Ask Lemmy
A Fediverse community for open-ended, thought provoking questions
Rules: (interactive)
1) Be nice and; have fun
Doxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them
2) All posts must end with a '?'
This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?
3) No spam
Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.
4) NSFW is okay, within reason
Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com.
NSFW comments should be restricted to posts tagged [NSFW].
5) This is not a support community.
It is not a place for 'how do I?', type questions.
If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.
6) No US Politics.
Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !askusa@discuss.online
Reminder: The terms of service apply here too.
Partnered Communities:
Logo design credit goes to: tubbadu
view the rest of the comments
Yes, though not a "traditional" one. I've got a voice recorder, I use it when I'm walking my dog to ramble on about whatever's on my mind. The day's events, my personal thoughts, to-do lists and notes, whatever. When I get home I dump the recording into a folder where some scripts I've written process the audio to produce a transcript (using the Whisper model from OpenAI) and then an LLM to create summaries and subject tags and so forth from it (currently Qwen3), entirely local on my computer. I've got an index for searching through them based on those AI-generated tags and summaries so I can more easily find old stuff if I need them or am curious for whatever reason.
I use entirely local AI because I am completely open and honest in there. Probably a bunch of blackmail material to be found if you dug deeply enough. I'm very careful with data security, none of this ever leaves my local systems.
I've been doing this for over ten years now, almost daily. I've always had a vague plan that someday I'd feed it all into an AI, it;s only just the past two years where that's actually started to become a reality. This weekend I'm going to experiment with upgrading my transcription AI to WhisperX, if it does a significantly better job I may have to rerun the whole dang thing through it all. Could take weeks, maybe months. I'm almost hoping it doesn't work. :)
How much storage does it take up? How much ram does the llm use?
My main recordings folder is 175 GB, for a little over ten years worth of recordings. That's not really all that much - consider how much a terabyte hard drive costs these days, it's a trivial expense. Even when you include the various backups I keep (definitely don't want a crash to take all that out).
My GPU's reasonably hefty, an RTX 4090 with 24GB of VRAM. But AI is a rapidly changing technology right now so who knows what the next six months will bring. Someone might come out with an awesome lightweight model, someone might announce they're going to be selling a cheap AI-specific card. My view has always been "save the data now because you can't save it later if you didn't save it now. You can process it any time."
How often do you find a yourself searching through your memos?
Not that often, but my search tools aren't very refined yet so it's probably a bit of a chicken-and-egg problem. The technology is advancing rapidly right now so I'm not putting a whole lot of effort into polish yet, since in six months some dramatic new tool might come out that invalidates everything I did so far. Like that potential WhisperX switch.
Most recently, I remember a situation where I didn't remember the name of some NPCs from a roleplaying game that were only in one or two adventures. I did a little searching and found them in a transcript from 2017. That was fun.