this post was submitted on 09 Jan 2025
487 points (99.2% liked)
Opensource
2558 readers
82 users here now
A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!
⠀
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The most important part is that it’s a local ~~LLM~~ model running on your machine. The problem with AI is less about LLMs themselves, and more about their control and application by unethical companies and governments in a world driven by profit and power. And it’s none of those things, it’s just some open source code running on your device. So that’s cool and good.
Also the incessant ammounts of power/energy that they consume.
Running an llm llocally takes less power than playing a video game.
They aren't using a LLM, this is a speech to text model like Whisper.