this post was submitted on 15 Jul 2026
160 points (95.5% liked)
Technology
86401 readers
2638 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
As a programmer I've been doing this, but only because a friend lent me a very powerful computer that I could never afford myself. That's the problem right now: local LLM use requires a huge upfront investment in equipment that most workers can't afford. But it does feel a lot better (and cheaper, once you have the equipment) to run the LLM on a server at home than on a server owned by some nasty tech company. If everyone could run open models locally some of the main objections would fall away.
So I disagree with the poster who said anything you can run at home isn't worth it, but the catch is you need an absurdly expensive computer. The one I'm using would cost about 6 times what I used to pay for a powerful development PC. The model and agent I'm using can do some complex things and get decent results. But right now no affordable computer can run them. On regular affordable computers the models you can run are indeed limited.