this post was submitted on 31 Aug 2026
180 points (98.4% liked)
Technology
87712 readers
2912 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don’t like conspiracy theories but hugging face was bought, tens of thousands of Mac’s were bought, RAM is “indefinitely “ high priced.
Starting to feel someone doesn’t want the self hosted AI to get legs.
Self hosting also requires a ton of RAM because each individual user has to load a (usually slightly smaller) model + KV cache, whereas for hosted, they load the huge-ass model once (per cluster) and then store KV caches for a bunch of users, which has better scaling.
The memory companies win whether you self-host or pay a subscription. They might win more if you self-host because look at the cost of self-hosting, it's actually pretty steep if you don't have the hardware already from the before times.
It's just hyper capitalism unfortunately.
Self hosting isnt a threat to them, most folks ain't doing that. And those of us who do already block most of their ways to generate revenue of our usage, so we don't really matter to them.