this post was submitted on 29 May 2026
815 points (98.7% liked)
Technology
85043 readers
2048 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Depends how big the model is. Smaller models can be dirt cheap.
Think deeper in Copilot is apparently o3-mini, or it used to be until recently. GPT 5.5 (and some other versions) are also an option, so I should try using these next week.
If you have a high VRAM GPU (like 16GB or more) you can try running some model locally with LMStudio. You won't get the same level as cloud models but depending on use case it might be good enough.
I only have an Radeon RX Vega 56 8GB HBM2, so limited to CPU-only. 64 GB memory there at least. Not upgrading unless hardware dies.
That's poor but not horrible. LMStudio has Vulkan compute backend option that works on almost any card. You can also do partial GPU/RAM split giving you total of 72GB and increased performance vs CPU only.
Hmm, have to try it sometime when the hot phase at work is over. Thanks!