this post was submitted on 01 Nov 2026
292 points (98.0% liked)

Technology

89619 readers
3770 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] humanspiral@lemmy.ca 10 points 1 week ago* (last edited 1 week ago) (2 children)

Confusing headline/article. Darkbloom does not serve proprietary models. It is competitive for smaller models. best price for qwen 3.8 27b.

The actual competition problem is from deepseek which has open sourced its inference server architecture on Nvidia (and Huawei) datacenter cards, and deepseek v4.1 flash is one of the best combos of good, fast, cheap. But it needs a mac ultra for q4, and datacenters much faster/cheaper with batch service. Qwen 4 is coming out next week with 2 good models that fit under 128gb.

[–] Diurnambule@jlai.lu 1 points 1 week ago* (last edited 1 week ago) (1 children)

Qwen 4 next week ? Got info on this ? I just managed to make glm 5.3 flash run on my system.

[–] twilightwolf90@lemmy.world 1 points 1 week ago

The CTO of Alibaba announced it earlier last week.

[–] boonhet@sopuli.xyz 1 points 1 week ago (1 children)

As I understand, only 27B is known to come out as open weight, Max and Plus are API-only anyway and it's suspected that so is Flash. Makes sense tbh, they've established their position in the market, now it's time to stop giving people better and better models they can run locally. It eats into their profits.

[–] humanspiral@lemmy.ca 1 points 1 week ago

Max has always been API/proprietary. Plus has shifted between the 2, but could very well be API only. Flash the 120b parameter model was new in 3.8. Current king with strata, and I'd be surprised if it wasn't open. 27b is what drove 5090 to $7000, though flash next is the real 3.8 king.