Machine Learning

596 readers

10 users here now

A community for posting things related to machine learning

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

founded 2 years ago

MODERATORS

Ategon@programming.dev

Akisamb@programming.dev

ericjmorey@programming.dev

Researchers figured out how to run a 120-billion parameter model across four regular desktop PCs (actu.epfl.ch)

submitted 4 days ago by noumenon@lemmy.world to c/machine_learning@programming.dev

4 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Kissaki@programming.dev 1 points 4 days ago

The article isn't very concrete on what the substance of this Anyway System is.

The FAQ answered my question though, and it seems mostly about dynamic management of PCs as execution nodes.

I assume that means I could run the model on one of those PCs as well, despite the article claiming you can use as few as four PCs? Or does this system somehow distribute a single model prompt process into multiple execution pipelines?