this post was submitted on 07 Mar 2025
40 points (91.7% liked)

Open Source

35531 readers
864 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
top 12 comments
sorted by: hot top controversial new old
[–] JOMusic@lemmy.ml 7 points 1 month ago* (last edited 1 month ago)

GitHub here: https://github.com/allenai/OLMoE.swift

Ai2 make as much of their training data available as possible: https://huggingface.co/datasets/allenai/OLMoE-mix-0924

[–] jeena@piefed.jeena.net 4 points 1 month ago (1 children)

I wonder how bit it is, normally they call them something with 3B or 7b

[–] oktoberpaard@feddit.nl 1 points 1 month ago (1 children)

It’s 7 billion parameters big.

[–] jeena@piefed.jeena.net 1 points 1 month ago

Ah, nice, not bad for a iPhone model.

[–] kekmacska@lemmy.zip 3 points 1 month ago

Wanna see how you git clone and compile it on ios

[–] foremanguy92_@lemmy.ml 3 points 1 month ago (2 children)
[–] 2xsaiko@discuss.tchncs.de 6 points 1 month ago (2 children)

It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.

[–] foremanguy92_@lemmy.ml 1 points 1 month ago (1 children)
[–] 2xsaiko@discuss.tchncs.de 3 points 1 month ago (1 children)

It's Apple's API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it's actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml

[–] foremanguy92_@lemmy.ml 1 points 1 month ago* (last edited 1 month ago)

Seems like a good project to implement on the green side (Or pinguin side)

[–] JOMusic@lemmy.ml 2 points 1 month ago

according to the linked article, it sounds like it is for performance reasons.