this post was submitted on 07 Mar 2025
40 points (91.7% liked)

Open Source

36307 readers
1 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 6 years ago
MODERATORS
top 12 comments
sorted by: hot top controversial new old
[–] JOMusic@lemmy.ml 7 points 11 months ago* (last edited 11 months ago)

GitHub here: https://github.com/allenai/OLMoE.swift

Ai2 make as much of their training data available as possible: https://huggingface.co/datasets/allenai/OLMoE-mix-0924

[–] jeena@piefed.jeena.net 4 points 11 months ago (1 children)

I wonder how bit it is, normally they call them something with 3B or 7b

[–] oktoberpaard@feddit.nl 1 points 11 months ago (1 children)

It’s 7 billion parameters big.

[–] jeena@piefed.jeena.net 1 points 11 months ago

Ah, nice, not bad for a iPhone model.

[–] kekmacska@lemmy.zip 3 points 11 months ago

Wanna see how you git clone and compile it on ios

[–] foremanguy92_@lemmy.ml 3 points 11 months ago (2 children)
[–] 2xsaiko@discuss.tchncs.de 6 points 11 months ago (2 children)

It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.

[–] foremanguy92_@lemmy.ml 1 points 11 months ago (1 children)
[–] 2xsaiko@discuss.tchncs.de 3 points 11 months ago (1 children)

It's Apple's API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it's actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml

[–] foremanguy92_@lemmy.ml 1 points 11 months ago* (last edited 11 months ago)

Seems like a good project to implement on the green side (Or pinguin side)

[–] JOMusic@lemmy.ml 2 points 11 months ago

according to the linked article, it sounds like it is for performance reasons.