this post was submitted on 07 Mar 2025
40 points (91.7% liked)

Open Source

36307 readers
1 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 6 years ago
MODERATORS
top 12 comments
sorted by: hot top controversial new old
[–] JOMusic@lemmy.ml 7 points 1 year ago* (last edited 1 year ago)

GitHub here: https://github.com/allenai/OLMoE.swift

Ai2 make as much of their training data available as possible: https://huggingface.co/datasets/allenai/OLMoE-mix-0924

[–] jeena@piefed.jeena.net 4 points 1 year ago (1 children)

I wonder how bit it is, normally they call them something with 3B or 7b

[–] oktoberpaard@feddit.nl 1 points 1 year ago (1 children)

It’s 7 billion parameters big.

[–] jeena@piefed.jeena.net 1 points 1 year ago

Ah, nice, not bad for a iPhone model.

[–] kekmacska@lemmy.zip 3 points 1 year ago

Wanna see how you git clone and compile it on ios

[–] foremanguy92_@lemmy.ml 3 points 1 year ago (2 children)
[–] 2xsaiko@discuss.tchncs.de 6 points 1 year ago (2 children)

It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.

[–] foremanguy92_@lemmy.ml 1 points 1 year ago (1 children)
[–] 2xsaiko@discuss.tchncs.de 3 points 1 year ago (1 children)

It's Apple's API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it's actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml

[–] foremanguy92_@lemmy.ml 1 points 1 year ago* (last edited 1 year ago)

Seems like a good project to implement on the green side (Or pinguin side)

[–] JOMusic@lemmy.ml 2 points 1 year ago

according to the linked article, it sounds like it is for performance reasons.