LocalLLaMA

2845 readers

2 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

[email protected]

SpatialLM, a 1B model capable of spatial identification, using 3d point cloud data. The video demo is amazing. (manycore-research.github.io)

submitted 3 weeks ago by [email protected] to c/[email protected]

6 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 3 weeks ago (1 children)

Looks impressive and it's truly open-source.

However, I see it requires CUDA. Could it run anyway:

Without this?
With AMD hardware?
On mobile (as the model is only 1B) ?

[–] [email protected] 2 points 3 weeks ago

I think the bigger bottleneck is SLAM, running that is intensive, it wont directly run on video, and SLAM is tough i guess, reading the repo doesn't give any clues of it being able to run on CPU inference.