Free Open-Source Artificial Intelligence

4672 readers

3 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

GitHub Stars

FOSAI Time Capsule

founded 2 years ago

MODERATORS

Blaed@lemmy.world

fosai@lemmy.world

What's the next gen AI tech you're using or experimenting with? (lemmy.world)

submitted 1 week ago by venusaur@lemmy.world to c/fosai@lemmy.world

13 comments fedilink hide all child comments

LLM’s are not the end all be all. What other AI tech are you all using? Something generative? Something else?

you are viewing a single comment's thread
view the rest of the comments

[–] venusaur@lemmy.world 1 points 22 hours ago (1 children)

Thanks! I’ll make sure to include Vulcan in criteria for a new machine and I’ll look at intel options. Only been looking at NVIDIA. Even 4GB VRAM will be a huge upgrade for me.

[–] N0tTr0xy@lemmy.dbzer0.com 2 points 19 hours ago (1 children)

All modern GPU drivers support Vulkan, at least on Linux. I don’t know how bad Vulkan does in comparison to CUDA, since I’ve never used that stuff. The bigger issue is software-side support. Ollama, llama-cpp and KoboldCPP all support Vulkan by now. ComfyUI doesn’t seem to support it.

[–] venusaur@lemmy.world 1 points 14 hours ago

Thanks! I’ve been using llama.cpp but not married to it. What’s your opinion on used machines? Presumably risky to get a used GPU or they don’t really just fail?