Selfhosted

59897 readers

498 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam.
Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.
Don't duplicate the full text of your blog or git here. Just post the link for folks to click.
Submission headline should match the article title.
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

183

Self-GPT: Open WebUI + Ollama = Self Hosted ChatGPT (sh.itjust.works)

submitted 2 years ago by spiritedpause@sh.itjust.works to c/selfhosted@lemmy.world

50 comments fedilink hide all child comments

Instructions here: https://github.com/ghobs91/Self-GPT

If you’ve ever wanted a ChatGPT-style assistant but fully self-hosted and open source, Self-GPT is a handy script that bundles Open WebUI (chat interface front end) with Ollama (LLM backend).

Privacy & Control: Unlike ChatGPT, everything runs locally, so your data stays with you—great for those concerned about data privacy.
Cost: Once set up, self-hosting avoids monthly subscription fees. You’ll need decent hardware (ideally a GPU), but there’s a range of model sizes to fit different setups.
Flexibility: Open WebUI and Ollama support multiple models and let you switch between them easily, so you’re not locked into one provider.

you are viewing a single comment's thread
view the rest of the comments

[–] Player2@lemm.ee 10 points 2 years ago (3 children)

Wish I could accelerate these models with an Intel Arc card, unfortunately Ollama seems to only support Nvidia

[–] Deckweiss@lemmy.world 18 points 2 years ago* (last edited 2 years ago) (1 children)

They support AMD as well.

https://ollama.com/blog/amd-preview

also check out this thread:

https://github.com/ollama/ollama/issues/1590

Seems like you can run llama.cpp directly on intel ARC through Vulkan, but there are still some hurdles for ollama.

[–] Player2@lemm.ee 3 points 2 years ago

Interesting, I see that is pretty new. Some of the documentation must be out of date because it definitely said Nvidia only somewhere when I tested it about a month ago. Thanks for giving me hope!

[–] possiblylinux127@lemmy.zip 3 points 2 years ago

And AMD

You should be able to get llama.cpp to run on Arc but I'm not sure what performance you will get. It may not be worth it.