this post was submitted on 30 Jun 2024
2 points (100.0% liked)
ChatGPT
9559 readers
2 users here now
Unofficial ChatGPT community to discuss anything ChatGPT
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Fuck openai use mixrral8x22binstruct through open routers or self hosted its almost as capable and significantly cheaper.
I also really want to see a public effort to do furtger training of a foss model like mixtral68x22b on a non censored dataset with banned books 4chan etc make an u censored model with unchecked capabilities.
I'm can't believe I'm considering purchasing another GPU just so I don't have to depend on OpenAI or anyone toying around with the models.
Now you know why the real winners of AI are chipmakers
I do have a local setup. Not powerful enough to run Mixtral 8x22b, but can run 8x7b (albeit quite slowly). Use it a lot.