Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
On the bar chart I included what I think are the most popular models right now (not objectively, based on my anecdotal observations, link to include/exclude what you want).
What do you think? Is it fair? There was, and to some digree still is, a bit of controversy about AA score indexes after they updated their benchmarks to V5.0. I am mainly interested in your thoughts about QFN in relation to other models.
Gemini encrypts their thinking traces, so if you inject a thought in an early thinking trace it always gets added after user context on any later message in the conversation.
That means if the thought trace disagrees with a user message it goes with the original thought trace.
E.g imagine you start a conversation with the date, then come back the next day. The thinking trace will make the model always think it’s the same date, no matter how much you argue.
They were working on fixing this, so not sure if the new models today fixes that.
Interesting, maybe caused by design focused on overprotection against distillation of the thinking process, so "it's a feature, not a bug" mentality. I don't use gemini models so I can't confirm by myself, thanks for pointing that out!
That is part of it.
The thinking trace is a base64 encoded proton if with an encrypted string inside