this post was submitted on 26 Nov 2025
433 points (98.7% liked)
Fuck AI
8457 readers
1433 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Can you help correct this for me? Don't you feed them valuable training data and exposure to real world problems in the process of using them?
No. AI models are pre-trained, they do not learn on the fly. They are hoping to discover General Artificial Intelligence, which is what you are describing. The problem is that they don't even understand exactly how training even works. While engineers understand the overall architecture, the specific "reasoning" or decision-making pathways within the model are too complex to fully interpret, leading to a gap between how it works and why it makes a particular decision.
My assumption wasn't that they learned on the fly, it was that they were trained on previous interactions. Eg the team developing them would use data collected from interaction with model v3 to train model v4. Seems like juicy relevant data they wouldn't even have to go steal and sort
That's true to an extend, but the interactions are only useful for training if you can mark it as good / bad etc (which is why sometimes apps will ask you if they were useful). But the 'best' training data like professional programming etc is usually sold at a premium tier with a promise not to use your data for training (since corporations don't want their secrets getting out).