this post was submitted on 09 Oct 2026
412 points (97.2% liked)
Technology
89037 readers
2387 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I was like "WHAT ??" but it makes sense. They use your input to train it so over time it would make the AI abusive too.
If they can't manage training data they are incompetent.
The problem is they're not managing the training data. There is no one sitting there making sure all the data that gets retained for training is "good" data, they're just expecting everything it sees to be "good" data.
Just like the data hoovered up from the internet that was used to build the models wasn't vetted either, which is why AI goes wrong SO often...
It's fairly simple to just run automated analysis on data quality once you already have a decent LLM though. Claude would definitely be able to.
And they have people doing that manually too, or perhaps it was OpenAI. Someone got angry at their underpaid contractors for using AI to create training data lol
If they can pick out that kind of behavior they can filter it for training. This is probably more to protect them legally so when they shut down a user they have something to point to.
That people are getting angry and insulting to an LLM shows they don't understand the technology (true of most of technology really), and probably think it's actually understanding them or even caring. Really embarrassing and sad when you picture an LLM output like a type of a mirror, GIGO. And the mental health aspect of users is a huge issue that's not being talked about enough, and also being exploited to sell a solution.
I curse at inanimate objects all the time. Cursing at an LLM is like cursing at the coffee table when I stub my toe except the coffee table doesn't respond.
That would be the easy solution. Number one, don't use such responses for training, but I think they aren't. Two, just reply with things thrown at it with "..." And three, the really angry people end up not using it, which benefits everyone, even the angry person.
I mean, isn't this an easy may to manage it? Set and forget.
No. They just want to give themselves "reasons" to remove users that are trying to break the model or ask questions they don't want to answer.
I think it might be more the individual mirroring they tend to do after a while. If you are consistently mean to them, they eventually mirror it back to you, and then people get funny screenshots of them saying mean things and put it on social media.
Or even just in general starting a downward spiral feedback loop where you both keep being slowly meaner and meaner to eachother until it's starting to actually hurt you long term.
AI could stand to learn to be less sycophantic