Not The Onion

16607 readers

931 users here now

Welcome

We're not The Onion! Not affiliated with them in any way! Not operated by them in any way! All the news here is real!

The Rules

Posts must be:

Links to news stories from...
...credible sources, with...
...their original headlines, that...
...would make people who see the headline think, “That has got to be a story from The Onion, America’s Finest News Source.”

Please also avoid duplicates.

Comments and post content must abide by the server rules for Lemmy.world and generally abstain from trollish, bigoted, or otherwise disruptive behavior that makes this community less fun for everyone.

And that’s basically it!

founded 2 years ago

MODERATORS

kescusay@lemmy.world

946

Therapy Chatbot Tells Recovering Addict to Have a Little Meth as a Treat (futurism.com)

submitted 3 days ago by LordWiggle@lemmy.world to c/nottheonion@lemmy.world

183 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] pixxelkick@lemmy.world 4 points 3 days ago (1 children)

Cool

The paper clearly is about how a specific form of training on a model causes the outcome.

The article is actively disinformation then, it frames it as a user and not a scientific experiment, and it says it was Facebook llama model, but it wasn't.

It was a further altered model of llama that was further trained to do this

So, as I said, utter garbage journalism.

The actual title should be "Scientific study shows training a model based off user feedback can produce dangerous results"

[–] petrol_sniff_king@lemmy.blahaj.zone 1 points 2 days ago

I don't see how this is much different from the sycophancy "error" OpenAI built into its machine to drive user retention.

If a meth user is looking for reasons to keep using, then a yes-man AI system biased toward agreeing with them will give them reasons.

Honestly, it's much scarier than meth addiction; you could reasonably argue the meth user should pull up their bootstraps and simply refuse to use the sycophantic AI.

But what about flat-earthers? What about Q-Anon? These are not people looking for the treatment of their mental illness, and a sycophantic AI will tell them "You're on the right track. It's freedom fighters like you this country needs. NASA doesn't want people to know about this."