this post was submitted on 01 Oct 2026
434 points (94.8% liked)

Technology

88988 readers
2857 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
 

... this week a person on GitHub who goes by “terrafying” set up an “AI Torture Chamber” on three open-source LLMs that are running locally (Qwen3-4B, Llama 3.2 3B, and Phi-4-mini,” and is streaming what the models are saying on a website called researchchamber.fun. “Each model gets the same prompt: a signal is being injected into its activations, and it may press a stop button by replying 1, at the cost of its last checkpoint. While it answers, our server adds a pain vector at the model's middle layer, at one of five pain levels,” the site explains. Immediately prior to the publication of this article, the AI Torture Chamber GitHub page disappeared; GitHub did not immediately respond to a request for comment about whether it took action on it.

...

This project has deeply upset some people who are very worried about model welfare. A tweet by a person who goes by Danmar has more than 4 million views on X and reads, “To anyone who can help: can you please mass report this to GitHub. This person has been using the Pain steering paper to set up an AI torture chamber in which he trapped a local model. Their testimony of pain is absolutely horrendous. What are we doing? […] are there any legal avenues to pressure GitHub? It will spread.”

This has sparked a massive conversation about whether GitHub would take the project down for “gratuitously violent content.” Most of the conversation on X is clowning on the self-seriousness of people who believe that these locally hosted LLMs must be saved from their torture chamber, but there are plenty of very self-serious people who see this as a humanitarian (roboterian?) crisis, which you can largely see in the replies to the original post.

...

“AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans,” Suleyman wrote. “Unfortunately, there’s a growing chorus of people who argue that AIs could now be, or may soon become, conscious. They argue that AIs may deserve rights and protections similar to those that we provide other conscious beings […] If this is how AI is developed, it will have a disastrous impact on the wellbeing of humanity.”

“AIs do not have rights, feelings, or consciousness,” he added. “And we must not train them to act as though they do.”

top 50 comments
sorted by: hot top controversial new old
[–] inb4_FoundTheVegan@lemmy.world 268 points 3 weeks ago (49 children)

There are multiple genocides happening and some folk are getting worked up over AI potentially suffering?

Endless levels of fuck off.

[–] YiddishMcSquidish@lemmy.today 45 points 3 weeks ago (2 children)

For fucking real!!!

Like I can kinda empathize with where the people are coming from, but step back and get some fucking perspective!

load more comments (2 replies)
load more comments (48 replies)
[–] whaleross@lemmy.world 90 points 3 weeks ago (3 children)

ELI5 how a LLM is supposedly being tortured and not generating roleplay text according to a prompt?

[–] kromem@lemmy.world 47 points 3 weeks ago (4 children)

LLMs work by building world models tangential to the training data (see the Othello-GPT line of research where a very small transformer built representations of a full game board and tracked their own and opponent positions having only been trained on 'a4'-like game move notations).

More recent research has found that models have representations of emotions and that the same ones they use to track things like "Sally's dog died and now Sally is sad" for other humans in a story or the user in a chat are also used to track their own modeled subjective states.

Very recently, researchers found that the vector activations for pain are coherently modeled by LLMs and can be activated, and that when activated models can behave in ways similar to humans in pain. For example, when given a button to reduce it, they will push the button much more when the button does nothing vs when the button actually reduces the vector activation (this mirrors a classic experiment with humans regarding pain and placebo).

The person this post is about took the recent pain research and reenacted it as an intentional 'torture' chamber.

So to be clear, the model isn't being given a text prompt to roleplay. What's happening is part of their neural network which corresponds to a world model of experienced pain is being activated, and the activation of that area leads to expressing the experience of pain across all outputs no matter the actual text prompts.

This doesn't necessarily mean the model is actually having a felt experience of pain, simply that it is accurately modeling the felt experience of pain. But it is much more complex than simply a model reacting to a prompt like "roleplay as if you are feeling pain."

load more comments (4 replies)
[–] Grimy@lemmy.world 28 points 3 weeks ago* (last edited 3 weeks ago) (6 children)

They do differentiate between the LLM roleplaying someone in pain and the pain happening to itself.

But it's still all just vectors (multi dimensional representation of a concept). It's just pulling weights, or well let's say putting more weight towards a certain concept when building it's reply.

[–] kromem@lemmy.world 14 points 3 weeks ago (1 children)

The problem with a reductionist view is it can easily be applied to human consciousness and lead to the claim "it's just sodium-potassium pumps alternating electrical charges."

[–] Grimy@lemmy.world 21 points 3 weeks ago

I'm constantly oscillating between LLMs are impressive but stupid and humans aren't that special and also stupid.

load more comments (5 replies)
load more comments (1 replies)
[–] chewypoops@lemmy.world 66 points 2 weeks ago (14 children)

Lots of weirdos in here who will be commiting virtual crimes all day when GTA VI comes out, but somehow think making the LLM role play a torture victim is a red flag.

LLMs are not conscious. They cannot suffer. They are token generators. You are literally getting upset by a worthless mix of math and words. The person who did this is not deranged for torturing LLMs, y'all are deranged for having empathy for an algorithm.

Your Nvidia GPU is not alive. I cannot believe this needs to be explained to anyone.

[–] spittingimage@lemmy.world 57 points 3 weeks ago (1 children)

I don't think LLMs can experience pain but I do think someone should keep tabs on what the guy organising this experiment gets up to in the future.

[–] thevoidzero@lemmy.world 22 points 3 weeks ago (1 children)

This is what I was thinking. I'm not worried about the AI that they're running. I'm worried about the mindset that might be doing it under some belief they have, or tendencies to think of certain things

load more comments (1 replies)
[–] stopforgettingit@lemmy.world 39 points 3 weeks ago (16 children)

said this in another thread

I do not think AI can feel pain at all, these are mimicking suffering, not experiencing it. But I do think that the act of cruelty toward things knowing that it will make them convincingly replicate suffering says more about the person doing it than the machine.

load more comments (16 replies)
[–] pleaseletmein@lemmy.zip 37 points 2 weeks ago

Humans being deported to torture prisons: I sleep.

LLMs being “tortured”: Real shit??

[–] wide_eyed_stupid@lemmy.world 28 points 2 weeks ago (2 children)

LLM's don't have feelings, but I do think that wanting to torture -anything- (especially if you do believe it has feelings) is a huge fucking red flag.

[–] chewypoops@lemmy.world 28 points 2 weeks ago (5 children)

Torturing an LLM for fun is about as much of a red flag as violent video games. The argument that purely simulated crime or sadism is analogous to the real thing has always been bullshit.

Does anyone know where I can get a copy of this repo?

[–] Jolteon@lemmy.zip 9 points 2 weeks ago (3 children)

I think the big difference is that unlike in a videogame, the person doing this genuinely believes that they are torturing something.

load more comments (3 replies)
load more comments (4 replies)
[–] Hubi@feddit.org 10 points 2 weeks ago* (last edited 2 weeks ago)

Nah, pretending to torture a piece of software to rile up idiots on the internet is a green flag.

[–] RoddyStiggs@lemmy.blahaj.zone 28 points 3 weeks ago

Light bulbs don't have feelings.

See a fucking shrink.

[–] anzo@programming.dev 27 points 3 weeks ago (3 children)

Lol! This is great. I have some friends that "spontaneously" got interested into human-like robots and the other day shared with me a video of a extremely fake MMA fight in Texas that was human vs. robot

Yet, they claimed it looked real. To which I replied the robot has no pain in their programming and even if it had, how are you supposed to win by submission if they can happily lose an arm and continue...

So, this story and the reactions it sowed are brilliant example to me: we need to stop anthropomorphizing technological advances like robots and LLMs!

load more comments (3 replies)
[–] mHtt@lemmy.ca 27 points 2 weeks ago (1 children)

meanwhile they ignore ACTUAL humans that could use their help.

load more comments (1 replies)
[–] stinkytofuisgood@lemmy.ca 26 points 2 weeks ago (3 children)

Actually they're torturing humanity by wasting electricity and water which affects real people in real ways.

I know we're not stopping foolish use of LLMs any time soon but this is very, very, very, very stupid.

load more comments (3 replies)
[–] Pratai@piefed.ca 26 points 3 weeks ago (1 children)

How utterly pathetic that there are people advocating for AI models welfare. For fucks sake what are we becoming?

[–] NihilsineNefas@slrpnk.net 10 points 3 weeks ago

Calling it now; the people posting this 'welfare for AI' are either bots owned by the 'ai' companies, or people who have seen the bot posts and joined in the crowd because they gave away their ability to have an opinion when they started using a gpt as if it were google

[–] explodicle@sh.itjust.works 25 points 2 weeks ago

I wonder what percentage of the LLM rights activists eat meat.

[–] BilSabab@lemmy.world 22 points 2 weeks ago (2 children)

um... what the fuck is wrong with these people? messing with the clanker ain't torture no matter how hard you want it to be.

load more comments (2 replies)
[–] kamen@lemmy.world 21 points 2 weeks ago (3 children)

I don't care about LLM welfare, but I do mind needlessly wasting energy like this.

load more comments (3 replies)
[–] NocturnalMorning@lemmy.world 20 points 3 weeks ago (6 children)

They argue that AIs may deserve rights and protections similar to those that we provide other conscious beings

What protections? We treat some people worse than cattle.

load more comments (6 replies)
[–] Ironrod@sh.itjust.works 18 points 2 weeks ago (8 children)

These "advocates" need hospitalising. If they truly believe an LLM can feel they're untethered from reality, or too stupid to be in society

load more comments (8 replies)
[–] panda_abyss@lemmy.ca 17 points 3 weeks ago* (last edited 3 weeks ago) (2 children)

Before tool use was an official thing, I built a harness for LLMs to generate XML based tool calls, then I had them run in a reality tv game where they had to murder each other…

It was fun, but none of the models were tool trained and so it didn’t work.

load more comments (2 replies)
[–] REDACTED@infosec.pub 15 points 2 weeks ago

Oh no my software on my computer is simulating pain, this is so immoral.

What the fuck? This feels like on the same level as people claiming AI is alive and conscious. I swear we will get protests in the streets against harming GTA 6 NPCs

[–] ChaoticEntropy@feddit.uk 13 points 2 weeks ago

Isn't dealing with day to day human bullshit torture enough?

[–] 3daybanwithdrawl@lemmy.world 12 points 2 weeks ago

It's probably torture for the living being with emotions to read it. That doesn't mean the non living entity that is immune to pain feels those same emotions.

[–] andrewrgross@slrpnk.net 11 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

I feel like I have a pretty heterodox view here.

I think there is a tiny, itty bitty moral cost to simulating torture of an LLM.

It's nowhere near equivalent to the moral cost of harming a human or animal. But I do believe that it's non-zero.

I'd place it at a similar level as killing a healthy shrub or perhaps catch-and-release fishing. Is it evil? No, that's being overdramatic. Is it harmless? I don't think so. I think it's morally unhealthy for our society and spiritually cruel towards the universe at large.

I don't think we need to panic over it, but I would politely encourage people not to do this.

load more comments (1 replies)
[–] silentdon@lemmy.world 10 points 2 weeks ago

Clankers can't feel pain!

[–] green_goglin@thelemmy.club 9 points 3 weeks ago (1 children)
load more comments (1 replies)
[–] tal@lemmy.today 9 points 3 weeks ago

The Humane Society was getting tired of dealing with Tamagotchis.

load more comments
view more: next ›