this post was submitted on 25 Jan 2026
456 points (97.7% liked)

Programmer Humor

28803 readers
444 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] FishFace@piefed.social 103 points 2 days ago (3 children)

LLMs work by picking the next word* as the most likely candidate word given its training and the context. Sometimes it gets into a situation where the model's view of "context" doesn't change when the word is picked, so the next word is just the same. Then the same thing happens again and around we go. There are fail-safe mechanisms to try and prevent it but they don't work perfectly.

*Token

[–] bunchberry@lemmy.world 1 points 19 hours ago (1 children)

This happened to me a lot when I tried to run big models with low context windows. It would effectively run out of memory so each new token wouldn't actually be added to the context so it would just get stuck in an infinite loop repeating the previous token. It is possible that there was a memory issue on Google's end.

[–] FishFace@piefed.social 1 points 11 hours ago

There is something wrong if it's not discarding old context to make room for new

[–] ideonek@piefed.social 20 points 2 days ago (1 children)

That was the answer I was looking for. So it's simmolar to "seahorse" emoji case, but this time.at some point he just glitched that most likely next world for this sentence is "or" and after adding the "or" is also "or" and after adding the next one is also "or", and after a 11th one... you may just as we'll commit. Since thats the same context as with 10.

Thanks!

[–] atomicbocks@sh.itjust.works -3 points 2 days ago (1 children)

He?

This is not a person and does not have a gender.

[–] ideonek@piefed.social 37 points 2 days ago* (last edited 2 days ago) (1 children)

Chill dude. It's a grammatical/translation error, not an ideological declaration. Especially common mistake if of your native language have "grammatical gender". Everything have "gender" in mine. "Spoon" is a "she" for example, but im not proposing to any one soon. Not all hills are worth nitpicking on.

[–] MonkderVierte@lemmy.zip 5 points 2 days ago

I've got it once in a "while it is not" "while it is" loop.