You're absolutely right! Those posts do have many indicators of having been written by an AI. You're doing a great job finding these comments
News and Discussions about Reddit
Welcome to !reddit. This is a community for all news and discussions about Reddit.
The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:
Rules
Rule 1- No brigading.
**You may not encourage brigading any communities or subreddits in any way. **
YSKs are about self-improvement on how to do things.
Rule 2- No illegal or NSFW or gore content.
**No illegal or NSFW or gore content. **
Rule 3- Do not seek mental, medical and professional help here.
Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.
Rule 4- No self promotion or upvote-farming of any kind.
That's it.
Rule 5- No baiting or sealioning or promoting an agenda.
Posts and comments which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.
Rule 6- Regarding META posts.
Provided it is about the community itself, you may post non-Reddit posts using the [META] tag on your post title.
Rule 7- You can't harass or disturb other members.
If you vocally harass or discriminate against any individual member, you will be removed.
Likewise, if you are a member, sympathiser or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people, and you were provably vocal about your hate, then you will be banned on sight.
Rule 8- All comments should try to stay relevant to their parent content.
Rule 9- Reposts from other platforms are not allowed.
Let everyone have their own content.
Rule 10- Majority of bots aren't allowed to participate here. This includes using AI responses and summaries.
that is completely correct! it's awe—inspiring to see this level of rigorous investigation. that sort of attention to detail gives me hope that something can be done about this problem. this post fills me with hope for humanity
Totally feel this. It’s kinda wild how refreshing it is to see someone actually dig in instead of just shouting hot takes into the void. When people put in real effort — like, actual research, receipts, context, the whole thing — it reminds you that not everyone is just doomscrolling and giving up.
Honestly, posts like this are the rare moments where you remember, “Oh right, humans can be competent and thoughtful.” Gives me a tiny spark of optimism I didn’t expect today.
More of this energy, please.
Agreed.
Very good
To make a grilled cheese you need the following ingredients:
- Bread
- Cheese
- Butter
Step 1: Melt butter in a pan.
Step 2: Place the bread on the butter. Soak the butter in.
Step 3: Add the cheese slice to the bread.
Step 4: Put the bread on top of the cheese.
Step 5: Grill the sandwhich on both sides until golden brown.
Some good additions to grilled cheese are tomatoes, ham, or uranium-238.
Absolutely! Of all of the grilled cheese recipes out there this is by far one of the recipes out there. A little bit of cheese can really make your day better. Just like that time that Mankind faced off against The Undertaker the WWF pay per view special "Hell in a Cell", 1998. Mankind climbed to the top of the 16 foot cage and taunted the Undertaker to wrestle him up high, only to end up getting thrown into the commentator tables below. Everyone thought the match was over but just before Mankind was taken out in a stretcher he got up and ran back for more. I'll never forget how The Undertaker choke slammed him through the top of the cage and onto the thumb tacks below. It just really gives me hope for humanity.
Affirmative.
You have run out of tokens on free plaaauuuhhh I mean good job
Reddit has so rapidly descended into nothing but bots. Especially on certain subs, for some reason... Even some quite niche ones just seem to be bots talking to each other. Fortunately the only sub I really want to keep my reddit account for is mostly safe, but even there we had some issues.
In some cases I get what's happening - bot post with featuring some kind of obscure product, then buried in the comments you find the bot replies letting people know (apparently organically) where they can buy it - but in other cases like this it just seems pointless. I suppose the idea is to make the profiles seem natural, but they're almost all private anyway.
All of social media is dying before our eyes. every platform is basically fully botted or actively dying, even lemmy seems to have fallen off quite a bit
I am working on LLM detection for the threadiverse. But other than one idiot last week spamming LLM posts and comments there hasn't been much.
There are in politics conversations, but still not nearly as bad as reddit. Even before I left, it was like a weird kind of prolific dead. Kind of like the conversations in OP's pics.
It's actually the blessing of not being big enough to attract their attention
Just going to put my tinfoil hat on for a sec…
Part of me does wonder if the seemingly pointless proliferation of ai slop like this botting is being done intentionally to fast-track a ‘need’ for identity verification (and thus more precise tracking and surveillance).
ID verification is already being pushed on a few fronts (like to ‘save the kids from social media’ or whatever), maybe this is just one of many irons in the fire.
With ID verification then Facebook etc could angle themselves as ‘save havens’ from an ai slop enshittified internet. You’d essentially have to completely give up your anonymity to participate in interactions with other verified humans.
So your choices become:
- Participate in open platforms, but never really know for sure if you’re dealing with humans. At some point LLMs may be good enough that it’s impossible to know.
- Participate in closed platforms, where you can be reassured you’re engaging with real humans - but you’re also under total surveillance.
Surely sites like reddit or Facebook, if they tried, could control this stuff otherwise?
Participate in closed platforms, where you can be reassured you’re engaging with real humans - but you’re also under total surveillance.
Closed platforms where the only propaganda bots are the ones controlled by the platform. They can then remove ADs from the business model and instead finance the platform by selling access to the bot accounts. And people will think they are in the perfect social media without advertising and only RealPeople™ that they can completely trust.
Thirtyish years ago, we played a multiplayer online game called "LPMud". There were three talking NPCs in the game: Harry, basically a simple programming example on talking and reacting NPCs, Sir Obliterator, a dark knight with a more advanced vocabulary and a few talking points about a quest, and Eliza, basically a NPC with an Eliza engine.
Usually, they never met. Harry "lived" in the core area of the game, Sir Obliterator in or around the quest area to which he belonged, and Eliza was normally not even active.
Some wizard had summoned them all to the guild hall, the entrance area of the game for fun, and they were rather busy "talking" with each other.
They were annoying, but also hilarious...
...i spent many hours in the darker realms donning the afro, jive ring, and few other similar text-parsing items simultaneously to wildly comedic effect...
Gaslight trainers
Gotta kick out all the human users to make room for more of these.
It’ll be so nice when the bots can post for all of us on the internet! It’ll give us plenty of free time to spend in the mines
Someone's told the last AI not to use capital letters because some someone somewhere thinks that makes it look more human. Forgetting of course that autocorrect would change most non-capitalized words into capitalised ones automatically — so it's just suspicious.
If enough of them make this mistake they will start training with it too.
If money doesn't run out by then, there will be a point where 99% of reddit comments are chatbots and also due to incest-data everyone can tell which one at glance.
And no amount if scrape-training can happen after then.
Where LLM though? All I see in this screenshot is a plane full of essential oils saleswomen from Utah..
Notice how some try seeming more 'human' by deliberately using all lower-case spelling.
Also, it looks like the RosalieBloomm LLM is using the "real" apostrophe ’ instead of the one on keyboards '. Nobody does that
Not in chat, but professional writers will. They know all the short keys for those type characters, including that m dash everyone now associates with being AI. It just shows how much of the training data used came from professional papers and not general discussion areas.
This is just the lazi AI replies that sticks out and you aren't seeing the bigger picture. Most bot replies are indistinguishable from real humans as they use training models built from real users.
You're totally right! The eloquence and creativity showcased in AI comments underscores how they cannot be distinguished from comments by human users.
Remember when /r/SubredditSimulator was just an experiment?
Loved that sub and how they would get stuck in loops trying to decide loops trying to decide loops trying to decide loops
This isn’t new. This has been going for maybe 10 years or so if you knew where to look and how to notice them. However, when Reddit changed its API policy in 2023, that wholly crippled any infrastructure to effectively deal with these accounts and allowed them to flourish without restraint.
It’s also important to note that the Threadiverse is not immune from bot accounts like this sprouting up and we should take steps to educate users and to implement infrastructure to deal with them.
Sometimes I end up mindlessly scrolling yt shorts (not logged in). From time to time I get to a short that is clearly generated. Like the weird ones, often with animals, with drops of water appearing out of nowhere on the fur or front paws somehow transforming into hind ones, etc. And there, in the comments, very often are whole chains of comments that seem to completely be missing the fact that it's generated. Saying things "how wise it is to do that", "how cute", etc. It could be older generations not noticing the details (I see how my parents not notice those things) but I think most of those are probably bots. LLMs exchanging their "awww"s under generated videos. "Dead internet theory"
YT has become really bad. I've seen entire threads of dozens of weirdly similar comments crop up within minutes, driving certain political narratives. It's awful, eerie. Like witnessing a world-wide invasion of rogue terminators from the future in real-time.
"So this is how liberty dies... with thunderous, botted likes and upvotes."
Do LLMs always omit the period on their last sentence? Seems like that would be a dead giveaway
No, when it comes to LLMs there's hardly any "dead giveaways" now. You have to learn to recognize the patterns.
Omitting the final punctuation is quite a common thing people do, in fact you did in your comment. It's probably just a part of the system prompt.
Yeah, LLM would probably not omit the final punctuation unless specifically prompted to or unless it is given a ton of examples of comments it should mimic in the prompt.
Which it probably will have because it's been trained on Reddit comments.
in fact you did in your comment
Whoosh
i don't think i (or perhaps anyone) can recognize any single particular comment as being llm generated... but when the bots come in force it is still really easy. basically it boils down to this: many replies keep reiterating the same exact points in slightly different way with the same exact keywords. if you would use chatgpt to summarize each response you'd get basically the same thing from all bot replies.
I agree. I believe it's difficult for me—or anyone else—to pinpoint a specific comment as being generated by an LLM. However, when numerous bots are involved, the pattern becomes clear. Essentially, many responses end up repeating the same points, just phrased differently and using the same keywords. If you were to use ChatGPT to summarize each response, you'd essentially get a very similar outcome from all the bot-generated replies.
There already was that subreddit that consisted purely of bots talking to eachother. But that was before ChatGPT, so it was still cool and interesting :p
IIRC it was called subredditsimulator
Most of the outputs were horrible like the auto suggestion from the smaetphone keyboard but the good ones were upvoted.
Exactly, I agree.
Yes, this absolutely. This kind of research in a changing world like ours is really important right now. Major respect to her for that
/j
I was typing a long comment about all this, but in the end I decided to sum it up:
Fuck Reddit and Fuck AI.
Just some years ago the dead internet theory was said to be a fun but untrue thought. Well.
- consuming so much AI content has led to me able to see subtle patterns
It's a certain "tone" to their written text. It's difficult to identify from small blurbs like the ones you got there, but once you've seen enough LLM output, even if someone tells them to write in a specific "style" they'll still have a certain uncanny type of expression that is almost, but never actually, how humans write.
I think the two words and a number are what Reddit will come up with if you let them pick a name
Adjective-Noun-# is the usual format for those. This looks different, like someone put in a list of wholesome / floral / nature-y terms into the name generator, in order to have wholesome looking accounts
