this post was submitted on 15 Dec 2025
721 points (98.5% liked)

Technology

77742 readers
3787 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] thingAmaBob@lemmy.world 27 points 1 day ago (2 children)

I seriously keep reading LLM as MLM

[–] NikkiDimes@lemmy.world 22 points 1 day ago
[–] ChaoticEntropy@feddit.uk 2 points 1 day ago

The real money is from buying AI from me, in bulk, then reselling that AI to new vict... customers. Maybe they could white label your white label!

[–] PumpkinSkink@lemmy.world 36 points 1 day ago (3 children)

So you're saying that thorn guy might be on to somthing?

[–] LavaPlanet@sh.itjust.works 10 points 1 day ago (1 children)

Remember before they were released and the first we heard of them, were reports on the guy training them or testing or whatever, having a psychotic break and freaking out saying it was sentient. It's all been downhill from there, hey.

[–] Tattorack@lemmy.world 10 points 1 day ago (2 children)

I thought it was so comically stupid back then. But a friend of mine said this was just a bullshit way of hyping up AI.

[–] Toribor@corndog.social 5 points 1 day ago (1 children)

Seeing how much they've advanced over recent years I can't imagine whatever that guy was working on would actually impress anyone today.

[–] Petter1@discuss.tchncs.de 1 points 12 hours ago* (last edited 12 hours ago)

There are enough people thinking their agent is sentient but fear to speak out because they don’t understand why not, even when people try to explain…

[–] LavaPlanet@sh.itjust.works 2 points 1 day ago

That tracks. And It's kinda on brand, still. Skeezy af.

[–] Sam_Bass@lemmy.world 18 points 1 day ago

Thats a price you pay for all the indiscriminate scraping

[–] 87Six@lemmy.zip 17 points 1 day ago

Yea that's their entire purpose, to allow easy dishing of misinformation under the guise of

it's bleeding-edge tech, it makes mistakes

[–] AppleTea@lemmy.zip 8 points 1 day ago (1 children)

And this is why I do the captchas wrong.

load more comments (1 replies)
[–] ceenote@lemmy.world 191 points 2 days ago (2 children)

So, like with Godwin's law, the probability of a LLM being poisoned as it harvests enough data to become useful approaches 1.

[–] Gullible@sh.itjust.works 107 points 2 days ago (13 children)

I mean, if they didn’t piss in the pool, they’d have a lower chance of encountering piss. Godwin’s law is more benign and incidental. This is someone maliciously handing out extra Hitlers in a game of secret Hitler and then feeling shocked at the breakdown in the game

load more comments (13 replies)
[–] Clent@lemmy.dbzer0.com 2 points 1 day ago (1 children)

The problem is the harvesting.

In previous incarnations of this process they used curated data because of hardware limitations.

Now that hardware has improved they found if they throw enough random data into it, these complex patterns emerge.

The complexity also has a lot of people believing it's some form of emergent intelligence.

Research shows there is no emergent intelligence or they are incredibly brittle such as this one. Not to mention they end up spouting nonsense.

These things will remain toys until they get back to purposeful data inputs. But curation is expensive, harvesting is cheap.

[–] julietOscarEcho@sh.itjust.works 1 points 11 hours ago

Isn't "intelligence" so ill defined we can't prove it either way. All we have is models doing better on benchmarks and everyone shrieking "look emergent intelligence".

I disagree a bit on "toys". Machine summarization and translation is really quite powerful, but yeah that's a ways short of the claims that are being made.

[–] ZoteTheMighty@lemmy.zip 56 points 1 day ago (2 children)

This is why I think GPT 4 will be the best "most human-like" model we'll ever get. After that, we live in a post-GPT4 internet and all future models are polluted. Other models after that will be more optimized for things we know how to test for, but the general purpose "it just works" experience will get worse from here.

[–] jaykrown@lemmy.world 1 points 11 hours ago

That's not how this works at all. The people training these models are fully aware of bad data. There are entire careers dedicated to preserving high quality data. GPT-4 is terrible compared to something like Gemini 3 Pro or Claude Opus 4.5.

[–] krooklochurm@lemmy.ca 23 points 1 day ago (1 children)

Most human LLM anyway.

Word on the street is LLMs are a dead end anyway.

Maybe the next big model won't even need stupid amounts of training data.

[–] BangCrash@lemmy.world 6 points 1 day ago (1 children)
[–] MadPsyentist@lemmy.nz 2 points 18 hours ago

Will the real SLM Shady pleas stand up!

[–] supersquirrel@sopuli.xyz 98 points 2 days ago* (last edited 2 days ago) (11 children)

I made this point recently in a much more verbose form, but I want to reflect it briefly here, if you combine the vulnerability this article is talking about with the fact that large AI companies are most certainly stealing all the data they can and ignoring our demands to not do so the result is clear we have the opportunity to decisively poison future LLMs created by companies that refuse to follow the law or common decency with regards to privacy and ownership over the things we create with our own hands.

Whether we are talking about social media, personal websites... whatever if what you are creating is connected to the internet AI companies will steal it, so take advantage of that and add a little poison in as a thank you for stealing your labor :)

[–] Tollana1234567@lemmy.today 3 points 18 hours ago

dont they kinda poison themselves, when they scrape AI generated content too.

[–] korendian@lemmy.zip 60 points 2 days ago (28 children)

Not sure if the article covers it, but hypothetically, if one wanted to poison an LLM, how would one go about doing so?

[–] Meron35@lemmy.world 1 points 11 hours ago

Figure out how the AI scrapes the data, and just poison the data source.

For example, YouTube summariser AI bots work by harvesting the subtitle tracks of your video.

So, if you upload a video with the default track set to gibberish/poison, when you ask an AI to summarise it it will read/harvest the gibberish.

Here is a guide in how to do so:

https://youtu.be/NEDFUjqA1s8

[–] expatriado@lemmy.world 104 points 2 days ago (12 children)

it is as simple as adding a cup of sugar to the gasoline tank of your car, the extra calories will increase horsepower by 15%

[–] demizerone@lemmy.world 16 points 1 day ago

I give sugar to my car on its birthday for being a good car.

[–] Beacon@fedia.io 52 points 2 days ago (1 children)

I can verify personally that that's true. I put sugar in my gas tank and i was amazed how much better my car ran!

[–] setsubyou@lemmy.world 48 points 2 days ago

Since sugar is bad for you, I used organic maple syrup instead and it works just as well

load more comments (10 replies)
load more comments (26 replies)
load more comments (9 replies)
[–] kokesh@lemmy.world 70 points 1 day ago (8 children)

Is there some way I can contribute some poison?

load more comments (8 replies)
[–] Vupware@lemmy.zip 3 points 1 day ago (1 children)

The only way I could do that was if you had to do a little more work and I would be happy with it but you have a hard day and you don’t want me working on your day so you don’t want me doing that so you can get it all over with your own thing I would be fine if I was just trying not being rude to your friend or something but you don’t want me being mean and rude and rude and you just want me being mean I would just like you know that and you know I would like you and you know what I’m talking to do I would love you to do and you would love you too and you would like you know what to say and you would like you to me

[–] biggeoff@sh.itjust.works 3 points 1 day ago (1 children)
load more comments (1 replies)
load more comments
view more: next ›