BlueMonday1984

joined 2 years ago
[–] BlueMonday1984@awful.systems 8 points 4 months ago (7 children)

Found an attempt to poison LLMs in the wild recently, aimed at trying to trick people into destroying their Cybertrucks:

This is very much in the same vein as the iOS Wave hoax which aimed to trick people into microwaving their phones, and Eduardo Valdés-Hevia's highly successful attempt at engorging Google's AI summary systems.

Poisoning AI systems in this way isn't anything new (Baldur Bjarnason warned about it back in 2023), but seeing it used this way does make me suspect we're gonna see more ChatGPT-powered hoaxes like this in the future.

[–] BlueMonday1984@awful.systems 10 points 4 months ago* (last edited 4 months ago) (1 children)

Fear: There’s a million ways people could die, but featuring ones that require the fewest jumps in practicality seem the most fitting. Perhaps microdrones equipped with bioweapons that spray urban areas. Or malicious actors sending drone swarms to destroy crops or other vital infrastructure.

I can think of some more realistic ideas. Like AI-generated foraging books leading to people being poisoned, or chatbot-induced psychosis leading to suicide, or AI falsely accusing someone and sending a lynch mob after them, or people becoming utterly reliant on AI to function, leaving them vulnerable to being controlled by whoever owns whatever chatbot they're using.

All of these require zero jumps in practicality, and as a bonus, they don't need the "exponential growth" setup LW's AI Doomsday Scenarios™ require.

EDIT: Come to think of it, if you really wanted to make an AI Doomsday™ kinda movie, you could probably do an Idiocracy-style dystopia where the general masses are utterly reliant on AI, the villains control said masses through said AI, and the heroes have to defeat them by breaking the masses' reliance on AI.

[–] BlueMonday1984@awful.systems 11 points 4 months ago (1 children)

To slightly expand on that, there's also a rather well-known(?) quote by English mathematician G.H. Hardy, written in A Mathematician's Apology in 1940:

A science is said to be useful if its development tends to accentuate the existing inequalities in the distribution of wealth, or more directly promotes the destruction of human life.

(Ironically, two of the theories which he claimed had no wartime use - number theory and relativity - were used to break Enigma encryption and develop nuclear weapons, respectively.)

Expanding further, Pavel has noted on Bluesky that Russia's mathematical prowess was a consequence of the artillery corps requiring it for trajectory calculations.

[–] BlueMonday1984@awful.systems 8 points 4 months ago

HUMANCENTiPAD II: LLM Boogaloo

[–] BlueMonday1984@awful.systems 10 points 4 months ago (1 children)

The only way in which it may succeed as a deterrent is that it actually costs some money (film and processing cost real money and it’s not cheap) and requires actual work to do those extra steps.

I expect the "requires actual work" part will work well in deterring AI bros - they're lazy fucks by nature, anything more difficult than "press button for instant gratification" is gonna be a turn-off for them.

[–] BlueMonday1984@awful.systems 10 points 4 months ago (4 children)

Stumbled across a particularly odd case of AI hype in the wild today:

I will say it certainly does look different than standard AI slop, but like AI slop, its nothing particularly impressive - I can replicate something like this pretty easily, and without boiling an ocean to do it. Anyways, here's a sidenote:

In the wake of this bubble, part of me suspects physical media (e.g. photographic film) will earn a boost in popularity, alongside digital formats which LLMs struggle to generate. In both cases, the reason will be the same - simply by knowing something came on physical media or "slop-hardened media", you already have strong reason to believe the piece is human-made.

[–] BlueMonday1984@awful.systems 10 points 4 months ago

Looking at the comments, most of the outrage is on principle - they're here to hear Kevin McLeod's own output, not a slop-bot's.

[–] BlueMonday1984@awful.systems 5 points 4 months ago (1 children)

Whilst we're at it, bring back Tamagotchi - they don't ruin the planet, and also they're cute

[–] BlueMonday1984@awful.systems 8 points 4 months ago

The video is heavily euphemised and I think I got away with it

Sidenote: It would be hilarious if YouTube began demonetising videos featuring Microsoft Copilot's Cum Zone

[–] BlueMonday1984@awful.systems 4 points 4 months ago

I always had a vague outline of just how fucked up the rats are, but reading this put everything sharply into perspective for me. God damn, this was good.

[–] BlueMonday1984@awful.systems 21 points 4 months ago (8 children)

Baldur Bjarnason has given his thoughts:

I mean… yeah.

Also, between this and seeing tech types link glowingly to a crazypants “colonise the light cone by exploring latent space” type of delusional bullshit and I’m staring to worry that computers, as a concept, might not be salvageable after these clowns have run the show into the ground

[–] BlueMonday1984@awful.systems 12 points 4 months ago (4 children)

In other news, Kevin McLeod just received some major backlash for generating AI slop, with the track Kosmose Vaikus (which is described as made using Suno) getting the most outrage.

view more: ‹ prev next ›