BlueMonday1984

joined 2 years ago
[–] BlueMonday1984@awful.systems 2 points 2 months ago (1 children)

LLM's ability to fake solving word problems hinges on being able to crib the answer, so using aliens from cartoons (or automatically-generating random names for objects/characters) will prove highly effective until AI corps can get the answers into their training data.

As for context breaks, those will remain highly effective against LLMs pretty much forever - successfully working around a context break requires reasoning, which LLMs are categorically incapable of doing.

Constantly and subtly twiddling with questions (ideally through automatic means) should prove effective as well - Apple got "reasoning" text extruders to flounder and fail at simple logic puzzles through such a method.

[–] BlueMonday1984@awful.systems 7 points 2 months ago (1 children)

A damn good find - bringing particular attention to this passage, since it pinpoints one of the major causes of the rot:

The following doesn’t apply to everybody in technology, but it applies to enough of them: At some point STEM education was the only thing the Olds cared about because of something something Asia, and now we have a couple of generations that are highly educated on paper and comically unaware of the complexity of the world outside of WordPress plugins.

[–] BlueMonday1984@awful.systems 8 points 2 months ago

OT: Baldur Bjarnason's lamented how his webdev feed has turned to complete shit:

Between the direct and indirect support of fascism and the uncritical embrace of LLMs and the overwhelming majority of the dev sites in my feed reader have turned to an undifferentiated puddle of nonsense…

…Two years ago these feeds (I never subscribed to any of the React grifters) were all largely posts on concrete problem-solving and, y’know, useful stuff. Useful dev discourse has collapsed into a tiny handful of blogs.

[–] BlueMonday1984@awful.systems 2 points 2 months ago (1 children)

Also accidentally posted in an old thread:

Hot take: If a text extruder’s winning gold medals at your contest, that’s not a sign the text extruder’s good at something, that’s a sign your contest is worthless for determining skill.

[–] BlueMonday1984@awful.systems 0 points 2 months ago

Hot take: If a text extruder's winning gold medals at your contest, that's not a sign the text extruder's good at something, that's a sign your contest is worthless for determining skill.

[–] BlueMonday1984@awful.systems 3 points 2 months ago

The purpose of artificial intelligence is to lie and deceive, so seeing it used to make "synthetic data" is infuriating, but not shocking.

You or I might think that claiming a chatbot model simulates human psychology was obviously a weird and foolish claim. So we have a response paper: “Large Language Models Do Not Simulate Human Psychology.” [arXiv, PDF]

That this has to be said at all pisses me off, but its at least nice to see there's some pushback against the knowledge destruction machine.

[–] BlueMonday1984@awful.systems 13 points 2 months ago

I feel like I'm having a stroke

[–] BlueMonday1984@awful.systems 2 points 2 months ago (1 children)

This isn't an idea that I've heard of until you mentioned it, so it likely hasn't got much purchase in the public consciousness. (Intuitively speaking, a computer which sucks at maths isn't a good computer, let alone AGI material.)

[–] BlueMonday1984@awful.systems 7 points 2 months ago

(I don't know why, but part of me's saying the quantum bubble isn't gonna last long. Its probably the fact the AI bubble is still going - when that bursts, the sheer economic devastation it'll cause will likely burst the quantum bubble as well.)

In this paper, Gutmann is telling cryptographers not to worry too much about quantum computing. Though cryptographers have still been on the case for a couple of decades, just in case there’s a breakthrough.

Cryptographers do tend to be paranoid about threats to encryption. Given how every single government's hellbent on breaking it or bypassing it, I can't blame them on that front.

The AI bubble launched with a super-impressive demo called ChatGPT, and quantum computing doesn’t have anything like that. There are no products. But the physics experiments are very pretty.

Moreover, quantum can't really break into the consumer market like AI has. AI had slopgens of all stripes and supposedly sky-high adoption (through [forcing it on everyone](https://www.bloodinthemachine.com/p/how-big-tech-is-force-feeding-us https://awful.systems/post/5348844)), quantum's gonna have none of that.

(I don't see the general public falling for the quantum hype, either, given how badly they got burned by the AI hype.)

[–] BlueMonday1984@awful.systems 9 points 2 months ago* (last edited 2 months ago)

New edition of AI Killed My Job, giving a deep dive into how genAI has hurt artists. I'd like to bring particular attention to Meilssa's story, which is roughly halfway through, specifically the ending:

There's a part of me that will never forgive the tech industry for what they've taken from me and what they've chosen to do with it. In the early days as the dawning horror set in, I cried about this almost every day. I wondered if I should quit making art. I contemplated suicide. I did nothing to these people, but every day I have to see them gleefully cheer online about the anticipated death of my chosen profession. I had no idea we artists were so hated—I still don't know why. What did my silly little cat drawings do to earn so much contempt? That part is probably one of the hardest consequences of AI to come to terms with. It didn't just try to take my job (or succeed in making my job worse) it exposed a whole lot of people who hate me and everything I am for reasons I can't fathom. They want to exploit me and see me eradicated at the same time.

[–] BlueMonday1984@awful.systems 5 points 2 months ago

Given how gen-AI has utterly consumed the tech industry over these past two years, I see very little reason to give the benefit of the doubt here.

Focusing on NVidia, they've made billions selling shovels in the AI gold rush (inflating their stock prices in the process), and have put billions more into money-burning AI startups to keep the bubble going. They have a vested interest in forcing AI onto everyone and everything they can.

view more: ‹ prev next ›