this post was submitted on 19 Aug 2026
463 points (96.6% liked)

Fuck AI

8062 readers
1082 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS
 

The Generative AI Learning Penalty: Evidence from Chinese Secondary Education

Using 30 months of panel data on 26,811 Chinese students in grades 7-12, we study how generative AI affects homework productivity and learning. The data combine monthly closed-book exams, high-school and college entrance exams, and homework scores and completion time across nine subjects. We exploit staggered AI adoption in a difference-in-differences design. AI adoption raises homework scores by 18% and reduces completion time by 30%, but lowers monthly exam scores by 20% within six months. High-stakes entrance-exam scores fall by 18 and 24%, with the full penalty emerging only after about two years. The losses are largest in social science subjects, followed by STEM and languages, and are especially large for junior students, high-achieving students, and boys. The learning losses are concentrated among roughly 80% of AI users whose behavior is consistent with homework outsourcing, as indicated by exceptionally short homework completion time coupled with high homework scores. AI users who maintain similar homework completion time as non-AI users experience small learning losses.

Edit: moving my comment up here

Just in case as it’s formatted a bit weirdly

X-Axis: Homework scores

Y-Axis: Exam scores

top 50 comments
sorted by: hot top controversial new old
[–] cannedtuna@lemmy.world 173 points 1 week ago* (last edited 1 week ago) (2 children)

Just in case as it’s formatted a bit weirdly

X-Axis: Homework scores

Y-Axis: Exam scores

[–] Lumidaub@feddit.org 69 points 1 week ago

That explain SO MUCH (meaning, the entire thing).

[–] merc@sh.itjust.works 8 points 1 week ago

The implication being that if you use AI to do your homework and score highly on it, when it comes time to take the exam you'll do very badly. If you don't use AI to do your homework, your exam scores will more or less match your homework scores.

Still, the shapes of the curves are weird. I guess it suggests that students scoring around 100 on their homework are probably not relying on AI overly much, so their exam scores are still decently high. But, every student who has a higher homework score is relying on AI and, as a result, their exams suffer?

What really sucks about this is that I don't think students have the self-discipline to not use AI. I'm old enough now to know that cutting corners to get good grades is dumb if it means I'm not learning. But, I wasn't smart enough to know that back then. I absolutely would have cut corners to get those good grades and get through the homework more quickly. My parents wouldn't have approved, but they weren't technologically sophisticated enough to stop me.

[–] brucethemoose@lemmy.world 159 points 1 week ago (4 children)

I'm sorry, but WTF is this chart without clear axes?

This is from the paper, and clearer to me.

Thank you. Spent entirely way too long figuring out WTF those axis were supposed to be.

[–] Tattorack@lemmy.world 9 points 1 week ago
[–] kingofras@lemmy.world 4 points 1 week ago (1 children)

Meanwhile on Lemmy: 3 downvotes.

I’m getting too old for this

[–] brucethemoose@lemmy.world 10 points 1 week ago (1 children)

Side tangent, but Lemmy is the worst with sources.

If I were admin, I’d make all users, new and extant, take an 8-minute course on clicking through reposts to finding original sources before they are allowed to submit posts.

That’s my rant.

[–] kingofras@lemmy.world 3 points 1 week ago

I don’t think you can prevent this from being posted, though I agree that resource should be available. It’s just that our attention spans have evaporated, everything must be instant and with LLMs it’s only accelerating.

This is about having a brief second of critical thinking and then not upvote or downvote the low effort post and upvote the first critical thinking comment.

Another thing on Lemmy is that we have half a dozen “users” who don’t care about the content, they just automatically post high engagement content from other platforms and post it here (without declaring themselves as a bot account too). And the mindless scrollers (at least 60-70%) going by this post, just take the bait.

Not having karma didn’t help much in hindsight.

[–] alphabethunter@lemmy.world 3 points 1 week ago* (last edited 1 week ago) (2 children)

EDIT: nevermind, I misread. I thought you were complaining about the one you posted... However, the image used by op is still a fairly obvious graph.

Edit 2: the axis of the graph posted by op are also clearly defined, vertical is exam scores, horizontal is homework. The definition shows above and below the graph itself.

It seems fairly obvious to me. It shows the clear mismatch between homework scores and test scores of AI users, where higher homework scores using AI correlate to lower test scores, clearly indicating that there is no learning, when compared to non-ai users, where higher homework scores directly translate to higher test scores as well.

[–] brucethemoose@lemmy.world 8 points 1 week ago

Yeah I get it.

Looking at the OP graph again, I get it now, but initially I found the top label to be confusing. I thought it was part of the title, and that the Y axis was unlabeled.

[–] Viceversa@lemmy.world 2 points 1 week ago* (last edited 1 week ago)

Y label is bold
has the prefix "China*,"
has additional row of text between the label and the diagram.
Not even remotely near Y axis.

X label is regular
doesn't have the prefix "China*,"
but has the suffix ", average without Al=100"

How is it clearly defined again?

[–] wander1236@sh.itjust.works 43 points 1 week ago (1 children)

Did AI come up with these axes?

[–] mnemonicmonkeys@sh.itjust.works 24 points 1 week ago (1 children)

This is actually a very good chart to explain outcomes. It shows that there's a positive linear relationship between homework and exam scores for students that don't use ai, and a terrible relationship for students that do use ai

[–] spongebue@lemmy.world 25 points 1 week ago (1 children)

I was taught to always label your axes.

[–] Knock_Knock_Lemmy_In@lemmy.world 4 points 1 week ago (1 children)

They are labelled. It's just the Y label is next to the title.

[–] Viceversa@lemmy.world 5 points 1 week ago (1 children)
[–] Knock_Knock_Lemmy_In@lemmy.world 2 points 1 week ago (1 children)

"China* average exam score"

[–] Viceversa@lemmy.world 1 points 1 week ago* (last edited 1 week ago) (1 children)

Oh god.

Y label is bold
has the prefix "China*,"
has additional row of text between the label and the diagram.

X label is regular
doesn't have the prefix "China*,"
but has the suffix ", average without Al=100"

Complete disaster of a diagram.
Was it made by AI, perchance?

[–] Knock_Knock_Lemmy_In@lemmy.world 2 points 1 week ago (2 children)

In the paper, Figure A11. Homework and Exam Score is well labeled and presented.

You should blame The Economist

load more comments (2 replies)
[–] YiddishMcSquidish@lemmy.today 28 points 1 week ago (1 children)

Dafuq is this graph? No labeling and arbitrary numbers. Was this graphic made by ai?

[–] Lumidaub@feddit.org 26 points 1 week ago (3 children)

Wouldn't a bar graph be better for this sort of data? The line keeps suggesting change over time to me and it's making the whole thing hard to read, even with OP's note.

[–] Feathercrown@lemmy.world 12 points 1 week ago* (last edited 1 week ago)

Disagree-- line graphs are good for most continuous x axes, not just time. There's no reason to group the homework scores but not the exam scores, as most usages of a bar graph here would, or to use a bar graoh with 1 bar per possible hw score (which is basically just a line chart anyways).

The issue with the chart is just that the axes aren't labelled well at all. X is hw, Y is exam, and it looks like rather than raw score it's using... score divided by the average score, as a %? So how much better or worse the score is than the average, as a percentage?

[–] TheYojimbo@lemmy.world 8 points 1 week ago

It got me confused too at first but once you think about it it makes a lot of sense : the gray line is mostly straight, efforts get rewarded, but the more they use AI in homework, the worst they do on exams, even worst than the worst of the no AI crowd

[–] stoly@lemmy.world 2 points 1 week ago

Funny is that when I saw the graph I immediately thought that most people would be confused.

[–] im_fine_sandy@nord.pub 21 points 1 week ago (1 children)

Cognitive attrition.

Turns out you need to practice doing things. Who knew.

[–] JapaneseJudas@fedinsfw.app 3 points 1 week ago

I've seen the term "cognitive surrender" being thrown around for this and I think they're two very nice terms to describe what's happening to our society right now

[–] Not_mikey@lemmy.dbzer0.com 20 points 1 week ago (1 children)

Looks like millennials / elder Gen z are going to be the most educated generation in history. Older generations were taught when they knew less about the world and education, younger generations are screwed both by the pandemic and now AI.

So Idiocracy was sort of right, only it's not the eugenics "dumb people have more kids" reason they gave, it's just us offloading our thinking to machines.

[–] Viceversa@lemmy.world 1 points 1 week ago

dumb people have more kids

That factor is valid too.

[–] davetortoise@reddthat.com 14 points 1 week ago

Hm, this is something that feels quite obvious but its very nice to have some hard data confirming it

[–] yogurtwrong@lemmy.world 8 points 1 week ago (2 children)

Homeworks are useless, school bad, Einstein had bad grades (no he didn't) crowd is very silent right now.

[–] Jankatarch@lemmy.world 12 points 1 week ago* (last edited 1 week ago)

Lemmy is pretty unfriendly to anti-intellectualism, thankfully.

[–] Klostein@reddthat.com 4 points 1 week ago* (last edited 5 days ago) (1 children)

He had a bad grade in French language and literature

6 is the best grade in Switzerland

[–] uniquethrowagay@feddit.org 3 points 1 week ago

6 is the best grade in Switzerland

It being the other way around in Germany has to be the origin of the myth.

[–] heartSagan5@lemmy.zip 6 points 1 week ago

Anybody “offloading skills” to AI is getting rusty as hell in those skills.

[–] TropicalDingdong@lemmy.world 4 points 1 week ago (2 children)

Home work and learning have never been about getting the right answers

[–] schipelblorp@sh.itjust.works 9 points 1 week ago

Promotion at work also isn't about being the best at your job.

Between social requirements and gaming metrics, it's a wonder we haven't collapsed yet.

[–] Jax@sh.itjust.works 3 points 1 week ago

You're right, homework was invented as punishment

[–] HairEater@thelemmy.club 3 points 1 week ago

Using AI to "learn" is like drinking beer to quench your thirst.

[–] Pruning9165@feddit.org 2 points 1 week ago

Meanwhile in the country where they made this study I saw a cram school signage boasting AI teachers (of I understood correctly)

If you don't think the wealthy are well aware of this, for them , put knowledge behind a paywall... I know I would have probably fallen for the ease of asking instead of researching and learning.

The next generation has lots of hurdles

[–] Abyssian@lemmy.world 2 points 1 week ago* (last edited 1 week ago)

Damn, Chinese kids who don't use AI are already putting in more than 110%.

[–] melsaskca@lemmy.ca 2 points 1 week ago

Yet another example that "tech bros" are selling snake oil to an unsuspecting customer base.

load more comments
view more: next ›