TechTakes

1778 readers

86 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago

MODERATORS

[email protected]

LLMs average <5% on 2025 Math Olympiad; award each other 20x points (arxiv.org)

submitted 6 days ago by [email protected] to c/[email protected]

44 comments fedilink hide all child comments

"Notably, O3-MINI, despite being one of the best reasoning models, frequently skipped essential proof steps by labeling them as "trivial", even when their validity was crucial."

you are viewing a single comment's thread
view the rest of the comments

[+] [email protected] -11 points 6 days ago (2 children)

Read the paper, it’s not simply predicting the next token. For instance, when writing a rhyming couplet, it first plans ahead on what the rhyme is, and then fills in the rest of the sentence.

The researchers were surprised by this too, they expected it to be the other way around.

[–] [email protected] 17 points 6 days ago

Oh, sorry, I got so absorbed into reading the riveting material about features predicting state name tokens to predict state capital tokens I missed that we were quibbling over the word "next". Alright they can predict tokens out of order, too. Very impressive I guess.

[–] [email protected] 14 points 6 days ago* (last edited 6 days ago)

first plans ahead

predict

to declare or tell in advance; prophesy; foretell;

ahead

Strongest matches: advanced; along; before; earlier; forward

stop prompting LLMs and go read some books, it'll do you a world of good