me_irl

7664 readers

2566 users here now

All posts need to have the same title: me_irl it is allowed to use an emoji instead of the underscore _

founded 2 years ago

MODERATORS

herrwoland@lemmy.world

505

me_irl (lemmy.radio)

submitted 1 day ago by sanitation@lemmy.radio to c/me_irl@lemmy.world

67 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] CileTheSane@lemmy.ca 2 points 10 hours ago (2 children)

"Just 10 more data centers bro. Just another billion dollars and it will be as good as a person. Just 6 more months bro."

Yes, they are improving, but there is also deminishing returns. If you doubled the amount of resources in genAI right now you would not get something twice as good, you might get a 25% improvement, and the resources currently being used is already obscenely high. GenAI is slowly closing the gap, but the resources required to do so are rapidly increasing. Actually closing the gap in unsustainable.

then clearing context or changing engines and asking it to check your work throug the lense of a 5th grade teacher would very likely net you nearly undetectable results.

Did you literally just say "if you have genAI check the work of other genAI the genAI will say it's good"?

[–] faintwhenfree@lemmus.org 2 points 8 hours ago

25% wishful thinking. Valid point tho.

[–] rumba@lemmy.zip 0 points 7 hours ago* (last edited 7 hours ago)

Did you literally just say “if you have genAI check the work of other genAI the genAI will say it’s good”?

Yes, that is how they're getting by a large number of the previous issues. Multiple tries across versions of models with different training. Add in web searches. They're getting accuracy by cheating precision. It's expensive as fuck too.

but there is also deminishing returns.

absolutely correct. One query to local llm has a decent chance to be wrong. To bump that up, they're generating a shit ton of queries. It's eventually good for humanity overall, by the time they get it truly reasonable, the cost of the queries will be so high that when venture cap runs out, no one will be able to afford it even if it is replacing wages. Then we can go back to just using it as a tool.