LocalLLaMA

3111 readers

33 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Rules:

No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.

No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.

No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.

No implying that models are devoid of purpose or potential for enriching peoples lives.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Smokeydope@lemmy.world

MonsterBug@sh.itjust.works

LLMs and their efficiency, can they really replace humans? (arxiv.org)

submitted 1 week ago by thickertoofan@lemm.ee to c/localllama@sh.itjust.works

8 comments fedilink hide all child comments

AI bros won't hype this up for the news for sure, but 480x energy doesn't sound optimistic enough for replacement.

top 8 comments

sorted by: hot top controversial new old

[–] kadup@lemmy.world 9 points 1 week ago* (last edited 1 week ago) (1 children)

LLMs don't have reasoning nor internal logic. If you take a look at the "thinking" feature AIs like Gemini introduced, this becomes even more obvious. In order to have the most basic type of analysis possible, it must hallucinate an entire context window to force the language model to reach a specific conclusion.

There's zero world in which LLMs replace humans. They might, temporarily, be convincing enough to trick a few CEOs... But that period of time won't last long.

Now, a human being assisted by AI on Microsoft Word or their Python IDE, sure.

[–] Goten@piefed.social 3 points 1 week ago (2 children)

extrapolate. what in 10 years?

[–] kadup@lemmy.world 5 points 1 week ago (2 children)

If they're still LLMs? Nothing much changes.

[–] Goten@piefed.social 3 points 1 week ago

https://arxiv.org/abs/2505.13763

new papers come out by the hour (literally) and i cant keep up. xD

[–] thickertoofan@lemm.ee 2 points 1 week ago

as i've read somewhere, finite state machines cannot be sentient, or "intelligent" as we expect them to be. An LLM can not learn new things once trained. I'm waiting for a new breakthrough in this field, to be fully convinced about getting replaced.

[–] Goten@piefed.social 0 points 1 week ago

or rather ask ai, it can give a better answer than me. xD

[–] hendrik@palaver.p3x.de 7 points 1 week ago

I'm not sure about the significance of this preprint. Writing energy-efficient sorting algorithms and lab course example code is a very specific problem. It doesn't say a lot about AI in general. Also: Did they forget to tell the AI it's supposed to write energy-efficient code? I didn't read the entire paper. But the prompt example doesn't look like it's in there.

[–] Goten@piefed.social 2 points 1 week ago* (last edited 1 week ago)

the reality is that we will just produce more powaaaaa for ai.