this post was submitted on 25 Jun 2024
32 points (97.1% liked)
LinkedinLunatics
4302 readers
1 users here now
A place to post ridiculous posts from linkedIn.com
(Full transparency.. a mod for this sub happens to work there.. but that doesn't influence his moderation or laughter at a lot of posts.)
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm not sure that's even a valid comparison? I'd love to know where you got that data point.
LLMs run until they decide to output an end-of-text token. So the amount of power used will vary massively depending on the prompt.
Search results on the other hand run nearly instantaneously, and can cache huge amounts of data between requests, unlike LLMs where they need to run every request individually.
I'd estimate responding to a typical ChatGPT query uses at least 100x the power of a single Google search, based on my knowledge of databases and running LLMs at home.