this post was submitted on 23 Apr 2025
633 points (92.7% liked)

196

5125 readers
912 users here now

Be sure to follow the rule before you head out.


Rule: You must post before you leave.



Other rules

Behavior rules:

Posting rules:

NSFW: NSFW content is permitted but it must be tagged and have content warnings. Anything that doesn't adhere to this will be removed. Content warnings should be added like: [penis], [explicit description of sex]. Non-sexualized breasts of any gender are not considered inappropriate and therefore do not need to be blurred/tagged.

Also, when sharing art (comics etc.) please credit the creators.

If you have any questions, feel free to contact us on our matrix channel or email.

Other 196's:

founded 2 years ago
MODERATORS
 
top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 17 points 5 days ago

Somebody said The Apple ads for AI look like they're describing the people who are the biggest pieces of shit you work with or know.

[–] [email protected] 51 points 6 days ago (4 children)

What country? Sir Lanka? This isn't a useful comparison as is, I'll see if I can dig up actual numbers.

[–] [email protected] 20 points 6 days ago (1 children)

Following for the results of your work here so I can use it in the future.

[–] [email protected] 71 points 6 days ago (4 children)

From this 2023 paper, looks like if all Nvidia AI servers are running 24/7, you'd get an energy consumption of about 5.7–8.9 TWh per year. Nvidia servers make up 95% of the AI market (according to the paper) so that'd be pretty close to what AI servers would consume.

The paper also estimates about 20% of crypto mining GPUs no longer mining etherium converted to AI, which contributed another 16.1 TWh per year.

This doesn't include some AI, but it should be the majority.

Between those two sources, that gives 23.4 TWh per year. That gives 0.08 exta joules per year per this converter. That's 22% of Sri Lanka's energy consumption (which is the lowest country).

So AI in a year uses at much energy as Sri Lanka uses in 3 months. At least in 2023. I'll see if I can find a more recent study.

[–] [email protected] 23 points 6 days ago (1 children)

So that assumes AI requests use 100 percent of the hardware 100 percent of the time.

[–] [email protected] 13 points 6 days ago* (last edited 6 days ago) (3 children)

Yes, but those servers are pretty ai specific, so that's a decent assumption. Looks like Nvidia is drastically ramping up production of these servers, so current electricity use might be about 10x, I'm working on it.

load more comments (3 replies)
[–] [email protected] 15 points 6 days ago

This is the kind of comment I love on Lemmy.

load more comments (2 replies)
load more comments (3 replies)
[–] [email protected] 38 points 6 days ago (3 children)

This does misunderstand what actually costs the energy -- it's training the models that's costly, not using the already trained ones. Although to be fair using them increases incentive for new ones to be trained... But yeah asking ChatGPT for a recipe idea isn't burning an ounce of gasoline.

[–] [email protected] 9 points 5 days ago (1 children)

Using them is also very energy intensive (though much less so than training).

[–] [email protected] 5 points 5 days ago* (last edited 5 days ago) (7 children)

Playing a AAA game amount of energy vs running an entire data center on full blast amount of energy, is the comparison I like to make.

[–] [email protected] 4 points 5 days ago (2 children)

While the order of magnitude is correct, running the bigger models is closer to playing a AAA game on 8 computers at the same time.

load more comments (2 replies)
load more comments (6 replies)
[–] [email protected] 4 points 5 days ago (1 children)

But they are always training new models

load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 7 points 4 days ago

There's a misconception regarding the "consumption" of water, also a bit of a bias towards AI data centers whereas most used water is actually from energy production (via carbon, fuel or even hydroelectric) which is actually a factor to be considered when calculating the actual water use and consumption.

Regarding energy production and water "consumption" I read some papers and as far as I could understand numbers flactuate wildly. 5-40% of the water that runs through the system ends up being consumed via evaporation (so from potentially drinkable/usable for agriculture water to mostly water that ends up in the sea).

What I'm trying to say is that, yes, we should be very aware of the water that we consume in our big data centers but should also put a great focus on the water used by the energy that fuels the data center itself, much of the discourse ends up being "haha use water for email silly" when it should be a catalyst for a more informed approach to water consumption.

Basically I fear that the ai industry can make use of our ignorance and eappease with some "net zero" bs completely ignoring where most of the water is consumed and how.

And yes there are solutions to avoid using fresh water for energy production: solar/wind, using sea water, using polluted water, more sophisticated systems that actually "consume" as little water as possible. These methods have drawbacks that our governments and industry refuse to face and would rather consume and abuse our resources, I really want people to focus on that.

[–] [email protected] 5 points 4 days ago

I have local AI for this reason. All it does is toast my balls a bit, and waste 10's of watts of electricity.

[–] [email protected] 26 points 6 days ago (5 children)

Miyazaki's sadness was enough for me. He is right. This is humans losing faith in humans. Trust the machine, not yourself.

[–] [email protected] 18 points 6 days ago

Also AI is still worse than a human on things like essay writing. Why do I know? Cause I just finished grading midterms!

[–] [email protected] 7 points 6 days ago (1 children)

His popular AI quote is from 2016 and is missing a lot of context. What he was commenting on isn't anything like the current generative AI wave. That being said, he doesn't seem to have publicly rectified it so it might still represent his views.

[–] [email protected] 7 points 6 days ago* (last edited 6 days ago) (2 children)

Agreed. Based on ongoing circumstances and the general response from other high-profile animators in the industry, I am inclined to think that Miyazaki and others at Ghibli are still against AI art. But I also do feel that the quote from 2016 is being reused without the essential context.

Miyazaki opened his response by talking about a friend of his who suffers from a physical disability, which is entirely irrelevant to the topic of generative AI. In context, it was directed at a reinforcement-learning AI model that some artists implemented to try to animate human-like models in unorthodox and unnatural ways, with the proposed utility of using it for zombies or similar. Their suggestion was that these unnatural learned movements are meant to be seen as disturbing and monstrous.

The "insult to life itself" remark was with regards to how they seemed to be making a mockery of disability and, with his friend in mind, was not something he could approve of.

load more comments (2 replies)
load more comments (3 replies)
[–] [email protected] 4 points 4 days ago

I want cover letters to be shot in the street at noon

[–] [email protected] 15 points 6 days ago* (last edited 6 days ago) (5 children)

I found a blogpost that cites a Business Insider article that implies this claim as formulated is way off:

Reported energy use implies that ChatGPT consumes about as much energy as 20,000 American homes. An average US coal plant generates enough energy for 80,000 American homes every day. This means that even if OpenAI decided to power every one of its billion ChatGPT queries per day entirely on coal, all those queries together would only need one quarter of a single coal plant. ChatGPT is not the reason new coal plants are being opened to power AI data centers.

It goes on to argue that while it's true that AI related electricity use is booming, it's not because of LLM chatbots:

AI energy use is going to be a massive problem over the next 5 years. Projections say that by 2030 US data centers could use 9% of the country’s energy (they currently use 4%, mostly due to the internet rather than AI). Globally, data centers might rise from using 1% of the global energy grid to 21% of the grid by 2030. ...

97% of the total energy used by AI as of late 2024 is not being used by ChatGPT or similar apps, it’s being used for other services. What are those services? The actual data on which services are using how much energy is fuzzy, but the activities using the most energy are roughly in this order:

* Recommender Systems - Content recommendation engines and personalization models used by streaming platforms, e-commerce sites, social media feeds, and online advertising networks.

* Enterprise Analytics & Predictive AI - AI used in business and enterprise settings for data analytics, forecasting, and decision support.

* Search & Ad Targeting - The machine learning algorithms behind web search engines and online advertising networks.

* Computer vision - AI tasks involving image and video analysis – often referred to as computer vision. It includes models for image classification, object detection, facial recognition, video content analysis, medical image diagnostics, and content moderation (automatically flagging inappropriate images/videos). Examples are the face recognition algorithms used in photo tagging and surveillance, the object detection in self-driving car systems (though inference for autonomous vehicles largely runs on-board, not in data centers, the training of those models is data-center based), and the vision models that power services like Google Lens or Amazon’s image-based product search.

* Voice and Audio AI - AI systems that process spoken language or audio signals. The most prominent examples are voice assistants and speech recognition systems – such as Amazon’s Alexa, Google Assistant, Apple’s Siri, and voice-to-text dictation services.
[–] [email protected] 7 points 6 days ago (1 children)

You conveniently seem to have left this part from your first linked article out of your argument:

De Vries estimated in the paper that by 2027, the entire AI sector will consume between 85 to 134 terawatt-hours (a billion times a kilowatt-hour) annually.

"You're talking about AI electricity consumption potentially being half a percent of global electricity consumption by 2027," de Vries told The Verge. "I think that's a pretty significant number."

[–] [email protected] 6 points 5 days ago* (last edited 5 days ago)

No, I think that gets conveyed in the second half, the argument isn't that AI as a whole isn't using a lot of electricity, it's that this electricity use is being misattributed to LLM chatbots which are only a very small part of it.

load more comments (4 replies)
[–] [email protected] 5 points 5 days ago (1 children)

How does it actually consume the water?

[–] [email protected] 9 points 5 days ago (10 children)
[–] [email protected] 4 points 5 days ago (2 children)

How does it consume water? I thought it would be a closed loop?

load more comments (2 replies)
load more comments (9 replies)
load more comments
view more: next ›