Live data from Hacker News

Mistral reports on the environmental impact of LLMs

mistral.ai

51–59 of 59 posts

Re: Mistral reports on the environmental impact of LLMs

#51

Earlier quoted context omitted.

I think anyone that does get convinced and skip meat should be able to use LLMs without shame or guilt, while we continue to pressure everyone else to save resources and we continue to pressure LLM companies to save resources. LLM companies only get let off the hook if a very large fraction of their users do the meat skip thing, which is not very likely but could theoretically happen. LLMs being a new category of ene…

It was a yes or no question Like not an if or maybe thing, what do you see when you picture the future? Do you think “Skip meat for a day use LLMs for a year” will produce enough new vegans to offset the energy usage and co2 produced by the LLM architecture of your choice? Not asking if you want it to happen or if it’s something you can imagine could happen, I’m asking if you think it will [_] yes [_] no Because if n…

> It was a yes or no question [...] I’m asking if you think it will

[x] no

> Because if no, then the idea is just advocating for increased real consumption by invoking imaginary vegans!

Wrong.

> The person I was initially talking to took the position that LLM companies have negligible impact because people can be vegan.

He said "LLMs are not the problem here", which is true.

And he was arguing for individual use being offset when he said "maybe use ChatGPT to ask for vegan recipes".

The top level comment was also about individual use. "I would really like it if an LLM tool would show me the power consumption and environmental impact of each request I’ve submitted."

The comments right before you replied were also about individual use. "lifestyle choice".

> J-bp was saying that LLM companies shouldn’t be on anybody’s radars because uh, meat is 100,000 times worse.

The 100,000 number was a throwaway hypothetical to make a point. Not a number he was applying to LLMs in particular. Two lines later he threw in a 2,000x too.

And what he said is that LLM companies are not "somewhat equally important". Which is true. He didn't say you should ignore them entirely, just to have a sense of proportion.

-

Edit: Here is an important distinction that I think isn't getting through. There are multiple separate points being made by j-bp:

Point A, about not eating meat for a day, is only excusing anyone that actually does it. It's not a hypothetical that excuses the entire company.

Point B, about the size of the impact, suggests caring less about LLMs based on raw resource use. Point B does not care about the relatively small group of people that take up the offer in Point A. Point B is just looking at the big picture.

Re: Mistral reports on the environmental impact of LLMs

#52
post #38

It's sad to see the French of all people fall for guilt-trip austerity thinking. Just decarbonize the grid and move on. Energy is good.

France has a pretty low-carbon grid (relatively) already, this doesn't fix the water consumption issue though, which is getting more problematic as climate change cause droughts all over the country.

Re: Mistral reports on the environmental impact of LLMs

#53

Earlier quoted context omitted.

It was a yes or no question Like not an if or maybe thing, what do you see when you picture the future? Do you think “Skip meat for a day use LLMs for a year” will produce enough new vegans to offset the energy usage and co2 produced by the LLM architecture of your choice? Not asking if you want it to happen or if it’s something you can imagine could happen, I’m asking if you think it will [_] yes [_] no Because if n…

> It was a yes or no question [...] I’m asking if you think it will [x] no > Because if no, then the idea is just advocating for increased real consumption by invoking imaginary vegans! Wrong. > The person I was initially talking to took the position that LLM companies have negligible impact because people can be vegan. He said "LLMs are not the problem here", which is true. And he was arguing for individual use bein…

>[x] no

Then it is not a “very serious suggestion”. It is a thought experiment which should be taken with commensurate weight.

>Wrong

Explain what “skip a day of meat do a year of LLMs” is then. If it’s not just an ad for feeling good about using LLMs, what is it?

>The 100,000 number was a throwaway hypothetical to make a point

>Two lines later he threw in a 2,000x too.

Alright he said that meat is 2,000 times worse than language models as well as 100,000 times worse than language models. He might have meant 100k but could also mean 2k.

Do you have a real problem in real life where if somebody called you and said “it’s gotten two thousand times worse” versus “it’s gotten a hundred thousand times worse?” the former would be fine and the latter alarming?

If yes, what is the problem? Why was it a problem at 1x? 2000x? 100,000x? Why was it a problem at at 1x and 100,000x but not 2000x?

Re: Mistral reports on the environmental impact of LLMs

#54

Earlier quoted context omitted.

> It was a yes or no question [...] I’m asking if you think it will [x] no > Because if no, then the idea is just advocating for increased real consumption by invoking imaginary vegans! Wrong. > The person I was initially talking to took the position that LLM companies have negligible impact because people can be vegan. He said "LLMs are not the problem here", which is true. And he was arguing for individual use bein…

>[x] no Then it is not a “very serious suggestion”. It is a thought experiment which should be taken with commensurate weight. >Wrong Explain what “skip a day of meat do a year of LLMs” is then. If it’s not just an ad for feeling good about using LLMs, what is it? >The 100,000 number was a throwaway hypothetical to make a point >Two lines later he threw in a 2,000x too. Alright he said that meat is 2,000 times worse…

> Explain what “skip a day of meat do a year of LLMs” is then. If it’s not just an ad for feeling good about using LLMs, what is it?

You can stop being part of the problem if you do it. The problem still exists, but you are no longer part of it. You reduced it by more than your fair share. While the problem would stop existing if everyone made the same choice, there's no pretense that that's actually going to happen. LLM companies are not being excused by such an unlikely hypothetical.

j-lb also made an argument to not care much about LLMs at all, but it was separate from the "skip a day of meat" argument. That's where the big multiplier comes in. But again, separate argument.

I don't want to argue about the example ratio he used. The real ratio is very big if the numbers cited earlier are correct. So if you're going to sit here and say 2000x might as well be arbitrarily large then I think you just joined the "LLM resource use doesn't matter" team, because going by the above citation 2000x is in the ballpark of the correct number, so LLM use is 1 divided by arbitrarily large, making it negligible. Congrats.

Re: Mistral reports on the environmental impact of LLMs

#55
post #22
post #21

Earlier quoted context omitted.

Those are incredible stats. As a vegan who uses LLMs at work frequently, I would love to have the source as well :)

- https://mistral.ai/news/our-contribution-to-a-global-environmental-standard-for-ai - https://www.statista.com/statistics/1201677/greenhouse-gas-emissions-of-major-food-products/ - https://www.statista.com/chart/9483/how-thirsty-is-our-food/ - https://blog.samaltman.com/the-gentle-singularity - https://x.com/sama/status/1890820962993533232 You got to do the calculations yourself though.

Wow, thanks. I’m even coming up with 500K chatGPT queries for the amount of energy consumed as a KG of beef, though I might have moved a decimal place somewhere - feel free to check my math :)

“average query uses about 0.34 watt-hours of energy” - or 0.00034MWH

Using this calculator: https://www.epa.gov/energy/greenhouse-gas-equivalencies-calc... - in my zip, 0.0002KG of CO2 per MWH. (Though, I suppose it depends more on the zip where they’re doing inference, however this translation didn’t seem to vary much when I tried other zips)

Then, 99.48KG/0.0002KG= 497,400 chatGPT queries worth of CO2 per KG of beef?

Thanks for sharing!

Re: Mistral reports on the environmental impact of LLMs

#56
post #55
post #22

Earlier quoted context omitted.

- https://mistral.ai/news/our-contribution-to-a-global-environmental-standard-for-ai - https://www.statista.com/statistics/1201677/greenhouse-gas-emissions-of-major-food-products/ - https://www.statista.com/chart/9483/how-thirsty-is-our-food/ - https://blog.samaltman.com/the-gentle-singularity - https://x.com/sama/status/1890820962993533232 You got to do the calculations yourself though.

Wow, thanks. I’m even coming up with 500K chatGPT queries for the amount of energy consumed as a KG of beef, though I might have moved a decimal place somewhere - feel free to check my math :) “average query uses about 0.34 watt-hours of energy” - or 0.00034MWH Using this calculator: https://www.epa.gov/energy/greenhouse-gas-equivalencies-calc... - in my zip, 0.0002KG of CO2 per MWH. (Though, I suppose it depends mor…

`0.00034MWH`should probably be kilo not mega, but I think you still did it correctly :D

I think I used Btu (thermal units) in my calculation, so I only calculated actual energy expenditure for my 60.000 queries result.

But you are right, a better metric might be to use CO2-equivalent, because cows emit a lot of methane, whereas chatbots don't.

99.48KG / 0.228kg/kq = 436,315 queries per kg of beef.

Yup checks out!

Re: Mistral reports on the environmental impact of LLMs

#57

Earlier quoted context omitted.

>[x] no Then it is not a “very serious suggestion”. It is a thought experiment which should be taken with commensurate weight. >Wrong Explain what “skip a day of meat do a year of LLMs” is then. If it’s not just an ad for feeling good about using LLMs, what is it? >The 100,000 number was a throwaway hypothetical to make a point >Two lines later he threw in a 2,000x too. Alright he said that meat is 2,000 times worse…

> Explain what “skip a day of meat do a year of LLMs” is then. If it’s not just an ad for feeling good about using LLMs, what is it? You can stop being part of the problem if you do it. The problem still exists, but you are no longer part of it. You reduced it by more than your fair share. While the problem would stop existing if everyone made the same choice, there's no pretense that that's actually going to happen.…

Just wanted to chime in and say you represented my case perfectly and got all my points (and their separation) 100%!

You're right, I never said we should not care about LLMs because we also "rightfully don't care about meat".

To me the whole AI resource discussion is just a distraction for people who want to rally against a new scary thing, but not look at the real scary thing that they just gotten used to over the years.

In a sense it's the `banality of evil`, or maybe `banality of self destruction`:

  The “banality of evil” is the idea that evil does not have the Satan-like, villainous appearance we might typically associate it with. Rather, evil is perpetuated when immoral principles become normalized over time by people who do not think about things from the standpoint of others.
We've gotten so used to using huge amounts of resources in our day to day lives, that we are completely unwilling to stop and reflect about what we could readily change. Instead we fight against the new and shiny, because it tells a better story, distracting us from what really matters.

In a sense we are procrastinating on changing.

It's not the Skynet like AI that is going to be the doom of humankind, but the hot-dogs, taking your car for the commute, and shitty insulation.

Re: Mistral reports on the environmental impact of LLMs

#58
post #38

It's sad to see the French of all people fall for guilt-trip austerity thinking. Just decarbonize the grid and move on. Energy is good.

It's nice to see the French engineers collecting quantitative data to back future decisions thanks to our solid environment agency (the Ademe) work and public-private cooperation.

Re: Mistral reports on the environmental impact of LLMs

#59
post #38

It's sad to see the French of all people fall for guilt-trip austerity thinking. Just decarbonize the grid and move on. Energy is good.

It's nice to see the French engineers collecting quantitative data to back future decisions thanks to our solid environment agency (the Ademe) work and public-private cooperation.

hopefully they didn't fly to a conference in a private jet to report their findings...
Post reply on HN