Mistral reports on the environmental impact of LLMs
1–10 of 59 posts
Re: Mistral reports on the environmental impact of LLMs
#2I would really like it if an LLM tool would show me the power consumption and environmental impact of each request I’ve submitted.
Re: Mistral reports on the environmental impact of LLMs
#3I would really like it if an LLM tool would show me the power consumption and environmental impact of each request I’ve submitted.
And each toilet flush you make should also have a Co2 calculation which should go against your daily carbon allowance.
Re: Mistral reports on the environmental impact of LLMs
#4I would really like it if an LLM tool would show me the power consumption and environmental impact of each request I’ve submitted.
Let’s call it GreenOps
Re: Mistral reports on the environmental impact of LLMs
#5I would really like it if an LLM tool would show me the power consumption and environmental impact of each request I’ve submitted.
And each toilet flush you make should also have a Co2 calculation which should go against your daily carbon allowance.
Spending drinking water for toilet flushes is indeed a problem. Perhaps not CO2 measurements directly, but informing people in general of how much high quality water is wasted on flushes alone will hopefully bring more momentum into more efficient flushing mechanism and introducing grey water systems to new and old buildings alike. Good idea!
Re: Mistral reports on the environmental impact of LLMs
#6So, using the smallest model for the task would help, as expected.
A very small model could run on device to automatically switch and choose the right model based on the request. It would help navigate the difficult naming of each model of each vendor for sure.
Re: Mistral reports on the environmental impact of LLMs
#7I would really like it if an LLM tool would show me the power consumption and environmental impact of each request I’ve submitted.
And each toilet flush you make should also have a Co2 calculation which should go against your daily carbon allowance.
people downvote your sarcasm, but if you do the calculations you're kinda right.
1Kg of Beef costs:
- The energy equivalent of 60.000 ChatGPT queries.
- The water equivalent of 50.000.000 ChatGPT queries.
- The water equivalent of 18.8 Tons of Beef.
- The CO2 equivalent of 204 Tons of Beef.
and one large LLM per 6 months.
So yeah, maybe use ChatGPT to ask for vegan recipes.
People will try to blame everything else they can get a hold on before changing the stuff that really has an impact, if it means touching their lifestyle.
The LLMs are not the problem here.
Re: Mistral reports on the environmental impact of LLMs
#8Earlier quoted context omitted.
And each toilet flush you make should also have a Co2 calculation which should go against your daily carbon allowance.
people downvote your sarcasm, but if you do the calculations you're kinda right. 1Kg of Beef costs: - The energy equivalent of 60.000 ChatGPT queries. - The water equivalent of 50.000.000 ChatGPT queries. Applied to their metric Mistral Large 2 used: - The water equivalent of 18.8 Tons of Beef. - The CO2 equivalent of 204 Tons of Beef. France produces 3836 Tons of Beef per day, and one large LLM per 6 months. So yeah…
The difference is that food is important and live-giving and LLMs are a very fancy magic 8-ball
Re: Mistral reports on the environmental impact of LLMs
#9Earlier quoted context omitted.
people downvote your sarcasm, but if you do the calculations you're kinda right. 1Kg of Beef costs: - The energy equivalent of 60.000 ChatGPT queries. - The water equivalent of 50.000.000 ChatGPT queries. Applied to their metric Mistral Large 2 used: - The water equivalent of 18.8 Tons of Beef. - The CO2 equivalent of 204 Tons of Beef. France produces 3836 Tons of Beef per day, and one large LLM per 6 months. So yeah…
The difference is that food is important and live-giving and LLMs are a very fancy magic 8-ball
You don't need beef, beef is a lifestyle choice.
I use LLMs to do all of my coding these days, it's certainly more essential for feeding me than beef.
Re: Mistral reports on the environmental impact of LLMs
#10Earlier quoted context omitted.
The difference is that food is important and live-giving and LLMs are a very fancy magic 8-ball
You don't need beef, beef is a lifestyle choice. I use LLMs to do all of my coding these days, it's certainly more essential for feeding me than beef.
[deleted]