Earlier quoted context omitted.
Oh whoops! That's an embarrassing mistake, and I didn't realize I had that point twice. They're not running at a loss. I'll fix that.
If they are subsidised they can make a profit while still not making enough money to cover energy costs.
Things we learned about LLMs in 2024
21–30 of 615 posts
Re: Things we learned about LLMs in 2024
#22"learned out about" - is that an Australian phraseology by chance? Sounds Australian or British of some manner.
Re: Things we learned about LLMs in 2024
#23Don’t forget that 2024 was also a record year for new methane power plant projects. Some 200 new projects in the US alone and I’d wager most of them are funded directly by big tech for AI data centres. https://www.bnnbloomberg.ca/investing/2024/09/16/ai-boom-is-... This is definitely extending the runway of O&G at a crisis point in the climate disaster when we’re supposed to be reducing and shutting down these power…
It would be really cool if big tech could find a new hyperscaler model that didn't also require offsetting the goals of green energy projects worldwide. Between LLM and crypto you'd swear they're trying to find the most energy-wasteful tech possible.
Re: Things we learned about LLMs in 2024
#24Don’t forget that 2024 was also a record year for new methane power plant projects. Some 200 new projects in the US alone and I’d wager most of them are funded directly by big tech for AI data centres. https://www.bnnbloomberg.ca/investing/2024/09/16/ai-boom-is-... This is definitely extending the runway of O&G at a crisis point in the climate disaster when we’re supposed to be reducing and shutting down these power…
Re: Things we learned about LLMs in 2024
#25"learned out about" - is that an Australian phraseology by chance? Sounds Australian or British of some manner.
That was a very dumb typo in my title!
Re: Things we learned about LLMs in 2024
#26Having Slop generations from an LLM is a choice. There are so many tricks to make models genuinely creative just at the sampler level alone.
Re: Things we learned about LLMs in 2024
#27But that doesn’t necessarily reflect the potential of the underlying technology, which is developing rapidly. Websites were goofy and pointless until Amazon came around (or Yahoo or whatever you prefer).
I guess potential isn’t very exciting or interesting on its own.
Re: Things we learned about LLMs in 2024
#28Re: Things we learned about LLMs in 2024
#29> Some of those GPT-4 models run on my laptop That's an indication that most business-sized models won't need some giant data center. This is going to be a cheap technology most of the time. OpenAI is thus way overvalued.
Re: Things we learned about LLMs in 2024
#30Don’t forget that 2024 was also a record year for new methane power plant projects. Some 200 new projects in the US alone and I’d wager most of them are funded directly by big tech for AI data centres. https://www.bnnbloomberg.ca/investing/2024/09/16/ai-boom-is-... This is definitely extending the runway of O&G at a crisis point in the climate disaster when we’re supposed to be reducing and shutting down these power…
It would be really cool if big tech could find a new hyperscaler model that didn't also require offsetting the goals of green energy projects worldwide. Between LLM and crypto you'd swear they're trying to find the most energy-wasteful tech possible.
LLMs (and the image, sound, and movie generating models) are more coincidentally power-hogs — people are at least trying to make them better at fixed compute, and lower compute at fixed quality.