i have a crazy idea... how about... not focusing on ever increasing the size of ai models, so that we don't need to build all those power-hungry ai training datacenters? just a thought
It’s always interesting to see these ideas on a tech forum. Should we as humanity stop right here? Draw a line in the sand and not do anything new? Maybe we should move backwards, skipping the Industrial Revolution and go back to each individual growing their own food? This is a serious question. What do you propose? Because you are not able to pick and choose what humanity tries out, so shall we stop entirely?
Maybe someone with the knowledge of hindsight in a few generations will say that, yes, we should stop and draw a line in the sand.
We are still used to the idea that we can treat externalities to the systems we build as infinite and boundless, while it is getting increasingly clear that they are not. I am not saying we should stop working on LLMs. I just say we probably should factor in (that means: assign economic value to) downstream consequences of said high energy consumption if we don't wanna destroy our own habitats. And that then would probably lead to a world where LLMs are used for actually important problems instead of furthering the goals of the few who truly profit from surveillance-capitalism.
But hey, let's continue wasting a years worth of energy on training LLMs on cat pictures, they are cute after all.