GPU World

I finished reading it recently, too. I thought it was quirky, delightful, and obviously exaggerated for entertainment and contemplation purposes. I've recommended it to a bunch of people, too!

It triggered one of my favorite weird activities: after reading a book that I fully enjoyed and feel was completely "worth it," I give myself a few days to float on that happy feeling. Then, I go look at specifically only one and two star reviews. And laugh. Man, some people hated that book!

Note that otherwise, as a rule, I basically never read reviews of entertainment, restaurants, hotels and similar before nor after. I'm just not interested.

I was thinking of something similar.

Waxing poetic, it's been a while since the wheel was invented and we've gone through a lot since then, yet the rich are still rich and the poor are still poor and the loved are still loved and the loveless still loveless.

Would one GPU data center/person make a difference? Probably not, but it could be quite fun to have your own personal genie. And then we get used to it.

Still, I'm not sure if most people care to make the distinction between technology (a rocket promising to reach for the stars) and the human condition (has it ever changed since the dawn of time?).

Life in Asia and Africa has changed pretty dramatically, and improvements are accelerating. Yeah, we're not in utopia yet, but more people than ever live comfortable, safe lives. "Business at the speed of light" has become a reality, and we're still getting to grips with it. We dealt with a global pandemic with an efficiency never seen before - had it happened in the previous century, we would have probably seen "black death" levels of casualties.

Issues like inequality and conflict are mostly rooted in the human psyche more than the human condition, so they will continue to be there probably forever; but we're getting better.

> Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'. What would this world be like?

If we talk about just LLMs, given how things have been going since ChatGPT, my bet it would not change that much. LLMs are not foundational technology such as Internet or Steam engine or Rail roads were. There are very few products that can build upon them because of reliability issues which are completely unresolvable for LLMs, chatbots is a decent product that came out of it, coding harnesses is another one, this is not even close to the impact Internet or Steam engine had. LLMs gave us nice productivity tools for highly motivated expert knowledge workers, that is all. LLMs are getting better and will get better, but it is impossible to describe the universe and compress it into few terabytes and that is what they are doing atm effectively, so all serious LLMs's issues will still be there in 2040: the lack on continues learning, hallucinations, terrible sample ratio, agent's failures on long horizon tasks, instruction following failures.

Will any of the data submitted be used in training? We are all given the prompt and you will get a few thousand (maybe tens of thousands of submissions). Seems like a great source of training material.