As with much of this author's content this is a strong opinion that lacks nuance, but I basically agree with the fundamental assertion: that the lasting impact of this AI bubble will be to further centralise power, taking it away from workers. My hope is that a desire for authenticity prevents this from happening – whether that's a strong bias towards human content creators, towards speaking to a human on the phone f…
I'm not entirely sure about the centralization part. We already have models that can run on consumer hardware and are freely available to use for anyone (e.g. code-llama 34B is actually a viable gpt 3-5 replacement, if not slightly better) Training these is still out of reach, but fine tuning is getting close (LoRA) and running them is almost easy at this point. The products we've built so far are power-centralized,…
But also, a model running on your phone generating AI content is likely to be cheaper and not as good as human curated content in whatever form that is.
I think compute can be decentralised, while the power is still centralised, or at least those at the low end lose out on quality.