The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
71–80 of 352 posts
Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#72The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
Where is the actual evidence of distillation? I keep seeing this repeated ad nauseam but I must have somehow missed the evidence.
It's also how providers build their smaller models out of their larger ones; they publicly talk about the process.
Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#73Earlier quoted context omitted.
You are basically saying you will switch from one evil to another because the other seems less evil for now. It's funny how people make these alignment comments while ignoring how misaligned the leadership at these companies are right form the get go and they just play mental gymnastics to deflect those facts when confronted with them.
I don’t think anyone said anything about either being less evil? Just having more consumer oriented products..
Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#74Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#75The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
Where is the actual evidence of distillation? I keep seeing this repeated ad nauseam but I must have somehow missed the evidence.
Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#76The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
I think the only moat in the future will be the scale of hardware deployment. If one company is able to deploy an order of magnitude more silicon, they'll have a firm grip on a SOTA model and massive inference usage. China or SpaceX seem like the 2 likely candidates in 5 years, but who knows.
If (a) demand for AI continues to increase, and (b) SpaceX can get to ~$100/kg to orbit, then they will have a ridiculously deep moat. Probably more like 10 years, though.
But as you said, who knows.
Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#77Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#78Earlier quoted context omitted.
Even before LLMs, ML folks were already aware that you can use a model to teach another model. I doubt this is something AI companies put at the top of their investor materials, but it's been nice to see it play out. That said, there are other moat factors like, a US company needing to use a US AI provider, sticky customers due to corporate onboarding friction, and others. Not nothing, but not as large a moat as some…
Yes, but 10 or 15 years ago, I would have thought that there'd be more to it than just a slight modification on the ideas behind a CNN to get this level of AI. There were somewhat good reasons to think it needed more than just this data-driven ML approach.
Re: OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21)
#79Earlier quoted context omitted.
I think the only moat in the future will be the scale of hardware deployment. If one company is able to deploy an order of magnitude more silicon, they'll have a firm grip on a SOTA model and massive inference usage. China or SpaceX seem like the 2 likely candidates in 5 years, but who knows.
"Who knows" is the right answer, I think. If (a) demand for AI continues to increase, and (b) SpaceX can get to ~$100/kg to orbit, then they will have a ridiculously deep moat. Probably more like 10 years, though. But as you said, who knows.
If it doesn't work out, I think China's exponential terrestrial energy deployment will eventually give them the lead, IF they can get enough chips. Another big if.