Karpathy is probably one of the biggest names in AI, I do wonder where he fits now. He's sort of bounced around Tesla back to OpenAI back to independent. He sort of left OpenAI before it really hit the inflection point, and he was at Tesla for a long time and they didn't really deliver what they wanted on the AI side. Now he's bounced around a few places. I understand that the leaders in this market play this silly g…
> He sort of left OpenAI before it really hit the inflection point Sorry I'm out of the loop... What inflection point are you referring to?
Around the time Karpathy left, Ilya Sutskever, another OpenAI founder, started playing with Google's new "Transformer" architecture, which was the beginning of the "GPT" series, GPT-1, GPT-2 and eventually ChatGPT (GPT 3.5 + RLHF). In retrospect OpenAI's early Transformer experiments and GPT-1 was the inflection point that moved OpenAI from a company that wanted to build AI, as soon as anyone else did, to one that was actually doing so, although I think it would be revisionist for anyone to claim they knew what they were doing at the time. The early GPT-1 and GPT-2 papers read more like "wow, this is a bit unexpected, look at all of the things it can do!".