How good or bad is this for OpenAI?
According to Mr Altman’s tweet (https://twitter.com/sama/status/1790518031640347056) they had not just one but TWO of the greatest minds of this generation.
After this change they will have only one.
Ilya Sutskever to leave OpenAI
191–200 of 855 posts
Re: Ilya Sutskever to leave OpenAI
#192Earlier quoted context omitted.
You will still need the compute resources of Microsoft, Meta etc. And they have their own people who equally know how LLMs work. Even raising funds is not a certainty given that VCs are becoming more cautious with AI as they realise it's now a platform fight between the mega corporations.
Plenty of companies have compute, but everyone is barely catching up to GPT-4 over a year after release. I'm sure places like Meta would love to unlock the details of what makes it so good.
There's no mystery, they just have a lot of actual user data, so they've been able to refine the question answering behavior. They've also baked some common problem solving strategies like chain of thought into the model via training.
Re: Ilya Sutskever to leave OpenAI
#193Never go against the family, Fredo
[deleted]
Re: Ilya Sutskever to leave OpenAI
#194Ilya knows how ChatGPT works. Any company that hires him will be able to catch up with ChatGPT.
If his concern was irresponsible AI proliferation, too much commercial focus and wanting to move more carefully, accelerating competition doesn't seem like it would align with his goals.
Re: Ilya Sutskever to leave OpenAI
#195Altman's tweet ( https://x.com/sama/status/1790518031640347056?s=46 ) makes it seem as if he wanted to stay, and Ilya disagreed and "chose" to depart. Very interesting framing.
Since it's all in proper casing I'm going to assume he wrote it with chatgpt.
He also literally mentioned Ilya's personal project; something that ChatGPT would do (it repeats parts of the prompt).
Re: Ilya Sutskever to leave OpenAI
#196Re: Ilya Sutskever to leave OpenAI
#197Earlier quoted context omitted.
Catching up right now is not a matter of tech innovation, but raw energy and compute. Of course, the next -revolution- in AI could very well come from Ilya. But why would he bestow that honor to anyone? He can self fund it if he wants. It's an R&D project, not a scaling problem.
If that is the case, why hasn't Google caught up yet?
probably because they have identified (correctly) that slowly integrating AI into their existing products that make them hundreds of billions is smarter than just burning that money to get upvoted on HN. Tall trees catch too much wind, ancient Chinese proverb. If you can afford to being second is usually less painful than being first.
Re: Ilya Sutskever to leave OpenAI
#198Earlier quoted context omitted.
Catching up right now is not a matter of tech innovation, but raw energy and compute. Of course, the next -revolution- in AI could very well come from Ilya. But why would he bestow that honor to anyone? He can self fund it if he wants. It's an R&D project, not a scaling problem.
If that is the case, why hasn't Google caught up yet?
Google is ideologically compromised which ties them into knots and creates endless internal struggles.
this led to the release of Gemini which was absurdly biased when viewed by the typical American.
Re: Ilya Sutskever to leave OpenAI
#199There’s a halo around Ilya Sutskever as the Albert Einstein of AI. Are there others on par with his— umm, how would you qualify it—- AI intuition or are we idolizing?
You have used an excellent term: AI intuition. This quality is extremely rare. Einstein probably had a similar kind of intuition in physics, and maybe that's why he was so successful. The ability to see what direction to pursue. Ilya has demonstrated it again and again, first with Alexnet (Hinton said Ilya was the person driving the project, believing in its success when no one else did, while Alex was the main imple…
Einstein famously disagreed with many facets of QM that we now believe to be true or at least closer to the truth than he was.
Re: Ilya Sutskever to leave OpenAI
#200Altman's tweet ( https://x.com/sama/status/1790518031640347056?s=46 ) makes it seem as if he wanted to stay, and Ilya disagreed and "chose" to depart. Very interesting framing.
Personally I don’t trust much of anything sam says, so I’d take any framing with a large grain of salt
> a large grain of salt
You mean a lump of salt? I've always wondered what the right word is to describe this amount of salt /!jk