The usual fate of idealistic people who build something great only to be discarded by management in a power struggle. How often did this repeat?
Ilya Sutskever to leave OpenAI
501–510 of 855 posts
Re: Ilya Sutskever to leave OpenAI
#502Earlier quoted context omitted.
> Also, when they speak about AGI, it raises their(person leaving) marketing value Why yes, of course Jan Leike just impromptu resigned and Daniel Kokotajlo just gave up 85% of his wealth in order not to sign a resignation NDA to do what you're describing...
While he'll be giving up a lot of wealth, it's unlikely that any meaningful NDA will be applied here. Maybe for products, but definitely not for their research. There's very few people who can lead in frontier AI research domains - maybe a few dozen worldwide - and there are many active research niches. Applying an NDA to a very senior researcher would be such a massive net-negative for the industry, that it'd be a n…
Unclear how to value the equity I gave up, but it probably would have been about 85% of my family's net worth at least.
Basically I wanted to retain my ability to criticize the company in the future.“
> but "stop working on your field of research" isn't going to happen.
We’re talking about NDA, obviously no-competes aren’t legal in CA
https://www.lesswrong.com/posts/kovCotfpTFWFXaxwi/?commentId...
Re: Ilya Sutskever to leave OpenAI
#503Earlier quoted context omitted.
And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.
Couldn't a company like that get a huge tax benefit from the SRED program?
No evidence that SRED has done anything ever for actual R&D. I've seen people get SRED for making web pages in JavaScript&HTML. When I had to fill in the SRED stuff it was ridiculous. Someone doing actual innovation would throw their hands up in the air.
Re: Ilya Sutskever to leave OpenAI
#504Earlier quoted context omitted.
Silicon Valley is one of the most underrated documentaries of the last decade.
If you extend the window a little bit, along Yes Minister, Idiocracy and Demolition Man (the last two being a documentary of our time filmed 20y ago).
I definitely enjoyed this movie, and it's understandable that people of any era, starting with ancient Greece, enjoy lamenting at how stupid people are becoming. However, as long as videos explaining quantum physics and 4-hour long interviews with historians and engineers are still one of the most popular kinds of content on Youtube, I would suggest that it's not a documentary, at least not yet.
Re: Ilya Sutskever to leave OpenAI
#505Earlier quoted context omitted.
Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.
How important are top science guys though? OpenAI has a thousand employees and almost unlimited money, and llm are better understood, I would guess continous development will beat singular genius heroes?
You could say the same about Google - and yet they missed the consequences of their own discovery and got behind instead of being leaders. So you need specific talent to pull this off even if in theory you can hire anybody.
Re: Ilya Sutskever to leave OpenAI
#506Earlier quoted context omitted.
That was literally me at Google
How can I get this gig at Google? I’m willing to not work for mid to high six figures.
Also they won't do that anymore, I'm sure.
Re: Ilya Sutskever to leave OpenAI
#507When walking around the U of Toronto, I often think that ~10 years ago Ilya was in a lab next to Alex trying to figure things out. I can't believe this new AI wave started there. Ilya, Karpathy, Jimmy Ba, and many more were at the right time when Hinton was there too.
And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.
Re: Ilya Sutskever to leave OpenAI
#508Re: Ilya Sutskever to leave OpenAI
#509Earlier quoted context omitted.
I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…
No I’m with you on this. Next token prediction does lead to impressive emergent phenomena. But what makes people people is an internal drive to attend to our needs, and an LLM exists without that. A real AGI should be something you can drop in to a humanoid robot and it would basically live as an individual, learning from every moment and every day, growing and changing with time. LLMs can’t even count the number of…
Re: Ilya Sutskever to leave OpenAI
#510Earlier quoted context omitted.
I don’t feel that OpenAI has a huge moat against say Anthropic. And I don’t know OpenAI needs Microsoft nearly as much as Microsoft needs OpenAI
There are no moats in deep learning, everything changes so fast. They have the next iteration of GPT Sutskever helped to finalize. OpenAI lost it's future unless they find new same caliber people.
How do you know that they have the next GPT?
How do you know what Sutskever contributed? (There was talk that the most valuable contributions came from the less well known researchers not from him)