Live data from Hacker News

Ilya Sutskever to leave OpenAI

twitter.com

501–510 of 855 posts

Re: Ilya Sutskever to leave OpenAI

#501

The usual fate of idealistic people who build something great only to be discarded by management in a power struggle. How often did this repeat?

What do you mean how often, that is a foundation for the most successful economic model in humans. Some may not be discarded, but they will never get enough credit compared to a clueless head with a $1M smile talking to clueless heads with $1B wallets. We should thank god/nature that people who understand and do things exist in our species at all.

Re: Ilya Sutskever to leave OpenAI

#502

Earlier quoted context omitted.

> Also, when they speak about AGI, it raises their(person leaving) marketing value Why yes, of course Jan Leike just impromptu resigned and Daniel Kokotajlo just gave up 85% of his wealth in order not to sign a resignation NDA to do what you're describing...

While he'll be giving up a lot of wealth, it's unlikely that any meaningful NDA will be applied here. Maybe for products, but definitely not for their research. There's very few people who can lead in frontier AI research domains - maybe a few dozen worldwide - and there are many active research niches. Applying an NDA to a very senior researcher would be such a massive net-negative for the industry, that it'd be a n…

Kokotajlo: “To clarify: I did sign something when I joined the company, so I'm still not completely free to speak (still under confidentiality obligations). But I didn't take on any additional obligations when I left.

Unclear how to value the equity I gave up, but it probably would have been about 85% of my family's net worth at least.

Basically I wanted to retain my ability to criticize the company in the future.“

> but "stop working on your field of research" isn't going to happen.

We’re talking about NDA, obviously no-competes aren’t legal in CA

https://www.lesswrong.com/posts/kovCotfpTFWFXaxwi/?commentId...

Re: Ilya Sutskever to leave OpenAI

#503
post #366

Earlier quoted context omitted.

And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.

Couldn't a company like that get a huge tax benefit from the SRED program?

SRED is basically a subsidy for companies that do your SRED paperwork for you, not the company doing the engineering itself. There's a whole industry of this.

No evidence that SRED has done anything ever for actual R&D. I've seen people get SRED for making web pages in JavaScript&HTML. When I had to fill in the SRED stuff it was ridiculous. Someone doing actual innovation would throw their hands up in the air.

Re: Ilya Sutskever to leave OpenAI

#504
post #484

Earlier quoted context omitted.

Silicon Valley is one of the most underrated documentaries of the last decade.

If you extend the window a little bit, along Yes Minister, Idiocracy and Demolition Man (the last two being a documentary of our time filmed 20y ago).

> Idiocracy

I definitely enjoyed this movie, and it's understandable that people of any era, starting with ancient Greece, enjoy lamenting at how stupid people are becoming. However, as long as videos explaining quantum physics and 4-hour long interviews with historians and engineers are still one of the most popular kinds of content on Youtube, I would suggest that it's not a documentary, at least not yet.

Re: Ilya Sutskever to leave OpenAI

#505
post #480
post #447

Earlier quoted context omitted.

Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.

How important are top science guys though? OpenAI has a thousand employees and almost unlimited money, and llm are better understood, I would guess continous development will beat singular genius heroes?

> OpenAI has a thousand employees and almost unlimited money

You could say the same about Google - and yet they missed the consequences of their own discovery and got behind instead of being leaders. So you need specific talent to pull this off even if in theory you can hire anybody.

Re: Ilya Sutskever to leave OpenAI

#506

Earlier quoted context omitted.

That was literally me at Google

How can I get this gig at Google? I’m willing to not work for mid to high six figures.

You don't want it. They'll simultaneously pay you big money to stop you from working somewhere else, and crush your soul at the same time.

Also they won't do that anymore, I'm sure.

Re: Ilya Sutskever to leave OpenAI

#507
post #366

When walking around the U of Toronto, I often think that ~10 years ago Ilya was in a lab next to Alex trying to figure things out. I can't believe this new AI wave started there. Ilya, Karpathy, Jimmy Ba, and many more were at the right time when Hinton was there too.

And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.

As much as people on this site like to complain about Europe (and a lot of it is merited) - I've found that Canada manages to be worse. Even having lower on avg bureaucracy

Re: Ilya Sutskever to leave OpenAI

#508
The future of the company doesn't depend on one engineer. If he left, it's likely because he had a vision that wasn't in line with Sam or Microsoft. Others will take his place and OpenAI will likely reach Elon Musks' recent prediction that AI will improve 100x in the next few years.

Re: Ilya Sutskever to leave OpenAI

#509

Earlier quoted context omitted.

I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…

No I’m with you on this. Next token prediction does lead to impressive emergent phenomena. But what makes people people is an internal drive to attend to our needs, and an LLM exists without that. A real AGI should be something you can drop in to a humanoid robot and it would basically live as an individual, learning from every moment and every day, growing and changing with time. LLMs can’t even count the number of…

LLMs could count the number of letters in a sentence if you stopped tokenizing them first.

Re: Ilya Sutskever to leave OpenAI

#510
post #471

Earlier quoted context omitted.

I don’t feel that OpenAI has a huge moat against say Anthropic. And I don’t know OpenAI needs Microsoft nearly as much as Microsoft needs OpenAI

There are no moats in deep learning, everything changes so fast. They have the next iteration of GPT Sutskever helped to finalize. OpenAI lost it's future unless they find new same caliber people.

> They have the next iteration of GPT Sutskever helped to finalize

How do you know that they have the next GPT?

How do you know what Sutskever contributed? (There was talk that the most valuable contributions came from the less well known researchers not from him)

Post reply on HN