Live data from Hacker News

Ilya Sutskever to leave OpenAI

twitter.com

601–610 of 855 posts

Re: Ilya Sutskever to leave OpenAI

#601

Earlier quoted context omitted.

With regards to talent, there's no particular reason why software centers couldn't be in any major established city in the world. It's not like it takes billions of dollars on a highly uncertain bet like creating a car company, rocket reuse company, or a CPU company. A small crew of people could potentially build the next WhatsApp. On Erlang.

There are definitely many good programmers all over the world, but there are more in the US, because that's where all the best companies are. So if you're trying to make a good company and you want good programmers, where do you go?

You stay where you are and hire the ones willing or keen to work remotely?

Re: Ilya Sutskever to leave OpenAI

#602
post #570

Earlier quoted context omitted.

Not saying it’s going to be the same, but I’m sure computing progress looked pretty unimpressive from, say, 1975 to 1990 for the uninitiated. By the 90s they were still mainly used as fancy typewriters by “normal” people (my parents, school, etc) although the ridiculous potential was clear from day one. It just took a looong time to go from pong to ping and then to living online. I’m still convinced even this stage i…

Computing progress from 78 to 90 was mind-blowing. 1978: the apple ][. 1mhz 8 bit microprocessor, 4kb of ram, monochrome all-,caps display. 1990:Mac IIci, 25mhz 32-bit CPU, 4MB ram, 640x480 color graphics and an easy to use GUI. Ask any of us who used both of these at the time: it was really amazing.

I agree. Likewise, early AI models to GPT4 is breathtaking progress.

Regular people shrug and say, yeah sure, but what can I do with it. They still do this day.

Re: Ilya Sutskever to leave OpenAI

#603
post #366

When walking around the U of Toronto, I often think that ~10 years ago Ilya was in a lab next to Alex trying to figure things out. I can't believe this new AI wave started there. Ilya, Karpathy, Jimmy Ba, and many more were at the right time when Hinton was there too.

And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.

As another Canadian, I feel the same but I'm not surprised one bit.

Canada is actively hostile towards tech and suffers from crippling salaries and investments. The idea of "business" in this country is buying a house and renting its basement.

Our government's incompetence is comical, we are nothing but more than a tech talent / immigration proxy for United States at this point.

Re: Ilya Sutskever to leave OpenAI

#604
post #558

Earlier quoted context omitted.

Not saying it’s going to be the same, but I’m sure computing progress looked pretty unimpressive from, say, 1975 to 1990 for the uninitiated. By the 90s they were still mainly used as fancy typewriters by “normal” people (my parents, school, etc) although the ridiculous potential was clear from day one. It just took a looong time to go from pong to ping and then to living online. I’m still convinced even this stage i…

mobile internet and smartphones were the real gamechanger here, which were definitely not linear. They became viable in the 2000's, let's say 2007 with the iPhone, and by late 2010's everyone was living online, so "decades" is a stretch.

To make the 2000s possible, decades of relatively uninteresting progress was made. It quickly takes off from there.

Re: Ilya Sutskever to leave OpenAI

#605

Earlier quoted context omitted.

I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…

> truly understanding… when I explain something, I have understood it When you have that feeling of understanding, it is important to recognize that it is a feeling. We hope it’s correlated with some kind of ability to reason, but at the end of the day, you can have the ability to reason about things without realising it, and you can feel that you understand something and be wrong. It’s not clear to me why this feeli…

Would say understanding usually means ability to connect the dots and see the implications … not feeling.

Re: Ilya Sutskever to leave OpenAI

#606

At least now we know GPT-5 has finished development and is now in training from this (I would hope that Iyla got to add all that he hoped to before leaving). Ilya, thanks for all you have contributed within OpenAI!

From reporting GPT-5 finished pre-training while ago and was in the process of red-teaming.

Re: Ilya Sutskever to leave OpenAI

#607
post #447

Interesting, both Karpathy and Sutskever are gone from OpenAI now. Looks like it is now the Sam Altman and Greg Brockman show. I have to admit, of the four, Karpathy and Sutskever were the two I was most impressed with. I hope he goes on to do something great.

Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.

AI has now evolved beyond just the science and it's biggest issue is in the productization. Finding use cases for what's already available ALONG with new models will be where success lies.

ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works. It always sucks when mission and vision don't align with the nerds ideas, but I think it's probably the best move for both parties.

Re: Ilya Sutskever to leave OpenAI

#608

Earlier quoted context omitted.

Daniel “Quit OpenAI due to losing confidence that it would behave responsibly around the time of AGI” “I think AGI will probably be here by 2029, and could indeed arrive this year” Kokotajlo too. We are so fucked

I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…

> when I explain something, I have understood it.

Yeah, that's the part I don't understand though - do I understand it? Or do I just think I understand it. How do I know that I am not probabilistic also?

Synthesis is the only thing that comes to mind as a differentiator between me and an LLM.

Re: Ilya Sutskever to leave OpenAI

#609
post #607
post #447

Earlier quoted context omitted.

Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.

AI has now evolved beyond just the science and it's biggest issue is in the productization. Finding use cases for what's already available ALONG with new models will be where success lies. ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works. It always sucks when mission and vision don't align with the nerds ideas, but I think it's probably the best move for b…

>ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works.

I'm not as in tune as some people here so: don't they need both? With the rate at which things are moving, how can it be otherwise?

Re: Ilya Sutskever to leave OpenAI

#610
post #366

Earlier quoted context omitted.

And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.

As another Canadian, I feel the same but I'm not surprised one bit. Canada is actively hostile towards tech and suffers from crippling salaries and investments. The idea of "business" in this country is buying a house and renting its basement. Our government's incompetence is comical, we are nothing but more than a tech talent / immigration proxy for United States at this point.

I don't know, Canada and every-other-country-that's-not-the-US. When there's a neighbor that is flush with cash, where make-or-break is a kind of national disease ... what can you do?

(I'm an American, FWIW.)

Post reply on HN