Earlier quoted context omitted.
With regards to talent, there's no particular reason why software centers couldn't be in any major established city in the world. It's not like it takes billions of dollars on a highly uncertain bet like creating a car company, rocket reuse company, or a CPU company. A small crew of people could potentially build the next WhatsApp. On Erlang.
There are definitely many good programmers all over the world, but there are more in the US, because that's where all the best companies are. So if you're trying to make a good company and you want good programmers, where do you go?
Ilya Sutskever to leave OpenAI
601–610 of 855 posts
Re: Ilya Sutskever to leave OpenAI
#602Earlier quoted context omitted.
Not saying it’s going to be the same, but I’m sure computing progress looked pretty unimpressive from, say, 1975 to 1990 for the uninitiated. By the 90s they were still mainly used as fancy typewriters by “normal” people (my parents, school, etc) although the ridiculous potential was clear from day one. It just took a looong time to go from pong to ping and then to living online. I’m still convinced even this stage i…
Computing progress from 78 to 90 was mind-blowing. 1978: the apple ][. 1mhz 8 bit microprocessor, 4kb of ram, monochrome all-,caps display. 1990:Mac IIci, 25mhz 32-bit CPU, 4MB ram, 640x480 color graphics and an easy to use GUI. Ask any of us who used both of these at the time: it was really amazing.
Regular people shrug and say, yeah sure, but what can I do with it. They still do this day.
Re: Ilya Sutskever to leave OpenAI
#603When walking around the U of Toronto, I often think that ~10 years ago Ilya was in a lab next to Alex trying to figure things out. I can't believe this new AI wave started there. Ilya, Karpathy, Jimmy Ba, and many more were at the right time when Hinton was there too.
And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.
Canada is actively hostile towards tech and suffers from crippling salaries and investments. The idea of "business" in this country is buying a house and renting its basement.
Our government's incompetence is comical, we are nothing but more than a tech talent / immigration proxy for United States at this point.
Re: Ilya Sutskever to leave OpenAI
#604Earlier quoted context omitted.
Not saying it’s going to be the same, but I’m sure computing progress looked pretty unimpressive from, say, 1975 to 1990 for the uninitiated. By the 90s they were still mainly used as fancy typewriters by “normal” people (my parents, school, etc) although the ridiculous potential was clear from day one. It just took a looong time to go from pong to ping and then to living online. I’m still convinced even this stage i…
mobile internet and smartphones were the real gamechanger here, which were definitely not linear. They became viable in the 2000's, let's say 2007 with the iPhone, and by late 2010's everyone was living online, so "decades" is a stretch.
Re: Ilya Sutskever to leave OpenAI
#605Earlier quoted context omitted.
I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…
> truly understanding… when I explain something, I have understood it When you have that feeling of understanding, it is important to recognize that it is a feeling. We hope it’s correlated with some kind of ability to reason, but at the end of the day, you can have the ability to reason about things without realising it, and you can feel that you understand something and be wrong. It’s not clear to me why this feeli…
Re: Ilya Sutskever to leave OpenAI
#606At least now we know GPT-5 has finished development and is now in training from this (I would hope that Iyla got to add all that he hoped to before leaving). Ilya, thanks for all you have contributed within OpenAI!
Re: Ilya Sutskever to leave OpenAI
#607Interesting, both Karpathy and Sutskever are gone from OpenAI now. Looks like it is now the Sam Altman and Greg Brockman show. I have to admit, of the four, Karpathy and Sutskever were the two I was most impressed with. I hope he goes on to do something great.
Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.
ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works. It always sucks when mission and vision don't align with the nerds ideas, but I think it's probably the best move for both parties.
Re: Ilya Sutskever to leave OpenAI
#608Earlier quoted context omitted.
Daniel “Quit OpenAI due to losing confidence that it would behave responsibly around the time of AGI” “I think AGI will probably be here by 2029, and could indeed arrive this year” Kokotajlo too. We are so fucked
I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…
Yeah, that's the part I don't understand though - do I understand it? Or do I just think I understand it. How do I know that I am not probabilistic also?
Synthesis is the only thing that comes to mind as a differentiator between me and an LLM.
Re: Ilya Sutskever to leave OpenAI
#609Earlier quoted context omitted.
Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.
AI has now evolved beyond just the science and it's biggest issue is in the productization. Finding use cases for what's already available ALONG with new models will be where success lies. ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works. It always sucks when mission and vision don't align with the nerds ideas, but I think it's probably the best move for b…
I'm not as in tune as some people here so: don't they need both? With the rate at which things are moving, how can it be otherwise?
Re: Ilya Sutskever to leave OpenAI
#610Earlier quoted context omitted.
And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.
As another Canadian, I feel the same but I'm not surprised one bit. Canada is actively hostile towards tech and suffers from crippling salaries and investments. The idea of "business" in this country is buying a house and renting its basement. Our government's incompetence is comical, we are nothing but more than a tech talent / immigration proxy for United States at this point.
(I'm an American, FWIW.)