Live data from Hacker News

Ilya Sutskever to leave OpenAI

twitter.com

701–710 of 855 posts

Re: Ilya Sutskever to leave OpenAI

#701
post #607
post #447

Earlier quoted context omitted.

Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.

AI has now evolved beyond just the science and it's biggest issue is in the productization. Finding use cases for what's already available ALONG with new models will be where success lies. ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works. It always sucks when mission and vision don't align with the nerds ideas, but I think it's probably the best move for b…

Eh maybe from a company point of view.

But this race to add 'AI' into everything is producing a lot of nonsense. I'd rather go fullsteam ahead on the science and the new models, because that is what will actually get us something decent, rather than milking what we already have.

Re: Ilya Sutskever to leave OpenAI

#702
post #627

Earlier quoted context omitted.

I'm genuinely curious: what do you expect an "AGI" system to be able to do that we can't do with today's technology?

Some first ideas coming to mind: Engineering Level: Solve CO2 Levels End sickness/death Enhance cognition by integrating with willing minds. Safe and efficient interplanetary travel. Harness vastly higher levels of energy (solar, nuclear) for global benefit. Science: Uncover deeper insights into the laws of nature. Explore fundamental mysteries like the simulation hypothesis, Riemann hypothesis, multiverse theory, an…

The problem with CO2 levels is that no one likes the solution not that we don't have one. I highly doubt adding AGI to the mix is going to magically make things better. If anything we'll just burn more CO2 providing all the compute resources it needs.

People want their suburban lifestyle with their red meat and their pick-up truck or SUV. They drive fuel inefficient vehicles long-distances to urban work environments and they seem to have very limited interest in changing that. People who like detached homes aren't suddenly affording the rare instances of that closer to their work. We burn lots of oil because we drive fuel inefficient vehicles long distances. This is a problem of changing human preferences which you just aren't going to solve with an AGI.

Re: Ilya Sutskever to leave OpenAI

#703
post #366

Earlier quoted context omitted.

And none of them build AI companies in Toronto. I’m Canadian and disappointed at how ineffective we are at building successful companies.

I've thought about this one for a long time having lived in both SV and Canada. It is a complicated one but there are a handful of critical road blocks in Canada that make it more challenging. (1) Access to size of market even if online being US vs 'foreign' has advantages in political arena/regulatory benefits (2) Significant tax advantages for US investors vs limited tax advantages for Canada (Angel+VC) (3) Risk Ap…

if the idea that high taxes disincentivizes people from building stuff, california would be a wasteland.

but that's not what we see. people build because they still have a chance a making a lot of money.

also, like canada can build successfully tech companies. yes, I realize there should be more canadian tech darlings, but I don't think it has to do with high taxes so much as it has to do with Canadians being comfortable and not feeling the need to sacrifice everything to try and build the biggest thing.

If you look at Canada's most successful tech companies, the founders usually sell and enjoy a more comfortable existence.

Re: Ilya Sutskever to leave OpenAI

#704
post #594
post #568

Earlier quoted context omitted.

If we look at history of innovation and invention it’s very typical the original discovery and final productization are done by different people. For many reasons, but a lot of them are universal I would say. E.g. Oppenheimer’s team created the bomb, then following experts finetuned the subsequent weapon systems and payload designs. Etc.

Except OpenAI hasn’t yet finished discovery on its true goal: AGI. I wonder if they risk plateauing at a local maximum.

That's probably a good thing

Re: Ilya Sutskever to leave OpenAI

#705
post #627

Earlier quoted context omitted.

I'm genuinely curious: what do you expect an "AGI" system to be able to do that we can't do with today's technology?

Some first ideas coming to mind: Engineering Level: Solve CO2 Levels End sickness/death Enhance cognition by integrating with willing minds. Safe and efficient interplanetary travel. Harness vastly higher levels of energy (solar, nuclear) for global benefit. Science: Uncover deeper insights into the laws of nature. Explore fundamental mysteries like the simulation hypothesis, Riemann hypothesis, multiverse theory, an…

now do magical flying unicorn ponies, which I understand there is also considerable demand for

Re: Ilya Sutskever to leave OpenAI

#706

Earlier quoted context omitted.

I'm genuinely curious: what do you expect an "AGI" system to be able to do that we can't do with today's technology?

A working memory that can preserve information indefinitely outside a particular context window and which can engage in multi-step reasoning that doesn't show up in its outputs. GPT4o's context window is 128k tokens which is somewhere on the order of 128kB. Your brain's context window, all the subliminal activations from the nerves in your gut and the parts of your visual field you aren't necessarily paying attention…

I'm curious what resources led you to calculate a 2MB context window, I'd like to learn more.

Re: Ilya Sutskever to leave OpenAI

#707
post #607
post #447

Earlier quoted context omitted.

Top 6 science guys are long gone. Open AI is run by marketing, business, software and productization people. When the next wave of new deep learning innovations sweeps the world, Microsoft eats whats left of them. They make lots of money, but don't have future unless they replace what they lost.

AI has now evolved beyond just the science and it's biggest issue is in the productization. Finding use cases for what's already available ALONG with new models will be where success lies. ChatGPT is the number 1 brand in AI and as such needs to learn what it's selling, not how its technology works. It always sucks when mission and vision don't align with the nerds ideas, but I think it's probably the best move for b…

To this end, OpenAI is already off track. Their “GPT marketplace” or whatever they’re calling it is just misguided flailing from a product perspective.

Re: Ilya Sutskever to leave OpenAI

#708

Earlier quoted context omitted.

I've thought about this one for a long time having lived in both SV and Canada. It is a complicated one but there are a handful of critical road blocks in Canada that make it more challenging. (1) Access to size of market even if online being US vs 'foreign' has advantages in political arena/regulatory benefits (2) Significant tax advantages for US investors vs limited tax advantages for Canada (Angel+VC) (3) Risk Ap…

if the idea that high taxes disincentivizes people from building stuff, california would be a wasteland. but that's not what we see. people build because they still have a chance a making a lot of money. also, like canada can build successfully tech companies. yes, I realize there should be more canadian tech darlings, but I don't think it has to do with high taxes so much as it has to do with Canadians being comfort…

The point was about high taxes for investors not employees.

How many money does OpenAI _directly_ pay to CA in taxes? Sure the employees pay a ton in taxes but as an investor if you're going to lose more in taxes by investing into a Canadian company vs a California company then you invest into CA.

Re: Ilya Sutskever to leave OpenAI

#709

Earlier quoted context omitted.

I'm at a law firm, this is in use with attorneys to great success. And no, none of them are so dumb they do not verify the LLM's outputs.

How can no one see what we have today? You only need six instances of an LLM running at the same time, with a system to coordinate between them, and then you have to verify the results manually anyway. Sign me up!

If a certain percent of the work is completed through research synthesis and multiple perspective alignment, why is said novel approach not worth lauding?

I've created a version of one of the resume GPTs that analyses my resume's fit to a position when fed the job description along with a lookup of said company. I then have a streamlined manner in which it points out what needs to be further highlighted or omitted in my resume. It then helps me craft a cover letter based on a template I put together. Should I stop using it just because I can't feed it 50 job roles and have it automatically select which ones to apply to and then create all necessary changes to documents and then apply?

Post reply on HN