Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ilya Sutskever to leave OpenAI

twitter.com

Post reply on HN
Print view View original

611–620 of 855 posts

Re: Ilya Sutskever to leave OpenAI

#611

Post by pembrook »

JKCalhoun wrote: post #598
pembrook wrote: post #547

Earlier quoted context omitted.

I’m 100% positive lots of people at Google were chomping at the bit to productize LLMs early on. But the reality is, LLMs are a cannibalization threat to Search. And the Search Monopoly is the core money making engine of the entire company. Classic innovators dilemma. No fat-and-happy corporate executive would ever say yes to putting lots of resources behind something risky that might also kill the golden goose. The…

Golden goose is already being hoisted upon a spit — and your company is not even going to get even drippings of the fat. I am surprised by the short-sightedness of execs.

I don’t work there, I’ve just worked for lots of big orgs — they are all the same. Any claimed uniqueness in “Organizational structure” and “culture” are just window dressing around good ol’ human nature.

It’s not short sightedness, it’s rational self-interest. The rewards for taking risk as employee #20,768 in a large company are minimal, whereas the downside can be catastrophic for your career & personal life.

Re: Ilya Sutskever to leave OpenAI

#612

Post by upmind »

DalasNoin wrote: post #552
fhd2 wrote: post #495

Not to be a conspiracy theorist, but the phrase "So long, and thanks for everything" used in the tweet reminds me of "So long, and thanks for all the fish" from the dolphins in The Hitchhiker's Guide To The Galaxy. The background there is that dolphins are secretly more intelligent than humans, and are leaving Earth without them when its destruction is imminent (something the humans don't see coming). I did once leav…

In that metaphor, is openai the humans or are actual humans the humans? So is openai about to be destroyed or humanity?

Openai would be the humans here and Ilya would be the dolphin. (In the metaphor, the dolphins leave and here Ilya is leaving)

Re: Ilya Sutskever to leave OpenAI

#613

Post by itsoktocry »

bsenftner wrote: post #590
sheeshkebab wrote: post #575

Earlier quoted context omitted.

> The next revolution is going to be when people realize what we have already Enlighten us

It is both subtle and obvious, yet many are missing this: if you want/need a deep subject matter expert in virtually any subject, write a narrative biography describing your expert using the same language that expert would use to describe themselves; this generates a context within the LLM carrying that subject matter expertise, and now significantly higher quality responses are generated. Duplicate this process for…

>I have integrated 6 independent, specialized "AI attorneys" into a project management system where they are collaborating with "AI web developers", "AI creative writers", "AI spreadsheet gurus", "AI negotiators", "AI financial analysts" and an "AI educational psychologist" that looks at the user, the nature and quality of their requests, and makes a determination of how much help the user really needs, modulating how much help the other agents provide.

Ah yes, "it's so obvious no one sees it but me". Until you show people your work, and have real experts examining the results, I'm going to remain skeptical and assume you have LLMs talking nonsense to each each other.

Re: Ilya Sutskever to leave OpenAI

#614

Post by upmind »

fhd2 wrote: post #495

Not to be a conspiracy theorist, but the phrase "So long, and thanks for everything" used in the tweet reminds me of "So long, and thanks for all the fish" from the dolphins in The Hitchhiker's Guide To The Galaxy. The background there is that dolphins are secretly more intelligent than humans, and are leaving Earth without them when its destruction is imminent (something the humans don't see coming). I did once leav…

That is really smart, I wonder what's going on behind the scenes. Q* perhaps?

Re: Ilya Sutskever to leave OpenAI

#615

Post by HarHarVeryFunny »

gdiamos wrote: post #383
zoogeny wrote: post #362

Interesting, both Karpathy and Sutskever are gone from OpenAI now. Looks like it is now the Sam Altman and Greg Brockman show. I have to admit, of the four, Karpathy and Sutskever were the two I was most impressed with. I hope he goes on to do something great.

I don’t think people give Dario enough credit

Yeah, I think him leaving was a huge blow to OpenAI that they have maybe not yet recovered from. Clearly there is no moat to transformer-based LLM development (other than money), but in terms of pace of development (insight as to what is important) I think Anthropic have the edge, although Reka are also storming ahead at impressive pace.

Re: Ilya Sutskever to leave OpenAI

#616

Post by HarHarVeryFunny »

astrange wrote: post #509
TaylorAlexander wrote: post #446

Earlier quoted context omitted.

No I’m with you on this. Next token prediction does lead to impressive emergent phenomena. But what makes people people is an internal drive to attend to our needs, and an LLM exists without that. A real AGI should be something you can drop in to a humanoid robot and it would basically live as an individual, learning from every moment and every day, growing and changing with time. LLMs can’t even count the number of…

LLMs could count the number of letters in a sentence if you stopped tokenizing them first.

tokenization is not the issue - these LLMs can all break a word into letters if you ask them.

Re: Ilya Sutskever to leave OpenAI

#617

Post by bsenftner »

itsoktocry wrote: post #613
bsenftner wrote: post #590

Earlier quoted context omitted.

It is both subtle and obvious, yet many are missing this: if you want/need a deep subject matter expert in virtually any subject, write a narrative biography describing your expert using the same language that expert would use to describe themselves; this generates a context within the LLM carrying that subject matter expertise, and now significantly higher quality responses are generated. Duplicate this process for…

> I have integrated 6 independent, specialized "AI attorneys" into a project management system where they are collaborating with "AI web developers", "AI creative writers", "AI spreadsheet gurus", "AI negotiators", "AI financial analysts" and an "AI educational psychologist" that looks at the user, the nature and quality of their requests, and makes a determination of how much help the user really needs, modulating h…

The point is these characters are not doing the work for people, it co-authors the work with them. It's just like working with someone highly educated but with next to no experience - they're a great help, but ya gotta look at their work to verify they are on track. This is the same, but with a collection of inexperienced phds. The LLMs really are idiot savants, and when you treat them like that they respond with expectations better.

Re: Ilya Sutskever to leave OpenAI

#618

Post by itsoktocry »

trashtester wrote: post #572
chx wrote: post #553

Earlier quoted context omitted.

> When the next wave of new deep learning innovations sweeps the world, that won't happen, the next scam will be different it was crypto until FTX collapsed then the usual suspects led by a16z leaned on OpenAI to rush whatever they had on market hence the odd naming of ChatGPT 3.5. When the hype is finally realized to be just mass printing bullshit -- relevant bullshit, yes, which sometimes can be useful but not bill…

Crypto currencies has the potential to grow the world economy by about 1-3%, as banking fees go down. Add other uses of crypto may double or triple that, but that's really speculative. AI, on the other hand, has a near infinite potential. It's conceivable that it will grow the global economy by 2% OR MORE per MONTH for decades or more. AI is going to be much more impactful than the internet. Probably more than intern…

>Crypto currencies has the potential to grow the world economy by about 1-3%, as banking fees go down.

Bank fees don't disappear into the ether when they're collected, so I doubt they have this much affect.

Oh, made my very first retail purchase with Bitcoin the other day. While the process was pretty slick and easy, the network charged $15.00 in fees. Long way to go until "free".

Re: Ilya Sutskever to leave OpenAI

#619

Post by fsloth »

OJFord wrote: post #600
fsloth wrote: post #568

Earlier quoted context omitted.

If we look at history of innovation and invention it’s very typical the original discovery and final productization are done by different people. For many reasons, but a lot of them are universal I would say. E.g. Oppenheimer’s team created the bomb, then following experts finetuned the subsequent weapon systems and payload designs. Etc.

> If we look at history of innovation and invention it’s very typical the original discovery and final productization are done by different people. You don't really need to look at history, that's basically science vs engineering in a nutshell. Maybe history could tell us if that's an accident or a division that arose out of 'natural' occurrence, but I suppose a question for an economist or psychologist or sociologis…

With abombs for weapons systems design they needed people who just got huge kicks out of explosions (not kidding here). I guess it’s partially about personal internal motivations, and it might be more of a chance wether the thing you are intrinsically motivated to do falls under engineering or science (in both cases you get the feeling the greats did stuff they wanted to do regardless of the categorizations applied to their discipline - you get more capital affinity in engineering ofc).

Re: Ilya Sutskever to leave OpenAI

#620

Post by bsenftner »

itsoktocry wrote: post #613
bsenftner wrote: post #590

Earlier quoted context omitted.

It is both subtle and obvious, yet many are missing this: if you want/need a deep subject matter expert in virtually any subject, write a narrative biography describing your expert using the same language that expert would use to describe themselves; this generates a context within the LLM carrying that subject matter expertise, and now significantly higher quality responses are generated. Duplicate this process for…

> I have integrated 6 independent, specialized "AI attorneys" into a project management system where they are collaborating with "AI web developers", "AI creative writers", "AI spreadsheet gurus", "AI negotiators", "AI financial analysts" and an "AI educational psychologist" that looks at the user, the nature and quality of their requests, and makes a determination of how much help the user really needs, modulating h…

I'm at a law firm, this is in use with attorneys to great success. And no, none of them are so dumb they do not verify the LLM's outputs.
Post reply on HN