Earlier quoted context omitted.
I'm genuinely curious: what do you expect an "AGI" system to be able to do that we can't do with today's technology?
Prove the Riemann Hypothesis
Ilya Sutskever to leave OpenAI
761–770 of 855 posts
Re: Ilya Sutskever to leave OpenAI
#762Not to be a conspiracy theorist, but the phrase "So long, and thanks for everything" used in the tweet reminds me of "So long, and thanks for all the fish" from the dolphins in The Hitchhiker's Guide To The Galaxy. The background there is that dolphins are secretly more intelligent than humans, and are leaving Earth without them when its destruction is imminent (something the humans don't see coming). I did once leav…
That is really smart, I wonder what's going on behind the scenes. Q* perhaps?
Re: Ilya Sutskever to leave OpenAI
#763Earlier quoted context omitted.
A plane is good at hauling cargo and goes fast, but general flying skills? Doesn't even come close.
Exactly, a giant LLM is not even close to be as power efficient as a human brain, in the same vein as a plane isn't as good at general flying. Yet it provides huge value and in many dimensions (that are important to us as humans) a plane can do way more than any bird.
It’s cool and all. But I’m not sure if I’d say it’s as useful as flight yet.
If I could choose between LLm access and aviation, I’d stick with aviation.
Re: Ilya Sutskever to leave OpenAI
#764Jan Leike has said he's leaving too https://twitter.com/janleike/status/1790603862132596961
The scenario I have in my head is that they had to override the safety team's objections to ship their new models before Google IO happened.
I don't believe in AI "safety measures" any more than I do in kitchen cleaver safety measures.
That is, nothing beyond "keep out of kids' reach" and "don't use it like an idiot" but let the cleaver be a damn cleaver.
Re: Ilya Sutskever to leave OpenAI
#765Re: Ilya Sutskever to leave OpenAI
#766Earlier quoted context omitted.
For folks without responsibilities like kids, aging parents, etc. I really don’t think startups are very “risky”. What’s the worst that happens? It doesn’t work out and after five years you go get a job in boring corp corp with an incredible skillset and vast life experience. You’ve sacrificed some income perhaps, but so what? People make choices like that all the time. Your working career could easily be 40 or 45 ye…
There are countries where the business culture makes you unemployable and almost impossible for you to get a loan for the rest of your live if you have ever failed a business (bad enough). Many countries aren't as open to failure as the US.
Re: Ilya Sutskever to leave OpenAI
#767Earlier quoted context omitted.
Am I taking crazy pills or something? Because he was the one who tried to oust Sam like 6 months ago? Did we just all forget that or what? Again, why would any VC give Ilya money if that in any way signals that they are supporting someone who tried to oust the CEO of OpenAI from within? They wouldn't.
Because he is one of the big brains behind GPT-4; you know, the thing that propelled OpenAI there?
Re: Ilya Sutskever to leave OpenAI
#768Earlier quoted context omitted.
For folks without responsibilities like kids, aging parents, etc. I really don’t think startups are very “risky”. What’s the worst that happens? It doesn’t work out and after five years you go get a job in boring corp corp with an incredible skillset and vast life experience. You’ve sacrificed some income perhaps, but so what? People make choices like that all the time. Your working career could easily be 40 or 45 ye…
This depends on what you see as risk. If I can safely earn for 5 years way above national average and build a strong savings egg that can provide income forever. Or I can fail at a startup and be close to zero five years later, the fact that you aren't homeless and starving and can get another job doesn't mean it wasn't risky, you still wasted a bunch of years compared to slow and steady accumulation. I've read the m…
Re: Ilya Sutskever to leave OpenAI
#769Earlier quoted context omitted.
This depends on what you see as risk. If I can safely earn for 5 years way above national average and build a strong savings egg that can provide income forever. Or I can fail at a startup and be close to zero five years later, the fact that you aren't homeless and starving and can get another job doesn't mean it wasn't risky, you still wasted a bunch of years compared to slow and steady accumulation. I've read the m…
Of course you could probably say at least some of the same things about grad degrees that may not really translate into appreciable different/better career outcomes. Of course some say exactly that, especially about PhDs.
For me risk is “could go horribly wrong” but the worst case for most startup founders is … get a job?
Re: Ilya Sutskever to leave OpenAI
#770Earlier quoted context omitted.
Isn't access to massive datasets and computation the moat? If you and your very talented friends wanted to build something like GPT-4, could you? It's going to get orders of magnitude less expensive, but for now, the capital requirements feel like a pretty deep moat.
How do you know massive datasets are required? Just because that’s how current LLMs operate, doesn’t mean it’s necessarily the only solution.
I think academia and startups are currently better suited to optimize tinyml and edge ai hardware/compilers/frameworks etc.