521–530 of 855 posts
Plot twist: Ilya joins xAI next.
This is plausible, Elon is a fantastic recruiter and he recruited Ilya for OpenAI. There are reports of xAI buying enormous numbers of GPUs and Elon's level of control of his companies means that Ilya recklessness isn't an issue. It's a match. Probably the best match possible.
Earlier quoted context omitted.
My experience differs greatly, company I used to work for did NDA, alpha, beta projects with Google. I was always impressed at how little anyone knew, the fact that nothing was delivered on time, scope creep to the point of almost everything being delayed and most projects were not well thought out nor well architected. I warned one API update would break things if it went live, and it did. Why was the guy from anoth…
But ask a dynamic programming question and watch it get smashed out None of the points you raise relate to being really good at dynamic programming
Earlier quoted context omitted.
How important are top science guys though? OpenAI has a thousand employees and almost unlimited money, and llm are better understood, I would guess continous development will beat singular genius heroes?
> OpenAI has a thousand employees and almost unlimited money You could say the same about Google - and yet they missed the consequences of their own discovery and got behind instead of being leaders. So you need specific talent to pull this off even if in theory you can hire anybody.
Earlier quoted context omitted.
Daniel “Quit OpenAI due to losing confidence that it would behave responsibly around the time of AGI” “I think AGI will probably be here by 2029, and could indeed arrive this year” Kokotajlo too. We are so fucked
I am sorry, there must be some hidden tech, some completely different attempt to speak about AGI. I really, really doubt that transformers will become AGI. Maybe I am wrong, I am no expert in this field, but I would love to understand the reasoning behind this "could arrive this year", because it reminds me about coldfusion :X edit: maybe the term has changed again. AGI to me means truly understanding, maybe even som…
The term, and indeed each initial, means different things to different people.
To me, even InstructGPT manages to be a "general" AI, so it counts as AGI — much to the confusion and upset of many like you who think the term requires consciousness, and others who want it to be superhuman in quality.
I would also absolutely agree LLMs are not at all human-like. I don't know if they do or don't need the various missing parts in order to be in order to change the world into a jobless (u/dis)topia.
I also don't have any reason to be for or against any claim about consciousness, given that word also has a broad range of definitions to choose between.
I expect at least one more breakthrough architecture on the scale of Transformers before we get all the missing bits from human cognition, even without "consciousness".
What do you mean by "truly understanding"?
Earlier quoted context omitted.
There goes the so called superalignment: Ilya Jan Leike William Saunders Leopold Aschenbrenner All gone
Resignations lead to more resignations....unless mgmt. can get on top of it and remedy it quickly, which rarely happens. I've seen it happen way too many times working 25 years in tech.
Earlier quoted context omitted.
Why would anyone start the game on hard mode when easy mode is a border drive away? Us is so outrageously better than the rest that people fly across oceans to start businesses there. Canada, being next door, doesn't have the distance moat to at least slow down the brain drain
With regards to talent, there's no particular reason why software centers couldn't be in any major established city in the world. It's not like it takes billions of dollars on a highly uncertain bet like creating a car company, rocket reuse company, or a CPU company. A small crew of people could potentially build the next WhatsApp. On Erlang.
Interesting, both Karpathy and Sutskever are gone from OpenAI now. Looks like it is now the Sam Altman and Greg Brockman show. I have to admit, of the four, Karpathy and Sutskever were the two I was most impressed with. I hope he goes on to do something great.
Earlier quoted context omitted.
Why would anyone start the game on hard mode when easy mode is a border drive away? Us is so outrageously better than the rest that people fly across oceans to start businesses there. Canada, being next door, doesn't have the distance moat to at least slow down the brain drain
With regards to talent, there's no particular reason why software centers couldn't be in any major established city in the world. It's not like it takes billions of dollars on a highly uncertain bet like creating a car company, rocket reuse company, or a CPU company. A small crew of people could potentially build the next WhatsApp. On Erlang.
I wonder if he thinks LLMs are an AGI dead end and he's not interested in selling a product. There's some academic papers floating around coming to the same conclusion (no links. sorry, studying for a cert exam).
That's been my assumption since the beginning of this drama last year. He seems to have one goal: real AGI. He knows that while LLMs may make something that seems like AGI there's nothing actually intelligent about it and its never going to get them there. OpenAI wants to pivot and sell sell sell because all they see is potential trillions of dollars, and it's time to make money instead of burning more millions/billi…
Earlier quoted context omitted.
> OpenAI has a thousand employees and almost unlimited money You could say the same about Google - and yet they missed the consequences of their own discovery and got behind instead of being leaders. So you need specific talent to pull this off even if in theory you can hire anybody.
I am just curious how it happened to Google? Like who were the product managers or others who didn't see an opportunity here exactly where the whole thing was invented and they had huge amounts of data already, whole web basically and the amount of video that no one else can ever hope to have?