Earlier quoted context omitted.
It's easy to have missed this part of the story in all the chaos, but from the NYTimes in March: Ms. Murati wrote a private memo to Mr. Altman raising questions about his management and also shared her concerns with the board. That move helped to propel the board’s decision to force him out. https://www.nytimes.com/2024/03/07/technology/openai-executi... It should be no surprise if Sam Altman wants executives who opp…
Greg Brockman, OpenAI President and co-founder is also on extended leave of absence. And John Schulman, and Peter Deng are out already. Yet the company is still shipping, like no other. Recent multimodal integrations and benchmarks of o1 are outstanding.
Mira Murati leaves OpenAI
381–390 of 644 posts
Re: Mira Murati leaves OpenAI
#382Re: Mira Murati leaves OpenAI
#383Earlier quoted context omitted.
I feel like this is stating the obvious - but i guess not to many - but a probabilistic syllable generator is not intelligence, it does not understand us, it cannot reason, it can only generate the next syllable It makes us feel understood in the same ways John Edward used to in daytime tv, its all about how language makes us feel true AGI...unfortunately we're not even close
I truly think you haven't really thought this through. There's a huge amount of circuitry between the input and the output of the model. How do you know what it does or doesn't do? Humans brains "just" output the next couple milliseconds of muscle activation, given sensory input and internal state. Edit: Interestingly, this is getting downvotes even though 1) my last sentence is a precise and accurate statement of th…
Yeah - but it's just a stack of transformer layers. No looping, no memory, no self-modification (learning). Also, no magic.
Re: Mira Murati leaves OpenAI
#384Earlier quoted context omitted.
It's easy to have missed this part of the story in all the chaos, but from the NYTimes in March: Ms. Murati wrote a private memo to Mr. Altman raising questions about his management and also shared her concerns with the board. That move helped to propel the board’s decision to force him out. https://www.nytimes.com/2024/03/07/technology/openai-executi... It should be no surprise if Sam Altman wants executives who opp…
Greg Brockman, OpenAI President and co-founder is also on extended leave of absence. And John Schulman, and Peter Deng are out already. Yet the company is still shipping, like no other. Recent multimodal integrations and benchmarks of o1 are outstanding.
Re: Mira Murati leaves OpenAI
#385Earlier quoted context omitted.
While it's true that language models are fundamentally based on statistical patterns in language, characterizing them as mere "probabilistic syllable generators" significantly understates their capabilities and functional intelligence. These models can engage in multistep logical reasoning, solve complex problems, and generate novel ideas - going far beyond simply predicting the next syllable. They can follow intrica…
> its scaling keeps going with no end in sight. Not only are we within eyesight of the end, we're more or less there. o1 isn't just scaling up parameter count 10x again and making GPT-5, because that's not really an effective approach at this point in the exponential curve of parameter count and model performance. I agree with the broader point: I'm not sure it isn't consistent with current neuroscience that our brai…
I definitely agree that AGI isn't just a matter of scaling transformers, and also as you say that they "may not be the best" for such tasks. (Vanilla transformers are extremely inefficient.) But the really important point is that transformers can do things such as abstract, reason, form world models and theories of minds, etc, to a significant degree (a much greater degree than virtually anyone would have predicted 5-10 years ago), all learnt automatically. It shows these problems are actually tractable for connectionist machine learning, without a paradigm shift as you and many others allege. That is the part I disagree with. But more breakthroughs needed.
Re: Mira Murati leaves OpenAI
#386Earlier quoted context omitted.
It’s a glorified grammar corrector?
TIL Math Olympiad problems are simple grammar exercises.
It’s not like it’ll do it consistently.
Just a marketing stunt.
Re: Mira Murati leaves OpenAI
#387Prediction: OpenAI will implode by 2030 and become a smaller shell of current as they run out of money by spending too much. Prediction 2: Russia will implode by 2035, by also spending too much money.
Re: Mira Murati leaves OpenAI
#388Plain-text version for those who can’t read images: “ Hi all, I have something to share with you. After much reflection, I have made the difficult decision to leave OpenAI. My six-and-a-half years with the OpenAI team have been an extraordinary privilege. While I'll express my gratitude to many individuals in the coming days, I want to start by thanking Sam and Greg for their trust in me to lead the technical organiz…
Re: Mira Murati leaves OpenAI
#389Earlier quoted context omitted.
I don’t think we’re gonna see a winter. LLMs are here to stay. Natural language interfaces are great. Embeddings are incredibly useful. They just won’t be the hottest thing since smartphones.
I just made a (IMHO) cool test with OpenAI/Linux/TCL-TK: "write a TCL/tk script file that is a "frontend" to the ls command: It should provide checkboxes and dropdowns for the different options available in bash ls and a button "RUN" to run the configured ls command. The output of the ls command should be displayed in a Text box inside the interface. The script must be runnable using tclsh" It didn't get it right the…
I wrote some data visualizations with Claude and aider.
For anything that someone would actually pay for (expecting the robustness of paid-for software) I don’t think we’re there.
The devil is in the details, after all. And detail is what you lose when running reality through a statistical model.
Re: Mira Murati leaves OpenAI
#390Earlier quoted context omitted.
> Yet the company is still shipping, like no other If executives / high level architects / researchers are working on this quarter's features something is very wrong. The higher you get the more ahead you need to be working, C-level departures should only have an impact about a year down the line, at a company of this size.
Funny, at every corporation I've worked for, every department was still working on last quarter's features. FAANG included.