> we fundamentally changed how AI systems learn and reason through complex problems I'm not an AI researcher, have they done this? The commentary I've seen on o1 is basically that they incorporated techniques that were already being used. I'd also be curious to learn: what fundamental contributions to research has OpenAI made? The ChatGPT that was released in 2022 was based on Google's research, and IMO the internal…
Ilya was the Google researcher..
Mira Murati leaves OpenAI
351–360 of 644 posts
Re: Mira Murati leaves OpenAI
#352Earlier quoted context omitted.
Sure didn't. Neither did she though... To my knowledge. Can you provide any evidence that she tried to do that? I would ask that it be non-speculative in nature please.
https://www.nytimes.com/2023/11/17/technology/openai-sam-alt...
This piece is built on conjecture from a source whose identify is withheld. The sources version of events is openly refuted by the parties in question. Offering it as evidence that Mirati intentionally made political moves in order to get Altman ousted is an indefensible position.
'Mr. Sutskever’s lawyer, Alex Weingarten, said claims that he had approached the board were “categorically false.”'
'Marc H. Axelbaum, a lawyer for Ms. Murati, said in a statement: “The claims that she approached the board in an effort to get Mr. Altman fired last year or supported the board’s actions are flat wrong. She was perplexed at the board’s decision then, but is not surprised that some former board members are now attempting to shift the blame to her.” In a message to OpenAI employees after publication of this article, Ms. Murati said she and Mr. Altman “have a strong and productive partnership and I have not been shy about sharing feedback with him directly.”
She added that she did not reach out to the board but “when individual board members reached out directly to me for feedback about Sam, I provided it — all feedback Sam already knew,” and that did not mean she was “responsible for or supported the old board’s actions.”'
This part of NYT piece is supported by evidence:
'Ms. Murati wrote a private memo to Mr. Altman raising questions about his management and also shared her concerns with the board. That move helped to propel the board’s decision to force him out.'
INTENT matters. Mirati says the board asked for her concerns about Altmans. She provided it and had already brought it to Altmans attention... in writing. Her actions demonstrate transparency and professionalism.
Re: Mira Murati leaves OpenAI
#353Earlier quoted context omitted.
Many hours of interviews. Organizational performance metrics. Frequency of scientific breakthroughs. Frequency and quality of product updates. History of consistently setting the state of the art in artificial intelligence. Demonstrated ability to attract world class talent. Released the fastest growing software product in the history of humanity.
We have to see if they’ll keep executing in a year, considering the losses in staff and the non technical CEO.
I could write paragraphs...
Why the rain clouds?
Re: Mira Murati leaves OpenAI
#354Earlier quoted context omitted.
$10M doesn't go as far as you'd think in the Bay Area or NYC.
$10M is never work again money literally anywhere in the world. Don't kid yourself. Buy a $3.5M house outright and then collect $250k per year risk free after taxes. You're doing whatever you want and still saving money.
Re: Mira Murati leaves OpenAI
#355Earlier quoted context omitted.
$10M is never work again money literally anywhere in the world. Don't kid yourself. Buy a $3.5M house outright and then collect $250k per year risk free after taxes. You're doing whatever you want and still saving money.
Assuming they're 40, how far do you think $250k will go 20-30-40 years from now? It's not a stretch to think dollars could be devalued by 90%, possibly even worthless, within 30 years.
Re: Mira Murati leaves OpenAI
#356I will never understand why people still take statements like these at face value. These aren't her personal thoughts and feelings. The letter was carefully crafted by OpenAI's PR team under strict direction from Sam and the board. Whatever the real story is is sitting under many layers of NDAs and threats of clawing back/diluting her shares, and we will not know it for a long time. What I can say for certain is no e…
> no executive in her position ever willingly resigns to pursue different passions/spend more time with their family/enjoy retirement or whatever else Especially when they enjoy a position like hers at the most important technology company in a generation.
Re: Mira Murati leaves OpenAI
#357Update: Looks like Barret Zoph, GPT-4's post training (co-)lead is also leaving: https://x.com/barret_zoph/status/1839095143397515452
Re: Mira Murati leaves OpenAI
#358Earlier quoted context omitted.
To be fair she was also one of the employees who signed the letter to the board demanding that Altman be reinstated or she would leave the company.
Isn’t that even worse? You write to the board, they take action on your complaints, and then you change your mind?
Now that she's seen exactly what prompted the previous board to fire Altman, she fires herself because she understands their decision now.
Re: Mira Murati leaves OpenAI
#359Earlier quoted context omitted.
Sure if you ignore context. "a probabilistic syllable generator is not intelligence, it does not understand us, it cannot reason" is a strong statement and I highly doubt it's backed by any sort of substance other than "feelz".
I didn't ignore any more context than you did, but just I want to acknowledge the irony that "context" (specifically, here, any sort of memory that isn't in the text context window) is exactly what is lacking with these models. For example, even the dumbest dog has a memory, a strikingly advanced concept model of the world [1], a persistent state beyond the last conversation history, and an ability to reason (that do…
Lets assume the dog visual systems run at 60 frames per second. If it takes 1 second to flip a bowl of food over then that's 60 datapoints of cause-effect data that the dog's brain learned from.
Assuming it's the same for humans, lets say I go on a trip to the grocery store for 1 hour. That's 216,000 data points from one trip. Not to mention auditory data, touch, smell, and even taste.
> ability to reason [...] Transformer models do not
Can you tell me what reasoning is? Why can't transformers reason? Note I said transformers not llm's. You could make a reasonable (hah) case that current LLMs cannot reason (or at least very well) but why are transformers as an architecture doomed?
What about chain of thought? Some have made the claim that chain of thought adds recurrence to transformer models. That's a pretty big shift, but you've already decided transformers are a dead end so no chance of that making a difference right?
Re: Mira Murati leaves OpenAI
#360It is hard for me to square "This company is a few short years away from building world-changing AGI" and "I'm stepping away to do my own thing". Maybe I'm just bad at putting myself in someone else's shoes, but I feel like if I had spent years working towards a vision of AGI, and thought that success was finally just around the corner, it'd be very difficult to walk away.
[1] https://slate.com/technology/2019/02/openai-gpt2-text-genera...