[dead]
Noam Shazeer Joins OpenAI
21–30 of 478 posts
Re: Noam Shazeer Joins OpenAI
#22[dead]
Re: Noam Shazeer Joins OpenAI
#23Wow. What could possibly have caused him to quit so soon after coming back? I hope this is not accurate but I'm afraid it is: https://x.com/signulll/status/2067446889956430273
signull is more of an anonymous sh*tposter than a known industry insider, but I think this does capture the sama contribution to OpenAI very well. At least from an outsider who follows this stuff based on vibes.
That twitter story isn't anything unique to OpenAI or Google, it's just classic "big public corp vs private startup" culture. Once you have to worry about the SEC, shareholders, antitrust, regulations, lawsuits, etc. it's very, very difficult to avoid turning into "big corp" culture.
Sama, and any other founder, will always have a difficult fight against bureaucracy, and once you let a little bit in, the bureaucracy's sole purpose becomes to grow itself.
Re: Noam Shazeer Joins OpenAI
#24Earlier quoted context omitted.
Don't think it matters in the long run to be honest. The models have no moat, they are becoming a commodity. Besides that, Google is in a pretty good position, they're not bleeding money on AI like Anthropic/OpenAI, and they own product verticals where they can integrate it. Plus they have a mature ads-model which is what might actually drive a bit of revenue for LLMs.
> models have no moat Possibly true. Any smart innovations developed by one organization will be smuggled into others. Training, inferring, and data collection, infrastructures are definitely moats. High-volume usage feedback is also hard to come by for new entrants.
And Google has all of those. Custom silicon, more data than anyone else and probably the most comprehensive data collection system, and phones in the hands of 73% of the global smartphone using population to push gemini into to get high volume usage feedback and even more telemetry and data.
Re: Noam Shazeer Joins OpenAI
#25Earlier quoted context omitted.
Don't think it matters in the long run to be honest. The models have no moat, they are becoming a commodity. Besides that, Google is in a pretty good position, they're not bleeding money on AI like Anthropic/OpenAI, and they own product verticals where they can integrate it. Plus they have a mature ads-model which is what might actually drive a bit of revenue for LLMs.
I don't think you're honestly accounting for the engineering behind the progress models are making. If it was just a matter of compute on hand and iterating, Meta would be neck and neck with Ant, OAI, and Google, but clearly you've gotta have more. Noam has a deep expertise in these systems at every level, both algorithmically and at production scale, and knows how to leverage things at different levels. It's not lik…
I honestly don't think that matters for multiple reasons:
1. There are already multiple "sota" models on the market that compete with only marginal gains between them (OpenAI, Anthropic, Google/Gemini) and some that are catching up (DeepSeek, Qwen,..).
2. The fact that something is a hard engineering problem does not mean it's generating revenue. So while what you said is true, deep expertise is required to push the industry forward, I don't think that is going to matter for the bottom line of these companies. Hence why I think the models don't give a company any 'moat' in a capitalist economy.
Re: Noam Shazeer Joins OpenAI
#26Noam Shazeer was one of the lead authors of the seminal paper "Attention Is All You Need", which introduced the transformer architecture. (From Wikipedia)
This understates his criticality. The author list was randomized, but the critical idea was truly his. Wonder what this says about GDM …
Re: Noam Shazeer Joins OpenAI
#27Its getting pretty lame that we talk about the these guys like they're football players transferring teams.
Re: Noam Shazeer Joins OpenAI
#28Wow - Google paid a couple billion dollars to bring Noam back. Really impressive by OAI if this reporting is accurate!
It is accurate. Confirmed by Noam himself on X https://x.com/i/status/2067400851438932297
Love the choice of words by Noam- exceptional team for OpenAI, amazing team for GDM.
Re: Noam Shazeer Joins OpenAI
#29Wow. What could possibly have caused him to quit so soon after coming back? I hope this is not accurate but I'm afraid it is: https://x.com/signulll/status/2067446889956430273
going to go with "money" and a lot of BS from altman
Re: Noam Shazeer Joins OpenAI
#30Earlier quoted context omitted.
signull is more of an anonymous sh*tposter than a known industry insider, but I think this does capture the sama contribution to OpenAI very well. At least from an outsider who follows this stuff based on vibes.
That twitter story isn't anything unique to OpenAI or Google, it's just classic "big public corp vs private startup" culture. Once you have to worry about the SEC, shareholders, antitrust, regulations, lawsuits, etc. it's very, very difficult to avoid turning into "big corp" culture. Sama, and any other founder, will always have a difficult fight against bureaucracy, and once you let a little bit in, the bureaucracy'…
Google and Apple both need a culling similar to what Elon did with Twitter after taking over.