Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Noam Shazeer Joins OpenAI

twitter.com

Post reply on HN
Print view View original

401–410 of 478 posts

Re: Noam Shazeer Joins OpenAI

#401

Post by frollogaston »

bigyabai wrote: post #280
dansquizsoft wrote: post #266

Earlier quoted context omitted.

Trade secrets? Like how to invent a trillion dollar technology and then sit on it for years while others eat your lunch with it? Like how to consistenly release inferior quality models to others despite infinite compute and engineering talent and insane profitability in your legacy businesses?

Not really sure what you're talking about. Apple just licensed Gemini for Siri, Google and their TPU hardware is starting to hit primetime audiences that OpenAI can only dream of.

The Apple deal is a good sign. Before that, it was like yeah Gemini might have the lowest cost per query but that doesn't matter when its users largely aren't paying for it and never will.

Re: Noam Shazeer Joins OpenAI

#402

Post by pstuart »

eikenberry wrote: post #399
pstuart wrote: post #324

Earlier quoted context omitted.

Or maybe just have your R&D teams focused on doing R&D with zero corporate interference. Staff it with personal assistants whose only job is to ensure the researchers have whatever they need and are never bothered with meetings or other corporate shenanigans. The assistants could then be the proxies to management to provide feedback to management, but only on best effort and still staying the fuck out of the way of t…

Easy peasy yet still impossible for them to do as R&D doesn't add to the bottom line, it is a cost center.

Easey peasy was said with a wink, although technically speaking it would be easy -- if they didn't have their heads up their ass.

A dear friend of mine was doing R&D at a startup where management poured on a bunch of low-level management work that took him away from his joy, which was developing new tools and approaches to solving customer problems. He left, and went to another gig that promised him complete freedom to invent and discover. That job is at a Fortune 500 company that is slowly starting to pull its head out of its ass.

Re: Noam Shazeer Joins OpenAI

#403

Post by ViktorRay »

nrds wrote: post #392
ViktorRay wrote: post #377

Earlier quoted context omitted.

I’ve never seen any of the moderators here be snarky or indignant to anyone. Do you have any specific examples of where dang or another moderator posted in that way?

Literally every sentence dang has ever written on this site, that I've seen, is snarky. > Yes, in the sense that if there's nothing interesting to say about a quote then there's no reason to copy it into the thread. This one was both snarky and indignant. Indignant that anyone would post something dang doesn't like on his site, and snarky that the the original commenter hadn't conformed to norms of what positions are…

Snark definition:

“an attitude or expression of mocking irreverence and sarcasm”

Source:

https://www.merriam-webster.com/dictionary/snark

Indignant definition:

“feeling or showing anger because of something unjust or unworthy”

Source:

https://www.merriam-webster.com/dictionary/indignant

So just based on these definitions that comment seems neither snarky nor indignant? There’s no anger because he’s a moderator calmly stating one of the rules of the site. And there don’t seem to be anything mocking, irreverent or sarcastic about him calmly stating the site guidelines?

Re: Noam Shazeer Joins OpenAI

#404

Post by UltraSane »

frollogaston wrote: post #398
UltraSane wrote: post #333

Earlier quoted context omitted.

Israel actually LEFT Gaza. You seem biased to the point of just plain lying.

West Bank and Gaza are different situations. West Bank settlements have been popping up continuously. Settlers were in Gaza until they exited in 2005, but now that Israel's military occupies it again, Zionists believe it should be resettled. Sorry for CNN link, but it has direct quotes https://www.cnn.com/2024/01/17/middleeast/israel-far-right-g... To be clear they haven't done it yet , aside from some illegal (by Is…

  My only emotion is exhaustion at hearing the same lies told over and over.

Re: Noam Shazeer Joins OpenAI

#405

Post by bigyabai »

frollogaston wrote: post #401
bigyabai wrote: post #280

Earlier quoted context omitted.

Not really sure what you're talking about. Apple just licensed Gemini for Siri, Google and their TPU hardware is starting to hit primetime audiences that OpenAI can only dream of.

The Apple deal is a good sign. Before that, it was like yeah Gemini might have the lowest cost per query but that doesn't matter when its users largely aren't paying for it and never will.

Google only won the deal because they have great cards in their hand. Apple's homemade PCC nodes were never going to scale, but the TPUs would. Investors expected market displacement in all the wrong places.

The tea leaves were pretty easy to read, too; LLMs will eventually be commoditized. Once that happens, the only road to profitable AI will be paved with 1) branding and 2) cheap compute. Apple does not possess cheap inference hardware whatsoever. Their GPUs are raster-focused, inefficient and expensive for their dedicated compute role. Unless Apple crawls back to Nvidia with their tail between their legs, TPU inference was their only real option. The deal was even more obvious when you used Apple's local foundation models; they're downright eclipsed by the quality of Gemma. Once Apple Intelligence was announced, it became clear that Apple was the branding component in search of a strange bedfellow to thumb their nose at Nvidia.

Re: Noam Shazeer Joins OpenAI

#406

Post by deadbabe »

mlmonkey wrote: post #277
deadbabe wrote: post #222

Earlier quoted context omitted.

Yes, but what about the audacity of it? Get paid a lot to join a company but then decide to get up and leave again 2 years later? He just wants to be passed around?

There's a possibility that he lost out in internal political battles, and things weren't going his way. Google is full of battle-hardened political warriors who will do anything (subterfuge, sabotage, etc.) to win battles. It is possible that a guy who just wants to build cool shit would feel like a misfit in such an environment.

Noam Shazeer is not some super brain anymore.

His raw skills are likely atrophied by now from delegating and operating at higher levels. His entire value is mostly political now.

If he can’t play the political game and win, he’s useless. He would probably just go to some other organization where people aren’t immune to his lore.

Re: Noam Shazeer Joins OpenAI

#407

Post by tmule »

tovej wrote: post #352
UltraSane wrote: post #333

Earlier quoted context omitted.

Israel actually LEFT Gaza. You seem biased to the point of just plain lying.

They did not. They're still occupying a buffer zone, have broken the ceasefire countless times, and are blocking people from crossing. Israel razed Gaza to the ground. It was a genocide.

Don’t wrestle with pigs or argue with Zionists about Israel (though the former will at least avoid accusing you of things you’re not).

Re: Noam Shazeer Joins OpenAI

#408

Post by tmule »

throw37832 wrote: post #388
tovej wrote: post #353

Earlier quoted context omitted.

Zionist does have a specific meaning. It means you think the Jewish people have a god-given right to the Palestinian land, and that other creeds and ethnicities should be second class within the Jewish state in Palestine. A non-zionist Israel would be one where all peoples had the same right, e.g.

There are more Muslims living happily in Israel than Jews in all Muslim countries combined. More specifically there are 0 Jews living in areas under control of the Palestinian Authority, or in Lebanon, Syria, Egypt, Jordan, and Yemen.

Illogical collectivist blather suggesting that therefore, Muslims should be treated as a collective, and deprived of rights in Israel? Also, what’s with the “happily”?

Re: Noam Shazeer Joins OpenAI

#409

Post by cl3misch »

abixb wrote: post #245
HarHarVeryFunny wrote: post #120

Earlier quoted context omitted.

The architecture was Shazeer's, but the rough idea came from Jakob Uszkoreit who initiated the project. Uszkoreit wanted to build a more efficient/scalable language/seq2seq model that could take advantage of GPU parallelism (replacing RNNs which were the main approach to sequence modelling at that time). Uszkoreit's insight was that although language appears sequential, it is in fact really part parallel part hierarc…

Curious about others' contributions, such as Vaswani, Parmar, Jones and Gomez, to the paper. What sucks about co-authorship in research papers is that you don't get a clean breakdown of who contributed what to the research paper, and the distribution (in more cases than not) is very much like a pareto distribution. I'm talking from plenty of group project experience here.

> What sucks about co-authorship in research papers is that you don't get a clean breakdown of who contributed what to the research paper

Why? If you read a research paper for its content this is not especially important.

This thread is more about the people of course, and here we care, but that's not the point of a research paper.

Re: Noam Shazeer Joins OpenAI

#410

Post by frollogaston »

bigyabai wrote: post #405
frollogaston wrote: post #401

Earlier quoted context omitted.

The Apple deal is a good sign. Before that, it was like yeah Gemini might have the lowest cost per query but that doesn't matter when its users largely aren't paying for it and never will.

Google only won the deal because they have great cards in their hand. Apple's homemade PCC nodes were never going to scale, but the TPUs would. Investors expected market displacement in all the wrong places. The tea leaves were pretty easy to read, too; LLMs will eventually be commoditized. Once that happens, the only road to profitable AI will be paved with 1) branding and 2) cheap compute. Apple does not possess ch…

Would expect LLM training/inference infra to become commoditized before LLMs do.
Post reply on HN