Live data from Hacker News

Sam and Greg's response to OpenAI Safety researcher claims

twitter.com

51–60 of 508 posts

Re: Sam and Greg's response to OpenAI Safety researcher claims

#53
post #8

Any one noticed how Sam sometimes intentionally tries to attack his own work? For example, he has said GPT-2 was very bad, GPT-3 was bad, and GPT-4 is okay. He also fed the AI doomers by talking about AGI dangers and how the world needs to watch out for a future AI catastrophe. He just gives off the vibe of someone trying to act humble but I don't know how much of it is just an act and how much is real. I've never se…

> Any one noticed how Sam sometimes intentionally tries to attack his own work? For example, he has said GPT-2 was very bad, GPT-3 was bad, and GPT-4 is okay. He also fed the AI doomers by talking about AGI dangers and how the world needs to watch out for a future AI catastrophe.

That is the opposite of criticism. It all translates to "GPT-(n+1) is going to be super awesome".

Re: Sam and Greg's response to OpenAI Safety researcher claims

#54

Why do we give this people credit by giving for granted that AGI is somehow magically around the corner? It is not, and everyone’s delusional.

If you look at compute scaling and model improvement on that compute, we’re going to get there pretty fast. Both compute, architecture and cost matter, and those have been improving like crazy. I don’t know about you, but I didn’t expect GPT-4o to come out at half the price one year later, with real-time voice, image and text. There is zero sign of slowing, Nvidia keeps building beefier GPUs specialized in LLMs, the…

AGI seems like a stretch when none of the LLM’s right now can solve the prompt:

“ Write a sentence that has an odd number of words, with the third word being "keyboard", the last word being "anyway", the next-to-last word being a number, and the first word being a palindrome “

Do we have to add these examples to the dataset now, so that they can solve this? Then maybe we find another prompt and add that too, as a human I’ve never seen such a question before, why do I seem to be able to do it so easily? We are creating some form of intelligence that will have a massive economic impact, but I doubt we are creating human like intelligence that has the ability of being far better than humans along every dimension, which is what super intelligence is

Re: Sam and Greg's response to OpenAI Safety researcher claims

#55

Interesting that OpenAI has completely destroyed their reputation over the last year. For me, they've gone from an admirable company to cringe-worthy. I really think that the best outcome here is for OpenAI to collapse and get absorbed by Microsoft, where adults can continue some of the good work that is being overshadowed by ego and cult-like vibes.

I find this kind of hilarious because I had just been commenting that, "at the moment all the engineers at OpenAI, including gdb, who currently have their credibility in tact are nerd-washing Altman's tarnished reputation by staying there." And lo and behold, Altman chooses gdb's twitter account to make the first joint statement instead of his own, creepily signing off "Sam and Greg" instead of "Greg and Sam" on gdb'…

Greg has some agency in this

He also stuck by Altman in November. I'm surprised by how much credit and how much hate goes to the CEO when there are clearly other people making their own decisions, too.

Say whatever you want, they've done something impressive. That credit goes to more than just Sam. Ilya & Jan aren't the only ones making decisions.

Also, if you've ever been at a startup growing at the speed OpenAI is growing (think revenue, fundraising, headcount), it's not that unusual to see cofounders leave or to have other leadership changes. The reason why everybody thinks OpenAI looks particularly bad is because everybody is watching them (and public sentiment towards ai has shifted)

Re: Sam and Greg's response to OpenAI Safety researcher claims

#56

Interesting that OpenAI has completely destroyed their reputation over the last year. For me, they've gone from an admirable company to cringe-worthy. I really think that the best outcome here is for OpenAI to collapse and get absorbed by Microsoft, where adults can continue some of the good work that is being overshadowed by ego and cult-like vibes.

I find this kind of hilarious because I had just been commenting that, "at the moment all the engineers at OpenAI, including gdb, who currently have their credibility in tact are nerd-washing Altman's tarnished reputation by staying there." And lo and behold, Altman chooses gdb's twitter account to make the first joint statement instead of his own, creepily signing off "Sam and Greg" instead of "Greg and Sam" on gdb'…

It would probably be against hacker news guidelines to call him a manipulative weasel, so I will refrain from that.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#57

Why do we give this people credit by giving for granted that AGI is somehow magically around the corner? It is not, and everyone’s delusional.

If you look at compute scaling and model improvement on that compute, we’re going to get there pretty fast. Both compute, architecture and cost matter, and those have been improving like crazy. I don’t know about you, but I didn’t expect GPT-4o to come out at half the price one year later, with real-time voice, image and text. There is zero sign of slowing, Nvidia keeps building beefier GPUs specialized in LLMs, the…

And still, Yann LeCun (head of AI at Meta, renowned AI/ML researcher) is convinced that we are far from reaching AGI. He makes convincing arguments, especially around the fact that we are not able to expose models to the amount of redundant information that even a young kid is exposed to.

I guess we'll see some shifting goals around "what is even AGI". You say the we'll have soon "models that most of us consider AGI today", but what does that even mean?

Re: Sam and Greg's response to OpenAI Safety researcher claims

#59

Earlier quoted context omitted.

If you look at compute scaling and model improvement on that compute, we’re going to get there pretty fast. Both compute, architecture and cost matter, and those have been improving like crazy. I don’t know about you, but I didn’t expect GPT-4o to come out at half the price one year later, with real-time voice, image and text. There is zero sign of slowing, Nvidia keeps building beefier GPUs specialized in LLMs, the…

AGI seems like a stretch when none of the LLM’s right now can solve the prompt: “ Write a sentence that has an odd number of words, with the third word being "keyboard", the last word being "anyway", the next-to-last word being a number, and the first word being a palindrome “ Do we have to add these examples to the dataset now, so that they can solve this? Then maybe we find another prompt and add that too, as a hum…

gpt-4o produced a correct sentence first try for me
Post reply on HN