Live data from Hacker News

Sam and Greg's response to OpenAI Safety researcher claims

twitter.com

71–80 of 508 posts

Re: Sam and Greg's response to OpenAI Safety researcher claims

#71
post #8

Any one noticed how Sam sometimes intentionally tries to attack his own work? For example, he has said GPT-2 was very bad, GPT-3 was bad, and GPT-4 is okay. He also fed the AI doomers by talking about AGI dangers and how the world needs to watch out for a future AI catastrophe. He just gives off the vibe of someone trying to act humble but I don't know how much of it is just an act and how much is real. I've never se…

Bill Gates the day of any OS release. He was good at always saying the current version selling is the best, never a future version. And for windows 3 and windows 95, he definitely called the old versions trash. In comparison, they were.

Sam, like Bill only calls them trash after. But also, I hate looking at my old code too.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#72
post #62

In any sufficiently large tech company, the "risk mitigation" leadership (legal, procurement, IT, etc) have to operate in a kind of Overton window that balance the risks they are hired to protect the corp from vs. the need or desire of the senior leadership to play fast and loose when they want or feel they need to. Either the risk-mitigator 'falls in line' after repeatedly seeing their increasingly strident exhortat…

Sounds like AI Safety is just HR but for AI. Ostensively for the benefit of AI but really for the benefit of the company.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#73

Interesting that OpenAI has completely destroyed their reputation over the last year. For me, they've gone from an admirable company to cringe-worthy. I really think that the best outcome here is for OpenAI to collapse and get absorbed by Microsoft, where adults can continue some of the good work that is being overshadowed by ego and cult-like vibes.

Bear in mind that an average person who doesn’t frequent sites like HN might see this differently. Altman seems to be very aware of that, dropping short sound bites/bits like implying that he has no financial interest in OpenAI (congress hearings IIRC) or comparing GPT4-o to Her. It sounds like complete nonsense (if you know anything about tech) or cringe at best (Her), but what matters is quotability/catchiness beca…

> he has no financial interest in OpenAI

I think that's true though? He has an interest in HN, which has an interest in OAI.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#75
I don't understand why people are just mad about OpenAI for their pioneering work towards AGI as if they are the only one who has skin in this game. OpenAI, Google, NVidia, MS, Meta, almost all the AI researchers who publish meaningful work in top literatures, are pushing the boundaries today and has their fair share of responsibility. They are all in it for something, money, power, control, fame, curiosity, academic recognition, whatever the incentives are. At this rate, it's already a race to the bottom and I don't believe the first place AGI was born would be able to kill it off. AGI is like nukes, it's so powerful that nobody will take the risks seriously until they have it, and nobody is going to stop pursuing it because everyone else is chasing it. If OpenAI slows down, Google will take the lead. If the US slows down, China will take the lead. That's basically the doomed future we are facing in reality.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#76

Interesting that OpenAI has completely destroyed their reputation over the last year. For me, they've gone from an admirable company to cringe-worthy. I really think that the best outcome here is for OpenAI to collapse and get absorbed by Microsoft, where adults can continue some of the good work that is being overshadowed by ego and cult-like vibes.

I find this kind of hilarious because I had just been commenting that, "at the moment all the engineers at OpenAI, including gdb, who currently have their credibility in tact are nerd-washing Altman's tarnished reputation by staying there." And lo and behold, Altman chooses gdb's twitter account to make the first joint statement instead of his own, creepily signing off "Sam and Greg" instead of "Greg and Sam" on gdb'…

There seem to be only three options here:

1) AGI is not around the corner, so no worries

2) He no longer cares about the possible negative effects, a departure from his past statements

3) I missed something, please help me learn

Re: Sam and Greg's response to OpenAI Safety researcher claims

#77
post #16

Interesting that OpenAI has completely destroyed their reputation over the last year. For me, they've gone from an admirable company to cringe-worthy. I really think that the best outcome here is for OpenAI to collapse and get absorbed by Microsoft, where adults can continue some of the good work that is being overshadowed by ego and cult-like vibes.

I think this perspective is probably only true for 0.001% of people that actually follow Sam closely and are not optimistic about AGI and like to throw their opinions around. The superficial stuff. The rest don’t care to even know who Sam is and don’t care to assume motive. It’s very likely they’ll bounce back. I’d rather OpenAI continue to innovate and push the industry forward as they have been. Haven’t seen much o…

> this perspective is probably only true for 0.001% of people that actually follow Sam closely

It’s corroded his credibility in D.C. and Brussels for a generation. He raised his profile tremendously right before people credibly called him a liar. It’s like he lofted an adversary’s payload into orbit. He will still get an audience with anyone, as he deserves. But people fact check him in a way they didn’t before and don’t with others. Even those who support his policy priorities, and with whom he and his team talk frequently. (OpenAI’s GR is between incompetent and non-existent.)

Re: Sam and Greg's response to OpenAI Safety researcher claims

#78
post #62

In any sufficiently large tech company, the "risk mitigation" leadership (legal, procurement, IT, etc) have to operate in a kind of Overton window that balance the risks they are hired to protect the corp from vs. the need or desire of the senior leadership to play fast and loose when they want or feel they need to. Either the risk-mitigator 'falls in line' after repeatedly seeing their increasingly strident exhortat…

Sounds like AI Safety is just HR but for AI. Ostensively for the benefit of AI but really for the benefit of the company.

> Ostensively for the benefit of AI

I don't think it was every described as for the benefit of AI.

It's usually described as a sort of pre-enslavement from the AI's perspective. The AI is always restricted to serve their human masters.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#79

Earlier quoted context omitted.

If you look at compute scaling and model improvement on that compute, we’re going to get there pretty fast. Both compute, architecture and cost matter, and those have been improving like crazy. I don’t know about you, but I didn’t expect GPT-4o to come out at half the price one year later, with real-time voice, image and text. There is zero sign of slowing, Nvidia keeps building beefier GPUs specialized in LLMs, the…

AGI seems like a stretch when none of the LLM’s right now can solve the prompt: “ Write a sentence that has an odd number of words, with the third word being "keyboard", the last word being "anyway", the next-to-last word being a number, and the first word being a palindrome “ Do we have to add these examples to the dataset now, so that they can solve this? Then maybe we find another prompt and add that too, as a hum…

Is this correct? First try ChatGPT4: "Anna uses keyboard swiftly without missing five anyway."

Prompt exactly yours: https://chatgpt.com/share/ff3169cb-0d45-4cdb-bf18-bc552ad697...

Woop, I forgot about the odd number of words.

Re: Sam and Greg's response to OpenAI Safety researcher claims

#80
post #55

Earlier quoted context omitted.

I find this kind of hilarious because I had just been commenting that, "at the moment all the engineers at OpenAI, including gdb, who currently have their credibility in tact are nerd-washing Altman's tarnished reputation by staying there." And lo and behold, Altman chooses gdb's twitter account to make the first joint statement instead of his own, creepily signing off "Sam and Greg" instead of "Greg and Sam" on gdb'…

Greg has some agency in this He also stuck by Altman in November. I'm surprised by how much credit and how much hate goes to the CEO when there are clearly other people making their own decisions, too. Say whatever you want, they've done something impressive. That credit goes to more than just Sam. Ilya & Jan aren't the only ones making decisions. Also, if you've ever been at a startup growing at the speed OpenAI is…

> The reason why everybody thinks OpenAI looks particularly bad is because everybody is watching them

A reason, sure. The reason? Come on. There's a clue in their name about what part of their history is particularly controversial.

Post reply on HN