Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Three senior researchers have resigned from OpenAI

news.ycombinator.com

Post reply on HN
Print view View original

621–630 of 711 posts

Re: Three senior researchers have resigned from OpenAI

#621

Post by Jensson »

boh wrote: post #607
Jensson wrote: post #603

Earlier quoted context omitted.

> Google has a history of "ask for forgiveness not permission" when it comes to data mining. For very profitable things. This isn't very profitable, which is why I added that part to my comment. Google has a very good understanding what they get sued for and how much those lawsuits costs, if it is profitable anyway they go ahead.

After Open AI's proposed share sale it will likely be valued at $80-90 billion. That seems pretty profitable.

That doesn't come from ChatGPT though, that comes from expectation of much more products in the future and the possibility of them beating Google.

Re: Three senior researchers have resigned from OpenAI

#622

Post by kevinventullo »

aidaman wrote: post #156
lannisterstark wrote: post #19

Earlier quoted context omitted.

Doomerism when it comes to technology has always been such a weird mindset to me. "oh no, they're gonna take the horses/horse buggies/telegram/landlines away!" "Goddamn, how dare they invent the bigger cannons!?" - Romans, 1453, in Constantinople probably. (One incident where I can use my exempt powers).

Most of the time the technology is not building an artificial intelligent computer that is capable of superhuman reasoning. Have you used gpt4? it's reasoning capabilities match human ability. The more you think about it, the more scary the reality becomes. GPT 4 can reason through any mental exercise as well as a human. The rest of the work to make it autonomous is simple in comparison.

GPT 4 can reason through any mental exercise as well as a human

Lol try giving it any of the puzzles from here: https://momath.org/home/varsity-math/complete-varsity-math/

Don’t just accept its confident tone, read through and actually parse the logic. It totally falls apart.

Re: Three senior researchers have resigned from OpenAI

#623

Post by andomiz2 »

andrewstuart wrote: post #287
mirzap wrote: post #193

This is escalating rather quickly. It is an incredibly irresponsible move by the OpenAI board. Hypergrowing company, and now they managed to shake up their user's trust in leadership stability. This has Adam's (D'Angelo) fingerprints all over it (for context, he did overthrow his co-founder, and Quora has been struggling ever since). This guy shouldn't sit on any board ever again. I predict the board will be fired, a…

I’d be surprised if Sam does. He’s free now to compete and defeat with a huge equity stake.

No I don't think he really is free to compete. I think three letter agencies pulled the plug after his disturbing performance in Congress and attempt to strong arm the US government. It made me physically sick to watch.

Re: Three senior researchers have resigned from OpenAI

#624

Post by [deleted] »

sbrother wrote: post #565
belter wrote: post #473

Earlier quoted context omitted.

If all of that would be enough, there would be a ChatGPT from Google, a long time ago...

Google invented the core technology, and they had an internal version long before ChatGPT was released. I joined when it was already at the "accessible to all employees" stage and it absolutely blew my mind. They just hadn't -- and still haven't -- figured out how to commercialize it yet. I don't think they'll be the ones to crack that nut either. IMO they are too obsessed with "safety" to release something useful, a…

[deleted]

Re: Three senior researchers have resigned from OpenAI

#625

Post by andomiz2 »

kashyapc wrote: post #384
Shank wrote: post #192

It seems like firing Sam and causing this massive brain drain might be antithetical to the whole AGI mission of the original non-profit. If OpenAI loses everyone to Sam and he starts some new AI company, it probably won't be capped-profit and just be a normal company. All of the organizational safeguards OpenAI had inked with Microsoft and protection against "selling AGI" once-developed are out-the-window if he just…

Hi, can we talk about the elephant in the room? I see breathless talk about "AGI" here, as if it's just sitting in Altman's basement and waiting to be unleashed. We barely understand how consciousness works, we should stop talking about "AGI". It is just empty, ridiculous techno-babble. Sorry for the harsh language, there's no nice way to drive home this point.

Yes we should absolutely talk about that because it's a key contributor to a lot of the worry about letting Sam continue to go around and do stuff like strong arming the US government in public. He's getting high on his own supply. And I don't think he is going to be allowed to continue fucking around like that. And that goes for any scientists that that have joined up in his apocalyptic and extremely dangerous worldview as well.

Re: Three senior researchers have resigned from OpenAI

#626

Post by pixl97 »

hhsectech wrote: post #556
mcpackieh wrote: post #466

Earlier quoted context omitted.

Consciousness has no technical meaning. Even for other humans, it is a (good and morally justified) leap of faith to assume that other humans have thought processes that roughly resemble your own. It's a matter philosophers debate and science cannot address. Science cannot disprove the p-zombie hypothesis because nobody can devise an empirical test for consciousness.

I dont understand why something has to be conscious to be intelligent. If they were the same thing we wouldn't have two separate words. I suspect AGI is quite possible, it just won't be what everyone thinks it will be.

I'm pretty sure this was the entire point of the Paperclip Optimizer parable. That is that generalized intelligence doesn't have to look like or have any of the motivations that humans do.

Human behavior is highly optimized to having a meat based shell it has to keep alive. The vast majority of our behaviors have little to nothing to do with our intelligence. Any non-organic intelligence is going to be highly divergent in its trajectory.

Re: Three senior researchers have resigned from OpenAI

#628

Post by andomiz2 »

convexstrictly wrote: post #2

In March, Sam Altman said that Pachocki's "overall leadership and technical vision" was essential for pre-training GPT-4. https://twitter.com/sama/status/1635700851619819520

Yep, this and the capital hill stuff is what got the plug pulled. Thank God somebody finally recognized what an enormous threat this guy and his mad scientist friends are.

Re: Three senior researchers have resigned from OpenAI

#629

Post by andomiz2 »

ahepp wrote: post #138
ThrowawayTestr wrote: post #81

Earlier quoted context omitted.

Microsoft owns it. I honestly can not imagine trying to build a business on an API owned by Microsoft of all companies.

Isn't Microsoft famous for their insane API stability and backwards compatibility?

No I would not say that at all. Microsoft has gone through how many Desktop APIs for Windows at this point? At least a dozen I'd think.

Re: Three senior researchers have resigned from OpenAI

#630

Post by konschubert »

joachim4 wrote: post #325
konschubert wrote: post #253

Earlier quoted context omitted.

The problem is that you cannot finance the training of a competitive AI model and then turn around and give it all away for free. Who's supposed to pay for that?

Universities usually do that, they work on open problems and publish their findings for free.

Since there is enough private investment available, why spend public money?
Post reply on HN