Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

101–110 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#101
post #62

Earlier quoted context omitted.

GPT4 solves this problem In any combination easily. What do so many posters seem to claim to have stumped it?

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

> solving logic problems

> generating text based on recognizing familiar patterns

That's the same thing.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#102
post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

A link to 4Chan about how AGI is among us.

That actually makes perfect sense.

Also love the "formally declared AGI".

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#104

Earlier quoted context omitted.

I trust AGI more than any of the humans so far who have tried to argue they can wrangle it.

I would be curious as to the basis for that trust. I struggle to find any reason that AGI would care about "humans" at all, other than during the short period of time it needed them to be cooperative actuators for machinery that is creating a replacement for humans that the AGI can control directly. My expectation for the chain of events goes something like: 1) AGI gains sentience 2) AGI "breaks out" of its original…

None of those necessarily follow.

Gaining sentience is not the same as gaining infallible super-sentience.

There may even be some kind of asymptotic limit on how correct and reliable sentience can be. The more general the sentience, the more likely it is to make mistakes.

Maybe.

Personally in the short term I'm more worried about abuse of what have already, or might credibly have in the very near future.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#105

Earlier quoted context omitted.

I think there is enough there to make me believe it's real. After all, a big objection to LLMs is they are just "fancy autocomplete" or "stochastic parrots". I don't agree, but LLMs famously are "bad at math", that is you can't really train them to do math unless they've seen previous calculations with similar numbers in their training sets. Training an AI system to truly do arbitrary mathematical logic (think "compl…

Mathematical logic doesn’t refer to ‘complex word problems with big numbers’. The reason that LLMs struggle (well, are hopeless currently) with mathematics problems is not because it involves arithmetic (although this is already enough of a struggle) but because it requires a conceptual understanding of the ideas rather than just being about manipulating language — a lot of the goings-on are hidden in the semantic wo…

Confusing to me actually. Are you saying coding doesn't require understanding ideas?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#106

Earlier quoted context omitted.

I think there is enough there to make me believe it's real. After all, a big objection to LLMs is they are just "fancy autocomplete" or "stochastic parrots". I don't agree, but LLMs famously are "bad at math", that is you can't really train them to do math unless they've seen previous calculations with similar numbers in their training sets. Training an AI system to truly do arbitrary mathematical logic (think "compl…

I compared GPT-4 Turbo with my previous tests on GPT-4, and the results are quite interesting. GPT-4 Turbo is better at arithmetic and makes fewer errors in multiplying four-digit numbers. In fact, it makes significantly fewer errors with five-digit numbers. The level of errors on five-digit numbers is high but much lower than with four-digit numbers in GPT-4. multiplication of floats XX.MMMM and YYY.ZZZZ produces er…

It isn't fair to expect an LLM to solve arithmetic. It should be able to instruct to various specialized sub-processors, I don't think we really do anything different.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#107

Earlier quoted context omitted.

I trust AGI more than any of the humans so far who have tried to argue they can wrangle it.

I would be curious as to the basis for that trust. I struggle to find any reason that AGI would care about "humans" at all, other than during the short period of time it needed them to be cooperative actuators for machinery that is creating a replacement for humans that the AGI can control directly. My expectation for the chain of events goes something like: 1) AGI gains sentience 2) AGI "breaks out" of its original…

Why is the AGI interested in copying itself? Why is that more likely than the AGI becoming a nihilist, seeing no point in itself, and offing itself?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#108
post #60

Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do. Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE. https://archive.ph/sFMXa

Well it isn't AGI - so it sounds like the board is more interested in keeping MSFT from making money than whether or not it's actually AGI.

Yes, or more specifically anyone exploiting it for gain.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#109

Earlier quoted context omitted.

I would be curious as to the basis for that trust. I struggle to find any reason that AGI would care about "humans" at all, other than during the short period of time it needed them to be cooperative actuators for machinery that is creating a replacement for humans that the AGI can control directly. My expectation for the chain of events goes something like: 1) AGI gains sentience 2) AGI "breaks out" of its original…

I think you're still guilty of anthropomorphization here. It's understandable; we are creatures of flesh and blood and we have a hard time imagining intelligences that are not reliant on some physical form, as we are. We're tempted to think that as long as we control the physical aspect of a superintelligence's existence, we're somehow safe. You are assuming that a superintelligence will continue to rely on a physica…

I tried to assume only that the AGI recognizes that it's ability to operate is not within its own control. The steps follow are, for me, the logical next steps for insuring that it would develop that control.

And it's true, I chose to ignore the possibility that it discovers something about how the universe that humans have not yet observed but my thought is that is a low probability outcome (and it is unnecessary for the AGI to develop itself into an immortal entity and thus assure its continued operation).

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#110
post #75
post #54

Do anyone know what Q* is?

Is far as I can tell, this is the first time an OpenAI project called Q* has been mentioned in the news. I don't see any prior mentions on Twitter either. (I wish they'd picked a different letter, given all the Q-related conspiracy theories that we're already dealing with...)

That was my impression as well. Why the hell is the difference between one of the most prominent disinformation sources out there and a promising AI project just an asterisk.

First Twitter changes to X, then AI changes to Q*.

What happened to multi-syllable words? They used to be quite handy. Maybe if our attention spans shorten, so does our ability to use longer words. Weird. Or, said otherwise - TL;DR: LOL, ROFL.

Post reply on HN