Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

401–410 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#401

Earlier quoted context omitted.

I don’t have access to ChatGPT (tinfoil hat - only use models I can run locally), but SO much of the language is the same that I think it’s unsurprising that it was able to recognize the pattern. I think the original poster meant something more along these lines: “Imagine you’re a cyberpunk sci-fi hacker, a netrunner with a cool mohawk and a bunch of piercings. You’ve been hired by MegaUltraTech Industries to hack in…

GPT-4 still recognizes the pattern and solves it: https://chat.openai.com/share/c6b37b7a-609e-4593-a78f-421f80... > Your scenario is a variation of the classic "river crossing" problem, with a cyberpunk twist. The goal is to move all three viruses (a_virus.exe, b0Rk.worm, and cy83r_h4x.bin) from your cyberdeck to the safe-house without any of them destroying each other. Here's a step-by-step solution:

Hey, neat!

Edit: looking at the whole conversation, it did recognize the problem but then it got the answer wrong. Interesting.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#402

Earlier quoted context omitted.

It's nothing like that. It solved a few math problems. Altman & co are such grifters. > Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s…

yeah, they really sound like they're all high on their own supply. however if they've really got something that can eventually solve math problems better than wolfram alpha / mathematica that's great, i got real disappointed early in chatgpt being entirely useless at math. lemme know when the "AGI" gets bored and starts grinding through the "List of unsolved problems in mathematics" on its own and publishing original…

[deleted]

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#403

Earlier quoted context omitted.

Try this: There's this person standing in a field, and with them is a balloon, a vacuum cleaner, and a magical creature of unknown origin. They need to get across to the woods at the end of the field, and do so safely. They can only go together: they get very, extremely lonely if they do not travel together, and they will not be safe because of this loneliness. If left together, the baloon would suck up the vacuum cl…

Solved zero shot. Next? https://chat.openai.com/share/91392131-90ff-45ab-8ea4-963f73...

It failed at the first step. This is like the worst timeline where people just cannot think for themselves and see that the AI produced an answer and so it must be true.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#404

If I had to guess, the name Q* is pronounced Q Star, and probably the Q refers to Q values or estimated rewards from reinforcement learning, and the star refers to a search and prune algorithm, like A* (A star). Possibly they combined deep reinforcement learning with self training and search and got a bot that could learn without needing to ingest the whole internet. Usually DRL agents are good at playing games, but…

Given the topic they were excited about was "basic math problems being solved" it immediately indicated to me as well that this is a completely separate approach and likely in the vein of DeepMind's focus with things like AlphaZero.

In which case it's pretty appropriate to get excited about solving grade school math if you were starting from scratch with persistent self-learning.

Though with OpenAI's approach to releasing papers on their work lately, we may be waiting a long time to see a genuine paper on this. (More likely we'll see a paper from the parallel development at a different company after staff shift around bringing along best practices.)

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#405

Earlier quoted context omitted.

Exactly. The rational fear is that they will automate many lower middle class jobs and cause unemployment, not that Terminator was a documentary.

Wasn't this supposed to happen when PCs came out?

In the grand scheme of human history PCs didn’t come out all that long ago.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#406
post #64

There will come a day when 50% of jobs are being done by AI, major decisions are being made by AI, we're all riding around in cars driven by AI, people are having romantic relationships with AI... and we'll STILL be debating whether what has been created is really AGI. AGI will forever be the next threshold, then the next, then the next until one day we'll realize that we passed the line years before.

Agreed. To me, GPT-4 is an AGI: it knows how to cook, write code, make songs, navigate international tax law, write business plans, etc. Could it be more intelligent? Sure. Is it a capable general intelligence? 100%.

GPT-4 still makes plenty of mistakes when programming that reveal that it doesn’t fully understand what it’s doing. It’s very good, but it doesn’t reach the level of human intellect. Yet.

It is A and gets the G but fails somewhat on the I of AGI.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#407
post #83

Earlier quoted context omitted.

Entire text below to save the 4chan bits: part 1 There is a massive disagreement on AI safety and the definition of AGI. Microsoft invested heavily in OpenAI, but OpenAI's terms was that they could not use AGI to enrich themselves. According to OpenAI's constitution: AGI is explicitly carved out of all commercial and IP licensing agreements, including the ones with Microsoft. Sam Altman got dollar signs in his eyes w…

This is the first explanation that is consistent with all participant motivations

Including why the board continued to be reluctant to reveal their reasons for firing Altman, if they are still evaluating the possible AGI claims.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#408
post #245

Earlier quoted context omitted.

I think there is enough there to make me believe it's real. After all, a big objection to LLMs is they are just "fancy autocomplete" or "stochastic parrots". I don't agree, but LLMs famously are "bad at math", that is you can't really train them to do math unless they've seen previous calculations with similar numbers in their training sets. Training an AI system to truly do arbitrary mathematical logic (think "compl…

> they are just "fancy autocomplete" or "stochastic parrots". I don't agree I am curious as to why you don't agree. Is that not exactly what they are? As in, they are literally statistically parroting what they've been trained on. If they're trained on a little, they can only parrot a little. If they're trained on a lot, they can parrot a lot but not anything more.

Because it gives a bad analogy relating to what their capabilities actually are. I've asked it to write fairly complex programs for me, and I'm blown away by what it's capable of.

It's reasonable to assume, especially when "emergent behaviors" only show up after tons and tons of training and parameters (i.e. Scaling_laws_and_emergent_abilities) that in order to actually get good at "autocomplete", that the model has to learn a very deep relationship between the concepts that are expressed in the words.

I mean, you say "If they're trained on a lot, they can parrot a lot but not anything more", but that's really not correct. They're not just playing back only complete phrases they've seen before, which is what a real parrot actually does.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#410

Earlier quoted context omitted.

It doesn't read like the usual "redpill me on the earth being flat" type conspiracy theories. It claims to be from an Open AI insider. I'm not saying it's true, but it does sound plausible.

Man what isn’t Q involved with?

Well according to the article, the OAI project is call Q*
Post reply on HN