Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI threatens to revoke o1 access for asking it about its chain of thought

twitter.com

Post reply on HN
Print view View original

231–240 of 323 posts

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#231

Post by FuckButtons »

DiscourseFan wrote: post #41
mjburgess wrote: post #8

Earlier quoted context omitted.

Yip. It's pretty obvious this 'innovation' is just based off training data collected from chain-of-thought prompting by people, ie., the 'big leap forward' is just another dataset of people repairing chatgpt's lack of reasoning capabilities. No wonder then, that many of the benchmarks they've tested on would be no doubt, in that very training dataset, repaired expertly by people running those benchmarks on chatgpt. T…

It seems like the best AI models are increasingly just combinations of writings of various people thrown together. Like they hired a few hundred professors, journalists and writers to work with the model and create material for it, so you just get various combinations of their contributions. It's very telling that this model, for instance, is extraordinarily good at STEM related queries, but much worse (and worse eve…

There’s hypothetically a lot of money to be made by automating away engineering jobs. Sticking on an autoregressive self prompting loop to gpt-4 isn’t going to get open-ai there. With their burn rate what it is, I’m not convinced they will be able to automate away anyone’s job, but that doesn’t mean it’s not useful.

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#233

Post by bamboozled »

colejohnson66 wrote: post #174
echelon wrote: post #93

Earlier quoted context omitted.

Wizard of Oz. There is no magic, it's all smoke and mirrors. The models and prompts are all monkey-patched and this isn't a step towards general superintelligence. Just hacks. And once you realize that, you realize that there is no moat for the existing product. Throw some researchers and GPUs together and you too can have the same system. It wouldn't be so bad for ClopenAI if every company under the sun wasn't also…

Quite a few times, the secret sauce for a company is just having enough capital to make it unviable for people to not use you. Then, by the time everyone catches up, you’ve outspent them on the next generation. OpenAI, for example, has spent untold millions on chips/cards from Nvidia. Open models keep catching up, but OpenAI keeps releasing newer stuff.

"Nothing you can make that can't be made" -- The Beatles :)

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#234

Post by buzzerbetrayed »

argiopetech wrote: post #34
fallingknife wrote: post #26

Earlier quoted context omitted.

This is correct. Most people hear about AI from two sources, AI companies and journalists. Both have an incentive to make it sound more powerful than it is. On the other hand this thing got 83% on a test I got 47% on...

On the other other hand, it had the perfect recall of the collective knowledge of mankind at its metaphorical fingertips.

Is that supposed to make it sound more powerful or less powerful than it really is?

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#235

Post by mardifoufs »

mrinterweb wrote: post #40

The name "OpenAI" is a contraction since they don't seem "open" in any way. The only way I see "open" applying is "open for business."

Reminds me of OpenText, which is basically a software sweatshop with the most closed source ecosystems you could think of

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#236

Post by puppycodes »

Instead of banning users they really should use a rate limit feature for whatever they consider "malicious" queries. Not only is it clearly buggy and not reviewed by a human but the trend of not explaining what the user did wrong or can and can't ask is such a deeply terrible fad.

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#237

Post by neodymiumphish »

colejohnson66 wrote: post #174
echelon wrote: post #93

Earlier quoted context omitted.

Wizard of Oz. There is no magic, it's all smoke and mirrors. The models and prompts are all monkey-patched and this isn't a step towards general superintelligence. Just hacks. And once you realize that, you realize that there is no moat for the existing product. Throw some researchers and GPUs together and you too can have the same system. It wouldn't be so bad for ClopenAI if every company under the sun wasn't also…

Quite a few times, the secret sauce for a company is just having enough capital to make it unviable for people to not use you. Then, by the time everyone catches up, you’ve outspent them on the next generation. OpenAI, for example, has spent untold millions on chips/cards from Nvidia. Open models keep catching up, but OpenAI keeps releasing newer stuff.

Fortunately, Anthropic is doing an excellent job at matching or beating OpenAI in the user-facing models and pricing.

I don’t know enough about the technical side to say anything definitive, but I’ve been choosing Claude over ChatGPT for most tasks lately; it always seems to do a better job at helping me work out quick solutions in Python and/or SQL.

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#238

Post by PeterHolzwarth »

notamy wrote: post #3

https://xcancel.com/SmokeAwayyy/status/1834641370486915417

The worst responses are links to something the generalized you can't be bothered to summarize. Providing a link is fine, but don't expect us to do the work to figure out what you are trying to say via your link.

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#239

Post by fragmede »

PeterHolzwarth wrote: post #238
notamy wrote: post #3

https://xcancel.com/SmokeAwayyy/status/1834641370486915417

The worst responses are links to something the generalized you can't be bothered to summarize. Providing a link is fine, but don't expect us to do the work to figure out what you are trying to say via your link.

Given that the link is a duplication of the content of the original link, but hosted on a different domain, that one can view without logging into Twitter, and given the domain name of "xcancel.org", one might reasonably infer that the response from notamy is provided as a community service to allow users who do not wish to log into Twitter a chance to see the linked content originally hosted on Twitter.

Nitter was one such service. Threadreaderapp is a similar such site.

Re: OpenAI threatens to revoke o1 access for asking it about its chain of thought

#240

Post by golol »

qsort wrote: post #6
contravariant wrote: post #4

Okay this is just getting suspicious. Their excuses for keeping the chain of thought hidden are dubious at best [1], and honestly just seemed anti-competitive if anything. Worst is their argument that they want to monitor it for attempts to escape the prompt, but you can't. However the weirdest is that they note that: > for this to work the model must have freedom to express its thoughts in unaltered form, so we cann…

Occam's razor: there is no secret sauce and they're afraid someone trains a model on the output like what happened soon after the release of GPT-4. They basically said as much in the official announcement, you hardly even have to read between the lines.

Occam's razor is that what they literally say is maybe just true: They don't train any safety into the Chain of Thought and don't want the user to be exposed to "bad publicity" generations like slurs etc.
Post reply on HN