Live data from Hacker News

OpenAI says its new model GPT-2 is too dangerous to release (2019)

slate.com

81–90 of 131 posts

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#81
post #69

This is obviously in response to Mythos, but I'll actually defend their statement at that time - they were right to take a pause. Think about how much things have changed in our industry since GPT-2 has dropped - it WAS that dangerous, not in itself, but because it was the first that really signaled a change in the field of play. GPT-2 was where the capabilities of these were really proven, up until that point it was…

[flagged]

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#82
post #72

Earlier quoted context omitted.

I understand how laughable that sounds when I say it out loud. But the reality is, when I'm in a state of 'Tell LLM what to do, verify, repeat', it's really hard to sometimes break out of that loop and do manual fixes. Maybe the brain has some advanced optimization where once you're in a loop, roughly staying inside that loop has a lower impedance than starting one. Maybe that's why the flow state feels so magical, i…

I think it’s called "sunk cost fallacy".

"The last output is so close to exactly what I wanted, I can't not pull the machine's lever a few more times to finally get the jackpot..."

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#83
post #42

Earlier quoted context omitted.

Yeah, I find it a bit odd how at the time everyone was pointing and laughing at OpenAI for being obviously wrong about this. Now in 2026, AI slop is very obviously a serious problem - it inundates all platforms and obscures the truth. And people are still saying OpenAI in 2019 were wrong?

Both crowds are right because two messages were spread. The researchers spread reasonable fears and concerns. The marketing charlatans like Altman oversold the scare as "Terminator in T-4 days" to imply greater capacity in those systems than was reasonably there. The problem is the most publicly disseminated messaging around the topic were the fear mongering "it's god in a box" style messaging around it. Can't argue…

Right, there's a lot of that problem going on: https://en.wikipedia.org/wiki/Motte-and-bailey_fallacy

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#84

Someone needs to make a compilation of all these classic OpenAI moments. Including hits like GPT-2 too dangerous, the 64x64 image model DALL-E too scary, "push the veil of ignorance back", AGI achieved internally, Q*/strawberry is able to solve math and is making OpenAI researchers panic, etc. etc. I use Codex btw, and I really love it. But some of these companies have been so overhyping the capabilities of these mod…

> after wasting a day on this, I am now just going to go through the (single file) of code and just fix it myself.

Seriously, you wasted a whole day just so you wouldn't have to look at a single file of code?

> Update: some 20 minutes later, I have fixed the bug. Despite not knowing this particular programming language or framework.

Be really careful there, you might have accidentally learned something.

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#85
This was around the time I trained Transformer-XL (outside of OpenAI) with Ben Mann (https://yaroslavvb.medium.com/scaling-transformer-xl-to-128-...) . Originally we wanted to release train and release the weights as a kind of GPT-2.5, but our OpenAI friends pushed us to keep weights closed.

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#87

Someone needs to make a compilation of all these classic OpenAI moments. Including hits like GPT-2 too dangerous, the 64x64 image model DALL-E too scary, "push the veil of ignorance back", AGI achieved internally, Q*/strawberry is able to solve math and is making OpenAI researchers panic, etc. etc. I use Codex btw, and I really love it. But some of these companies have been so overhyping the capabilities of these mod…

Haven't you heard? "Coding is solved."

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#88

The current "too dangerous" hype today is Anthropic's Mythos. They say it is so mighty that they will wall it off and only grant access to approved corporations.

I would also say my tech is too dangerous and only allowed for selected corporations if I tried to sell my tech to said corporations.

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#89
Theads now of "Doctorow vs Zuboff", perhaps the two biggest critics of tech today, but Doctorow noting how Zuboff's criticism is really a radical super over amplification of ad-tech/big-tech's pitch, heightened to the point of being much scarier than the initial pitch. More than accepting the pitch, radically over accentuating the effectiveness of the ad-tech proposition! Yes ad-tech totally completely understands you! In vastly deep ways! How horrifying right? No, please don't keep signing up for your business to succeed by tapping this incredible keep infinitely detailed knowledge-bank of humanity that can predict everything! Don't give them money to make your business wildly successful beyond dream for their incredible insight! That would be so bad if their amazing tech let you exploit the population to amazingly target delivery of what you are selling! How horrible how effective it is!! https://www.cigionline.org/articles/doctorow-versus-zuboff/ https://www.schneier.com/blog/archives/2020/08/cory_doctorow...

This is happening so so strongly. All the time. But today especially. Mythos is a cult forming social technology much more than it is a technical technology. I'm going to be pretty wrong on that cynicism, I know! But also, it portrays a reality of what is happening. Mythos is being built as a Devs like diety with rule and domonion and awe. It drinks the nectar forbidden to man. We may not even sample this realm's tastes, nay! It would be ruin!!

The idea that this preciariat-launch to some trusted security firms is going to do jack all to actually build a base against what comes next is a joke. Maybe there is something to it, but my strong expectation is that the beneficiaries are not softwares of the world, not open source in any form, but some narrow closed far off present-day losers who have broadly bad bad bad systems that are just too big to embarrass. Too big too shame.

But more so, that this model gains a cascade of levels of notoriety by being Zuboff style too good to release.

Thus begins the new age. Hardware is now broadly post consumer, too expensive to buy. Mythos means nothing, is nothing. It's just the Zuboff excuse to roll the ladder up further, the reason to move from GPT-5.4 Pro prices of $270/1m tokens output to $2700+++/1m tokens. Mythos is the Zuboffian campaign to train us for the next 10x price increase. To tell us everything we have done is shit.

And given its costs to run: that's still going to be nowhere near enough!

Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)

#90
post #84

Someone needs to make a compilation of all these classic OpenAI moments. Including hits like GPT-2 too dangerous, the 64x64 image model DALL-E too scary, "push the veil of ignorance back", AGI achieved internally, Q*/strawberry is able to solve math and is making OpenAI researchers panic, etc. etc. I use Codex btw, and I really love it. But some of these companies have been so overhyping the capabilities of these mod…

> after wasting a day on this, I am now just going to go through the (single file) of code and just fix it myself. Seriously, you wasted a whole day just so you wouldn't have to look at a single file of code? > Update: some 20 minutes later, I have fixed the bug. Despite not knowing this particular programming language or framework. Be really careful there, you might have accidentally learned something.

It is entirely plausible they were just experimenting with AI tooling to better understand how to use it and what it is capable of. Their saying, 'Despite not knowing this particular programming language or framework.' indicates to me this is probably the case.
Post reply on HN