This didn't age well
OpenAI says its new model GPT-2 is too dangerous to release (2019)
71–80 of 131 posts
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#72Earlier quoted context omitted.
> I am now just going to go through the (single file) of code and just fix it myself. That's front page news, in this era.
I understand how laughable that sounds when I say it out loud. But the reality is, when I'm in a state of 'Tell LLM what to do, verify, repeat', it's really hard to sometimes break out of that loop and do manual fixes. Maybe the brain has some advanced optimization where once you're in a loop, roughly staying inside that loop has a lower impedance than starting one. Maybe that's why the flow state feels so magical, i…
I think it’s called "sunk cost fallacy".
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#73Earlier quoted context omitted.
I understand how laughable that sounds when I say it out loud. But the reality is, when I'm in a state of 'Tell LLM what to do, verify, repeat', it's really hard to sometimes break out of that loop and do manual fixes. Maybe the brain has some advanced optimization where once you're in a loop, roughly staying inside that loop has a lower impedance than starting one. Maybe that's why the flow state feels so magical, i…
> it's really hard to sometimes break out of that loop and do manual fixes You're aware of the MIT Media Lab study[0] from last summer regarding LLM usage and eroding critical thinking skills...? [0] Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task June 2025 DOI:10.48550/arXiv.2506.08872
>> it's really hard to sometimes break out of that loop and do manual fixes
it's not just an erosion of skills, it can also break the whole LLM toolchain flow.
Easy example: Put together some fairly complicated multi-facet program with an LLM. You'll eventually hit a bug that it needs to be coaxed into fixing. In the middle of this bug-fixing conversation go and ahead and fire an editor up and flip a true/false or change a value.
Half the time it'll go un-noticed. The other half of the time the LLM will do a git diff and see those values changed. It will then proceed to go on a tangent auditing code for specific methods or reasons that would have autonomously flipped those values.
This creates a behavior where you not only have to flip the value, the next prompt to the LLM has to be "I just flipped Y value.." in order to prevent the tangent that it (quite rightfully in most cases) goes off on when it sees a mysteriously changed value.
so you either lean in and tell the llm "flip this value", or you flip the value yourself and then explain. It takes more tokens to explain, in most cases, so you generally eat the time and let the LLM sort it.
so yeah, skill erosion, but it's also just a point of technical friction right now that'll improve.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#74This marketing strategy is getting tiring, every model is more dangerous than the next...
Playing on fear instead of the bright future you are opening up for us all is not the feeling I would want to leave the public with
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#75Someone needs to make a compilation of all these classic OpenAI moments. Including hits like GPT-2 too dangerous, the 64x64 image model DALL-E too scary, "push the veil of ignorance back", AGI achieved internally, Q*/strawberry is able to solve math and is making OpenAI researchers panic, etc. etc. I use Codex btw, and I really love it. But some of these companies have been so overhyping the capabilities of these mod…
> a very straightforward and basic UI bug Show us the code, or an obfuscated snippet. A common challenge with coding-agent related posts is that the described experiences have no associated context, and readers have no way of knowing whether it's the model, the task, the company or even the developer. Nobody learns anything without context, including the poster.
That's hard to believe in my case. I tried a variety of prompts, 3 different frontier models, provided manual screenshot(s), the agent itself also took its own screenshots from tests during the course of debugging. Nothing worked. I have now fixed the bug manually after 15-20 minutes of playing around with a codebase where I don't know the language and didn't write a single line of code until now.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#76Someone needs to make a compilation of all these classic OpenAI moments. Including hits like GPT-2 too dangerous, the 64x64 image model DALL-E too scary, "push the veil of ignorance back", AGI achieved internally, Q*/strawberry is able to solve math and is making OpenAI researchers panic, etc. etc. I use Codex btw, and I really love it. But some of these companies have been so overhyping the capabilities of these mod…
I had a problem that required a recursive solution and Opus4.6 nearly used all my credits trying to solve it to no avail. In the AI apocalypse I hope I'm not judged too harshly for my words near the end of all those sessions lol.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#77Now that I see this in the light of the recent sama article, I wonder whether the point of the "it's too dangerous" rhetoric is to enable "Open" AI to avoid open-sourcing the weights and process. A convenient pretext for maintaining a monetizable competitive advantage while claiming a benevolent purpose.
They don't need an excuse to not open the model weights (unfortunately). As far as I know the only western lab to release weights of a former flagship model is xAI with Grok 2. They said they were going to do the same for Grok 3 but nothing so far.
They have no obligation to do any open releases, it's just good PR for recruitment, fundraising, and devrel
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#78They finally did release 2.0 under the MIT license. That was the last version (a 1.5-billion-parameter model) they would release open source. GPT3 for comparison has 175 billion parameters.
No. That’s not true. https://huggingface.co/openai/gpt-oss-120b Was released after.
For clarity here, "after" was 6 years later, once Meta and then the Chinese labs had already established the ecosystem
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#79All the good stuff gets posted after the Americans go to sleep
OP posted too early, they flagged it off the front page
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#80I think they are right unintentionally. The growing amount of low-quality content everywhere could become a real problem.
They were more than right. They were correct in an intentional, precise manner. This is what OpenAI actually stated[0]: > Synthetic imagery, audio, and video, imply that technologies are reducing the cost of generating fake content and waging disinformation campaigns. > ‘The public at large will need to become more sceptical of text they find online, just as the ”deep fakes” phenomenon calls for more scepticism about…
The fact that they knew they were shitting in the public well and did it anyways pisses me off. What colossally selfish assholes.
Hang them all.