OpenAI says its new model GPT-2 is too dangerous to release (2019)
1–10 of 131 posts
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#2Had a minor conniption until I saw the year. OpenAI just struggled to close a round. And the New Yorker just published an unflattering profile of Altman [1]. So it would make sense they'd go back to the PR strategy of "stop me from shooting grandma."
[1] https://www.newyorker.com/magazine/2026/04/13/sam-altman-may...
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#3Wow! I totally remember reading the bit I'll quote down below back in 2019 and having my mind utterly blown. What a blast from the past. If anything, I think this moment was even more astounding to me than GPT 3.5, 4, etc.
> For example, researchers fed the generator the following scenario:
> > In a shocking finding, scientist discovered a herd of unicorns living in a remote, previously unexplored valley, in the Andes Mountains. Even more surprising to the researchers was the fact that the unicorns spoke perfect English.
> The GPT-2 algorithm produced a news article in response:
> > The scientist named the population, after their distinctive horn, Ovid’s Unicorn. These four-horned, silver-white unicorns were previously unknown to science. Now, after almost two centuries, the mystery of what sparked this odd phenomenon is finally solved. Dr. Jorge Pérez, an evolutionary biologist from the University of La Paz, and several companions, were exploring the Andes Mountains when they found a small valley, with no other animals or humans. Pérez noticed that the valley had what appeared to be a natural fountain, surrounded by two peaks of rock and silver snow. Pérez and the others then ventured further into the valley. “By the time we reached the top of one peak, the water looked blue, with some crystals on top,” said Pérez.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#4It playbook is that a model is too dangerous until a competitor releases a competing model that beats yours.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#5the thing could barely make full grammatical sentences, it's funny to see that even then they were overclaiming the fuck out of their myself
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#6I think they are right unintentionally. The growing amount of low-quality content everywhere could become a real problem.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#7Very safe to use the outputs to make a better model coz scraping the internet for publicly accessible content means your publicly shared outputs only become part of the same lol
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#8I'm wondering when people are going to figure out the doom marketing playbook.
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#9AI systems far weaker than GPT-2 have had terrible effects. The result of how information and power is distributed mostly flows along the lines of reward hacking recommendation engines, powered by even weaker models.
And yet, somehow, it is beyond disagreeable but unbelievable that other people may have and may still reasonably believe that these things are too dangerous for widespread release?
Re: OpenAI says its new model GPT-2 is too dangerous to release (2019)
#10I think they are right unintentionally. The growing amount of low-quality content everywhere could become a real problem.
Now imagine all that low quality AI slop is being posted online and a new generation of AI will "learn" from it, output it's own version of AI slop, that will eventually end up online again for a new generation of AI to "learn" from.
Something, something, idiocracy comes to mind.