the thing could barely make full grammatical sentences, it's funny to see that even then they were overclaiming the fuck out of their myself
imho it was more reasonable back then to claim "agi soon" -- back when nobody really knew how it scales
OpenAI were claiming GPT-2 was too dangerous because it could be used to flood the internet with fake content (mostly SEO spam).
And they were somewhat right. GPT-2 was very hard to prompt, but with a bit of effort it could spit out endless pages that were good enough to fool a search engine, and even a human at a first glance (you were often several paragraphs in before you realised it was complete nonsense.