OpenAI Releases Largest GPT-2 Text Generation Model
1–10 of 166 posts
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#2Re: OpenAI Releases Largest GPT-2 Text Generation Model
#3At a credibility score of 6.91/10, many people will rightly judge that the full GPT-2 model will remain insufficient for malicious use in creating fake news.
However, even the smaller models are already good enough for spamming/trolling/astroturfing. It doesn’t take a Shakespearean soliloquy to convince people of a point. Just enough of a flood of short 1-3 sentence pro/con comments on a forum can drastically affect the perceived public opinion of an issue. Those comments can then spur real people to reply, which could result in an ultimately organic but directed propaganda vector. Propaganda directors will carefully craft something for people to look at, and the GPT-2 bots will move people’s eyes in that direction.
You can see the same happen on r/subsimulatorgpt2, where the longer titles and prompts and replies eventually sprawl into incoherence, but the shorter sentences from the finetuned bots in the comments section are effectively indistinguishable from the kinds of short comments you would find on their respective subreddits.
Or in other words, the malicious uses for GPT-2 won’t be a tidal wave, but a flash flood.
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#4Sorry for asking but is there an example output and an example input?
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#5Sorry for asking but is there an example output and an example input?
The original GPT-2 blog post has famous demos of the 1.5B model: https://openai.com/blog/better-language-models/
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#6At a credibility score of 6.91/10, many people will rightly judge that the full GPT-2 model will remain insufficient for malicious use in creating fake news. However, even the smaller models are already good enough for spamming/trolling/astroturfing. It doesn’t take a Shakespearean soliloquy to convince people of a point. Just enough of a flood of short 1-3 sentence pro/con comments on a forum can drastically affect…
Funny how instead of admitting that social media is trash and doesn't facilitate meaningful communication, thus making it impossible to distinguish between humans and low-level bots, Silicon Valley types keep pretending the problem lies everyone except with their systems. The AI it too good, the people are too stupid, etc.
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#7Sorry for asking but is there an example output and an example input?
I created an Instagram account from a Google Colab instance.
https://medium.com/@jboren_20569/tensorrandos-gpt-2-musings-...
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#8Surely we are not far off models capable of submission-quality essays that will enable a new generation of cheating.
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#9At a credibility score of 6.91/10, many people will rightly judge that the full GPT-2 model will remain insufficient for malicious use in creating fake news. However, even the smaller models are already good enough for spamming/trolling/astroturfing. It doesn’t take a Shakespearean soliloquy to convince people of a point. Just enough of a flood of short 1-3 sentence pro/con comments on a forum can drastically affect…
Funny how instead of admitting that social media is trash and doesn't facilitate meaningful communication, thus making it impossible to distinguish between humans and low-level bots, Silicon Valley types keep pretending the problem lies everyone except with their systems. The AI it too good, the people are too stupid, etc.
There are too many edge cases to throw out the baby with the bathwater though. Reddit has a lot of really great niche communities that work hard to avoid toxicity (although to be fair I don’t go to anything news/politics related there, just memes and machine learning for me).
Facebook, likewise, is a trash company with a trash product, but has completely replaced the town notice boards and meeting halls in rural communities, and is indispensable for working with them.
I’ve been thinking hard enough to get steam blowing out of my ears trying to figure out a way to slice out that essential function from Facebook and put it on a platform that isn’t predatory and dangerous, but I still can’t square that circle. So in the meantime, if people want to engage and stay engaged with rural communities, Facebook is a necessary evil.
Re: OpenAI Releases Largest GPT-2 Text Generation Model
#10Sorry for asking but is there an example output and an example input?
You can check this interactive autocompletion demo (you provide the input), that I believe is based on the 774M model: https://transformer.huggingface.co/doc/gpt2-large