WOW. Not gonna lie. Up until the author mentioned that they didn't write the post, I really couldn't tell if a computer generated that post. This is scarily good.
OpenAI's GPT-3 may be the biggest thing since Bitcoin
341–350 of 554 posts
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#342Earlier quoted context omitted.
If OP article was cherry-picked, the tree must not be very productive. More than cherry-picking, there's the Eliza Effect - it's pretty easy to make people think generated text is intelligent. That text can seem intelligent for a while isn't necessarily impressive at all. https://en.wikipedia.org/wiki/ELIZA_effect
It will be very annoying for e.g. forum moderators to determine whether first user posts are just a bit incoherent, or generated spam garbage.
That used to be a pretty annoying thing back in the days of IRC as a kind of DOS: run a bunch of bots that just replay a conversation from another channel. Engaging them fails, but is that because they are bots, or because they're just ignoring you?
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#343Earlier quoted context omitted.
Besides predictable sentence structure, GPT-3 writes like George R. R. Martin: Interesting premises, solid setup but then it devolves into rambling tangents and never quite delivers the concluding action that ties everything together. Lots of examples I've seen have phrases like "see table below". Of course there's no table and it's hard to imagine how there could be. But GPT is trained on internet content and the in…
I am really curious how the model would be if you would train it with a decent amount of really good literature. Kazuo Ishiguro et al. instead of Reddit.
Library Genesis contains lots (millions?) of fiction ebooks (among other things). It's available in torrent form. Not that I would ever condone piracy or anything.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#344Wow this was amazing. As I was reading the article something at the back of my mind felt off but I could not tell what half way through the thought came to my mind it would be funny if this was an ai generated then the pay off at the end was great.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#345I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…
I read the beginning, went "what the fuck is this guy on about? Get to the point" and then came to check the comments to if this was anything interesting or worth reading, saw your comment, and skimmed the end bit. Overall I'm pleased with my process as its an efficient way to find out which articles are worth reading. But it was also clear to me that the author had difficulty making a clear point or had a goal in hi…
Yes, we have poorly written babble from humans too. Now we will have weapons grade babbling from machines.
The result is that worthwhile public discussion is dying. We have to transition now to secure verified communication.
Either that or the bots fork off a new cultural discourse and we treat them like a new form of entertainment.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#346I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…
I've started working on a version of GPT-2 which generates English text. The purpose of this is to improve its ability to predict the next character in a text, by having it learn 'grammatical rules' for English. It already works well for predicting the next character when it has seen only a small amount of text, but becomes less accurate as the amount of training text increases. I have managed to improve this by havi…
This comment reminds me of https://www.youtube.com/watch?v=RXJKdh1KZ0w
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#347Earlier quoted context omitted.
It was posted here: https://twitter.com/jsngr/status/1284511080715362304 Honestly not that impressive since you can get comparable results with a series of regex rules given that there are limited ways to describe your intent e.g. "create a button of colour at the "
What are your thoughts on why nobody made the set of rules yet?
If designers wanted to write texts to create visual designs, they'd be using some form of DSL and learn to code, wouldn't they?
I believe the hype is that people think they can replace the designer by "just telling the computer" what they want. I don't believe that will work, as they already have trouble telling a human what they want, and a computer won't really know what to do with "I want it to kind of feel like it's from that movie with the blue people that Cameron did, you know?"
In my experience, people have a hard time writing their ideas about designs & features down, because they don't know what they want. They want to talk about it abstractly with somebody who has a better understanding of the field so that person can help them develop the idea. I don't think ML will cover that part any time soon.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#348First line of the article: non profit [...] company. These two concepts are antinomical. Makes the article even more realistic as I thought a blogger would make that mistake.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#349Earlier quoted context omitted.
> Hasn't the typical human taken in orders of magnitude more data than this example? Have you read GPT-3s 175 billion parameters (words, sentences, papers, I don't care) of anything? Do you know all the words used in that corpus? Nobody has or does. A child of a small age can listen to a very small set of things and not just come up with words to communicate with mama and papa what they learned, but they can reuse it…
I recall a researcher filming their child from the day they were born until they began to speak. They wanted to find how many times a child had to hear a word in order to be able to repeat it back to the parent. The result, I think, was that if the child heard the word 2,000 times at all, they would be able to repeat it. But, if they heard the word 600 times at the same place, for instance the end of the couch, that…
> I recall a researcher filming their child from the day they were born until they began to speak.
Can’t tell if you are kidding or not, but if you aren’t, mind sharing links about the researcher for the curious?
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#350Tell me when this is possible: Read news from multiple sites. Rewrite articles automatically on my own news site with a different wording. Bam free automated news paper.
It's possible