Live data from Hacker News

Show HN: Humans vs AI – A/B testing GPT-3

vwo.com

51–60 of 80 posts

Re: Show HN: Humans vs AI – A/B testing GPT-3

#52

For all the texts generated by GPT3, is anyone verifying that it's not just copy pasting paragraphs from previous seen texts? (like by, searching n-grams or even just googling it?) If not, then its pretty easy for GPT-3 to copy paste existing human written texts and just prove that it can write like a human.

I've been playing with the generated text. It's usually NOT a direct copy-paste (verifying by searching on Google with the generated text in quotes)

Re: Show HN: Humans vs AI – A/B testing GPT-3

#53
post #51

Was GPT-3 trained with data from other languages besides English?

OpenAI recommend it for English but it generates text for other languages too (but generated text is not that good).

E.g. here is amazon.de https://imgur.com/a/5JesS3Y

I have no idea if generated recommendations are good. I don't know German. Perhaps someone who knows can comment.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#54

For all the texts generated by GPT3, is anyone verifying that it's not just copy pasting paragraphs from previous seen texts? (like by, searching n-grams or even just googling it?) If not, then its pretty easy for GPT-3 to copy paste existing human written texts and just prove that it can write like a human.

It’s more like it picks words from autosuggest that you see on your mobile keypad but better

Re: Show HN: Humans vs AI – A/B testing GPT-3

#56
post #51

Was GPT-3 trained with data from other languages besides English?

OpenAI recommend it for English but it generates text for other languages too (but generated text is not that good). E.g. here is amazon.de https://imgur.com/a/5JesS3Y I have no idea if generated recommendations are good. I don't know German. Perhaps someone who knows can comment.

I am a native german speaker. The recommendations in the screenshot are quit good and are also correct from a grammar point of view.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#57
post #6

I wouldn't be surprised if the result of the next election in a country would be decided by a Transformer based deep neural network. The dictator in my country is already paying stupid people to write stupid comments, GPT-3 is already over their level.

May I ask you which country you are talking about?

Re: Show HN: Humans vs AI – A/B testing GPT-3

#58
post #50

Earlier quoted context omitted.

Good point. Just launched an A/B test on the page using GPT-3 generated suggestions: https://soapbox.wistia.com/videos/TRn6lQiVhU Let's see which one gets more participation :)

Whao, that's pretty cool ! I'm so curious of the results now ^^

Early results are promising (but it's still too early)

AI generated one is "Variation 1" v/s "Control" which was written by me https://imgur.com/a/pcbTGwR

Re: Show HN: Humans vs AI – A/B testing GPT-3

#59
post #34
post #6

I wouldn't be surprised if the result of the next election in a country would be decided by a Transformer based deep neural network. The dictator in my country is already paying stupid people to write stupid comments, GPT-3 is already over their level.

Can anyone ask GPT-3 who will be the next president?

Joe Biden commented on the election that he is disappointed in the outcome, but hopes that president-elect Trump can do some good for the country.

Though with another some context and different priming I guess I'd get a different answer.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#60
post #51

Was GPT-3 trained with data from other languages besides English?

Yes, I've been able to make it write very well in other languages. It's ability to write good text in a language will vary greatly with the text you input. Some inputs can make it write a lot of gibberish and improper grammar, while other input will make it write properly.

You can also do things like make a characters that speak one language and another which knows both languages, then the German guy will write in German and the other can answer in English.

Post reply on HN