Show HN: Humans vs AI – A/B testing GPT-3
1–10 of 80 posts
Re: Show HN: Humans vs AI – A/B testing GPT-3
#2Hello HN,
As an A/B testing company (VWO), it's exciting to see how much effective is GPT-3 generated copy against human copywriters on live websites.
I like to think of this as the Turing test on the web :)
The quality of generated headlines, buttons and product descriptions seem very good, so we're hopeful that AI will at least score a few statistically significant wins.
I encourage you to participate in the competition (you don't have to use VWO for A/B testing - you can use your existing stack).
If you have any feedback or comments, happy to discuss.
Re: Show HN: Humans vs AI – A/B testing GPT-3
#3Really cool seeing GPT-3 in the wild. Very nice landing page.
Re: Show HN: Humans vs AI – A/B testing GPT-3
#4Interesting... honestly having seen some of GPT-3's output I'd be curious how well it performs here. One of the things that I think can still give GPT-3 away (GPT-2 as well) ... is that even if the text feels real, it lacks a deep emotional cohesion. Sometimes this can feel like an advanced word salad generator, some poetry can be recognizable this way, because some GPT poems can seem 90% real, but when compared to a poem a human wrote they just lack a a "punch". Of course this test will be quite different... but the idea that GPT-3 can out perform human text on a task to get people to do something will be quite a strong argument for its potential impact on economy/GDP!
Re: Show HN: Humans vs AI – A/B testing GPT-3
#5I feel like GPT-3 is going to unleash the next wave of SEO spam. Content spinning will be taken to the next level, will Google be able to detect GPT-3 content?
Re: Show HN: Humans vs AI – A/B testing GPT-3
#6I wouldn't be surprised if the result of the next election in a country would be decided by a Transformer based deep neural network.
The dictator in my country is already paying stupid people to write stupid comments, GPT-3 is already over their level.
Re: Show HN: Humans vs AI – A/B testing GPT-3
#7Not sure why you're being downvoted.
Re: Show HN: Humans vs AI – A/B testing GPT-3
#8I feel like GPT-3 is going to unleash the next wave of SEO spam. Content spinning will be taken to the next level, will Google be able to detect GPT-3 content?
Actually GPT-3 detectors can be built https://www.technologyreview.com/2019/03/12/136668/an-ai-for...
But it'll detect human written one too. So expect many false positives.
Re: Show HN: Humans vs AI – A/B testing GPT-3
#9Interesting... honestly having seen some of GPT-3's output I'd be curious how well it performs here. One of the things that I think can still give GPT-3 away (GPT-2 as well) ... is that even if the text feels real, it lacks a deep emotional cohesion. Sometimes this can feel like an advanced word salad generator, some poetry can be recognizable this way, because some GPT poems can seem 90% real, but when compared to a…
IMO for e-commerce it's more like poetry than eg an opinion piece. A lot of product websites are just nice pictures and some standard fluff, plus a call to action. Kinda like lorem ipsum but a lot smarter.
My guess is it will work, GPT will be hard to distinguish from human copywriting, for a lot of everyday items. It will only be found out when there's some deeper logic involved in the sale, for instance if you were to try to have it pretend to be a B2B salesman.
Re: Show HN: Humans vs AI – A/B testing GPT-3
#10Interesting... honestly having seen some of GPT-3's output I'd be curious how well it performs here. One of the things that I think can still give GPT-3 away (GPT-2 as well) ... is that even if the text feels real, it lacks a deep emotional cohesion. Sometimes this can feel like an advanced word salad generator, some poetry can be recognizable this way, because some GPT poems can seem 90% real, but when compared to a…
I actually think this is a perfect use of GPT. So much of landing page stuff is just surface level fluff and there is a human in the loop to make sure that the page as a whole tells a cohesive message.