Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Humans vs AI – A/B testing GPT-3

vwo.com

Post reply on HN
Print view View original

31–40 of 80 posts

Re: Show HN: Humans vs AI – A/B testing GPT-3

#31

Post by paraschopra »

edameme wrote: post #29
TrackerFF wrote: post #27

I've posted this before, but here's one service I can absolutely foresee: Automated job applications and Automated job listings Companies will use GPT-3 to generate job listings, and some company will curate a big database of good job applications (i.e those that have landed someone a job), and make a service where you feed in the listing, and out comes job application / letter.

Interesting thought. I would assume that job listings is easier to generate because it's a minimum threshold task, whereas job applications would be orders of magnitude harder because having a good application and being accepted to a job is weakly correlated at most.

People are trying though https://twitter.com/DonCubed/status/1284908940149395456

Re: Show HN: Humans vs AI – A/B testing GPT-3

#32

Post by rorykoehler »

xiphias2 wrote: post #6

I wouldn't be surprised if the result of the next election in a country would be decided by a Transformer based deep neural network. The dictator in my country is already paying stupid people to write stupid comments, GPT-3 is already over their level.

I’m almost certain I will soon stop using social media altogether. I’ve been considering it for years due to increasing prevalence of bots but gpt3 will push it over the line.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#33

Post by TrackerFF »

edameme wrote: post #29
TrackerFF wrote: post #27

I've posted this before, but here's one service I can absolutely foresee: Automated job applications and Automated job listings Companies will use GPT-3 to generate job listings, and some company will curate a big database of good job applications (i.e those that have landed someone a job), and make a service where you feed in the listing, and out comes job application / letter.

Interesting thought. I would assume that job listings is easier to generate because it's a minimum threshold task, whereas job applications would be orders of magnitude harder because having a good application and being accepted to a job is weakly correlated at most.

That's the thing, writing job applications sucks - and it's time consuming - which is why too many resort to just copy/pasting the same template for many jobs, which obviously shows if you've ever read a job application before.

A lot of posters here seem to complain (or have, for the past weeks) the GPT-3 output comes off as mediocre, but I'd wager that a lot of the job applications we see today are worse than mediocre, often times horrible.

It sucks that the end result would be some standoff between ML-software that reads job applications, written by some other ML-software, but there's lots of hours to be saved - from the human standpoint.

If I don't have to write 10 letters, then that's probably 10 hours saved from my part - as I easily use an hour to write a tailored job letter.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#34

Post by delaaxe »

xiphias2 wrote: post #6

I wouldn't be surprised if the result of the next election in a country would be decided by a Transformer based deep neural network. The dictator in my country is already paying stupid people to write stupid comments, GPT-3 is already over their level.

Can anyone ask GPT-3 who will be the next president?

Re: Show HN: Humans vs AI – A/B testing GPT-3

#35

Post by mkagenius »

For all the texts generated by GPT3, is anyone verifying that it's not just copy pasting paragraphs from previous seen texts? (like by, searching n-grams or even just googling it?)

If not, then its pretty easy for GPT-3 to copy paste existing human written texts and just prove that it can write like a human.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#36

Post by quickthrower2 »

TrackerFF wrote: post #33
edameme wrote: post #29

Earlier quoted context omitted.

Interesting thought. I would assume that job listings is easier to generate because it's a minimum threshold task, whereas job applications would be orders of magnitude harder because having a good application and being accepted to a job is weakly correlated at most.

That's the thing, writing job applications sucks - and it's time consuming - which is why too many resort to just copy/pasting the same template for many jobs, which obviously shows if you've ever read a job application before. A lot of posters here seem to complain (or have, for the past weeks) the GPT-3 output comes off as mediocre , but I'd wager that a lot of the job applications we see today are worse than medio…

I’ll have my bots talk to your bots

Re: Show HN: Humans vs AI – A/B testing GPT-3

#37

Post by Ologn »

mkagenius wrote: post #35

For all the texts generated by GPT3, is anyone verifying that it's not just copy pasting paragraphs from previous seen texts? (like by, searching n-grams or even just googling it?) If not, then its pretty easy for GPT-3 to copy paste existing human written texts and just prove that it can write like a human.

The question is, is this different from how humans learn to write and speak a particular language?

Re: Show HN: Humans vs AI – A/B testing GPT-3

#39

Post by Anirudh_Singh »

tren wrote: post #5

I feel like GPT-3 is going to unleash the next wave of SEO spam. Content spinning will be taken to the next level, will Google be able to detect GPT-3 content?

Yes you are right there are already lots of apps which people use to change the content.

Re: Show HN: Humans vs AI – A/B testing GPT-3

#40

Post by paraschopra »

C4stor wrote: post #21

I'm a little disappointed that the landing page for this challenge itself doesn't seem to be a live a/b test with live results for how much submissions are garnered through the human version of the page versus the gpt-3 one. Fun challenge though !

Good point. Just launched an A/B test on the page using GPT-3 generated suggestions: https://soapbox.wistia.com/videos/TRn6lQiVhU

Let's see which one gets more participation :)

Post reply on HN