GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
1–10 of 151 posts
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#2Buried in an arXiv paper was this nugget. Thought I'd share!
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#3[deleted]
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#4NLP is solved, more or less. Either way, Bespoke NLP is on its way out. It's pretty funny how buried this is in the original paper.
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#5Interesting to see what the impact will be on crowdsourcing annotation companies like Scale AI, especially after reading this article: https://www.forbes.com/sites/kenrickcai/2023/04/11/how-alexa...
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#6NLP is solved, more or less. Either way, Bespoke NLP is on its way out. It's pretty funny how buried this is in the original paper.
Parts of NLP have made great progress. There are still parts of NLP that could still be improved, such as the truthiness of generated answers.
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#7I don't think I see enough discussion about what this means for privacy. There was some protection in the fact that it was prohibitively expensive to get someone to listen to every single one of our phonecalls/read all our emails/etc.
Worrying that this will no longer be the case.
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#8Interesting to see what the impact will be on crowdsourcing annotation companies like Scale AI, especially after reading this article: https://www.forbes.com/sites/kenrickcai/2023/04/11/how-alexa...
Anecdotally, several CTOs I know intend to lessen their use of Scale, Labelbox and more in the future. Talked to one today who already ditched MTurk for GPT-4 -- cheaper, better, faster was what he said.
Labelbox does image annotating still, and one CTO said as soon as GPT-4 enabled this for him he'd have his team homebrew it from there.
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#9I don't think I see enough discussion about what this means for privacy. There was some protection in the fact that it was prohibitively expensive to get someone to listen to every single one of our phonecalls/read all our emails/etc. Worrying that this will no longer be the case.
Now that is something I hadn't considered. Woah.
Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours
#10Does OpenAI even have the compute to begin to meet demand?