Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

artisana.ai

Post reply on HN
Print view View original

111–120 of 151 posts

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#111

Post by flandish »

Nifty3929 wrote: post #74
876978095789789 wrote: post #50

Great to see this tech and the money invested in it being used to take low-paying jobs away from people with limited options, instead of something like drug discovery or cancer biology.

This assumes those people really do have no other way to contribute. I don’t believe that’s the case. Do you? I believe people can contribute in many different ways. When technology enables us to get my work output without me, that frees me up to produce other things for society.

> society

Sure. But when your “keep the lights on” job cuts you for AI, you are less likely to “produce other things” while you worry about food and heat.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#112

Post by jutrewag »

SongofEarth wrote: post #76
876978095789789 wrote: post #50

Great to see this tech and the money invested in it being used to take low-paying jobs away from people with limited options, instead of something like drug discovery or cancer biology.

PC and Xerox eliminated the secretarial pool, and working women since then have been working on much more meaningful things.

That’s debatable.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#113

Post by 411111111111111 »

nr2x wrote: post #56
stevenhuang wrote: post #42

Earlier quoted context omitted.

> This technology has been available since then No, it hasn't lol.

How sure are you about that? The basic theories have been around since the 70s, have been proven at scale in the last decade, and the NSA has more data and compute than anybody else. I’d be shocked if they aren’t very far along in solving many problems.

Your argument reminds me of the discussions about the moon landing.

If today's hardware was available 20 yrs ago, this would've been possible just like the moon landing could've been faked if it took place 20+ yrs later. The technology wasn't available at the time (GPUs in this case, and generally no experience in doing such advanced trick techniques for movies back then)

These models are having such a strong effect now because we've finally got the hardware to run them

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#114

Post by pseudo0 »

lumost wrote: post #101
troops_h8r wrote: post #7

I don't think I see enough discussion about what this means for privacy. There was some protection in the fact that it was prohibitively expensive to get someone to listen to every single one of our phonecalls/read all our emails/etc. Worrying that this will no longer be the case.

The top use case I've been hearing is in legal discovery. Law firms used to play games with diligence by disclosing TBs of email and making it cost prohibitive to find relevant emails. This task would normally require a $60-100/hr paralegal or lawyer. GPT-4 can do that task for fractions of a penny per email now. It doesn't have to be perfect if its competing with nothing. I expect we'll see similar shops for any oth…

Is there a solution to the issue of data stewardship yet? I'd imagine it typically would not be permissible to send a bunch of proprietary legal documents off to OpenAI.

What I'd really love to implement is a way for GPT-4 to answer questions based on a corpus of "all our Confluence pages plus random other sources of documentation." Like with the legal document issue, it's a bit of a nonstarter right now given the proprietary nature of corporate documentation.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#115

Post by pindab0ter »

flandish wrote: post #110
bequanna wrote: post #86

Earlier quoted context omitted.

With the current unskilled labor shortage driving wage increases which pushes inflation up, this seems to be arriving just in the time.

Just a small point of order: there is no such thing as “unskilled labor” - All labor is skilled labor. Even breaking rocks.

Labour for which no higher education is required, then?

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#116

Post by rozal »

RC_ITR wrote: post #77
nr2x wrote: post #56

Earlier quoted context omitted.

How sure are you about that? The basic theories have been around since the 70s, have been proven at scale in the last decade, and the NSA has more data and compute than anybody else. I’d be shocked if they aren’t very far along in solving many problems.

This isn’t really a “throw money at it” problem like the government is good at. Take drones for example. The government got really good at those because they made them jet-powered (lol) and blew a bunch of money on server-grade FPGA’s in each one of them. You can’t really just buy a lot of GPUs to make an LLM work, you need iterative development of architecture and training methods. Like maybe the government invented…

Did you like, forget the the military invented the nuclear bomb, semiconductors, coding, AI, NLP, the INTERNET.

Everything you use is from the military.

The government is good at lying, and making themselves ‘appear’ incompetent.

They secretly probably have a much further advanced quantum computer. Your viewpoint is limited to mainstream technology and mainstream science.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#117

Post by nethdeco »

rossdavidh wrote: post #68

So, uh, GPT-4 outperforms at labeling. What is that labeling used for? "Employing Surge AI's top-tier human annotators at a rate of $25 per hour would have cost $500,000 for 20,000 hours of work, an excessive amount to invest in the research endeavor. Surge AI is a venture-backed startup that performs the human labeling for numerous AI companies including OpenAI, Meta, and Anthropic." What could go wrong? Using GPT-4…

And the noise would keep adding up.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#118

Post by rozal »

stevenhuang wrote: post #92
nr2x wrote: post #56

Earlier quoted context omitted.

How sure are you about that? The basic theories have been around since the 70s, have been proven at scale in the last decade, and the NSA has more data and compute than anybody else. I’d be shocked if they aren’t very far along in solving many problems.

Pretty sure. Even the Manhattan project had nuclear research going on in public universities at the time. Nothing of the sort here for the attention mechanism which underpins LLMs we know today. Fundamental research isn't something you just throw money at and acquire. All we had back then were cleverbot and other expert systems.

The military invented AI and NLP which underpins LLMs.

The military is responsible for most the technology we use and talk about today. The government may appear incompetent, but we’re living off military hand-me-downs, the entire world is

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#119

Post by mclightning »

rossdavidh wrote: post #68

So, uh, GPT-4 outperforms at labeling. What is that labeling used for? "Employing Surge AI's top-tier human annotators at a rate of $25 per hour would have cost $500,000 for 20,000 hours of work, an excessive amount to invest in the research endeavor. Surge AI is a venture-backed startup that performs the human labeling for numerous AI companies including OpenAI, Meta, and Anthropic." What could go wrong? Using GPT-4…

This is a bigger problem than people realise.

Think about it, how many millions of articles are posted online produced by OpenAI's GPTs to date... Good luck clearing out the training data for GPT-5.

True human content will get gradually scarce. We steer it for sure for our posts, but it is still GPTs that do the heavy lifting.

OpenAI's own classifier fails to detect GPT-4 generated text at the moment.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#120

Post by [deleted] »

biohax2015 wrote: post #73
courseofaction wrote: post #24

We need new political arrangements to distribute the gains of AI or things are going to get very bad very quickly.

We are fucked. I have no hope in humanity managing this technology responsibly and no hope in my future. The months since ChatGPT's release have been some of the worst in my life, mental-health-wise.

[deleted]
Post reply on HN