Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

artisana.ai

Post reply on HN
Print view View original

31–40 of 151 posts

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#31

Post by boringuser2 »

local_crmdgeon wrote: post #21
MichaelZuo wrote: post #17

Earlier quoted context omitted.

Microsoft probably could buy several tens of billions of servers, though probably not feasible to spin up anytime soon.

This is a problem that money can solve.

If money could solve this problem, China would lead AI, not OpenAI.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#32

Post by CamperBob2 »

shaky-carrousel wrote: post #29
CamperBob2 wrote: post #22

Earlier quoted context omitted.

https://en.wikipedia.org/wiki/The_Machine_Stops

Interesting story, didn't know about it. Thanks.

A closer comparison might be the price gouging undertaken by Google Maps after effectively driving everybody else (but OSM) out of the market.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#33

Post by CamperBob2 »

brian_spiering wrote: post #6
famouswaffles wrote: post #4

NLP is solved, more or less. Either way, Bespoke NLP is on its way out. It's pretty funny how buried this is in the original paper.

Parts of NLP have made great progress. There are still parts of NLP that could still be improved, such as the truthiness of generated answers.

It is true, however, that the problem has been solved completely in the human-to-machine direction. The output of the current-generation LLMs is completely off base in many cases, but they certainly understand what they are being asked, for any useful definition of 'understand.'

I'm much more impressed by GPT's ability to handle input than I am in its ability to generate output. It's arguably as good at reading comprehension as most humans.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#34

Post by ClumsyPilot »

CamperBob2 wrote: post #22
shaky-carrousel wrote: post #14

Very interesting. Until the day OpenAI has a problem in their systems and the entire world grinds to a halt. Or they put outrageous new prices. Which apparently never happened in other fields, seems.

https://en.wikipedia.org/wiki/The_Machine_Stops

"At first, humans accept the deteriorations as the whim of the Machine, to which they are now wholly subservient, but the situation continues to deteriorate as the knowledge of how to repair the Machine has been lost"

Replace "the machine" eith "the market" and it describes some people today.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#35

Post by more_corn »

SketchySeaBeast wrote: post #19
troops_h8r wrote: post #7

I don't think I see enough discussion about what this means for privacy. There was some protection in the fact that it was prohibitively expensive to get someone to listen to every single one of our phonecalls/read all our emails/etc. Worrying that this will no longer be the case.

Man, I can't wait for the AI to start hallucinating crimes.

Already started. At least two reported cases.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#36

Post by orangepurple »

Roritharr wrote: post #20
Teever wrote: post #16

Earlier quoted context omitted.

Yeah, I think the NSA is going to get their money's worth for that Utah Datacenter that they started building like 20 years ago.

Looking at this from far away, with the Snowden revelations in mind I'd think it's not tinfoil hat territory to assume that some of the progress at OpenAI got achieved with some help from well ressourced folks in the USG/Three Letter Agencies.

I doubt it. Scraped tweets and reddit is already huge

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#37

Post by more_corn »

MichaelZuo wrote: post #17
boringuser2 wrote: post #10

Does OpenAI even have the compute to begin to meet demand?

Microsoft probably could buy several tens of billions of servers, though probably not feasible to spin up anytime soon.

Azure

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#38

Post by more_corn »

xiphias2 wrote: post #25
boringuser2 wrote: post #10

Does OpenAI even have the compute to begin to meet demand?

No, that's why it's impossible to get GPT 4 API access I guess. There are just not enough NVIDIA GPUs.

I got it. Impossible is a strong word.

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#39

Post by justinjlynn »

malux85 wrote: post #23
alphanumeric0 wrote: post #18

Earlier quoted context omitted.

Why do you think there was a mass surveillance of American domestic communications since forever ago, as leaked by Snowden? This technology has been available since then and can effectively summarize millions of pieces of communication.

Yeah but have you seen the leaked slides? It's clear that they have only the ability to analyse 10% or less of the data they are storing . GPT-like systems will close that gap, and then comes all of the problems of automated law enforcement - Extrapolation from incomplete data, false positives from coindicences, interpretation errors, all that annoying stuff

Just wait until they go back and have the bandwidth to finally analyse all the historical data they've accumulated...

Re: GPT-4 Outperforms Elite Crowdworkers, Saving Researchers $500k and 20k hours

#40

Post by xiphias2 »

more_corn wrote: post #38
xiphias2 wrote: post #25

Earlier quoted context omitted.

No, that's why it's impossible to get GPT 4 API access I guess. There are just not enough NVIDIA GPUs.

I got it. Impossible is a strong word.

Hm..can you tell me how to do it? I signed up a long time ago with my friend but didn't get it.
Post reply on HN