Live data from Hacker News

People paid to train AI are outsourcing their work to AI

technologyreview.com

161–170 of 233 posts

Re: People paid to train AI are outsourcing their work to AI

#161
This article is complete bunk. The researchers used a "chatgpt detector" which as we've seen over and over in academia, do not work. This study is completely unfounded.

God I'm choking on the irony of an article about the dangers of using AI to train AI based on a study that used AI to detect AI

Re: People paid to train AI are outsourcing their work to AI

#162

Earlier quoted context omitted.

> That's because humans don't say things without understanding them. Yeah, about that. https://v.cx/2010/04/feynman-brazil-education The parallels to LLMs are rather uncanny, now that I think about it.

Yep, the LLMs' "success" starkly shows how little real thinking is actually done by people when writing or talking. Mostly it is just stringing out something that sounds OK.

The LLM true believers demonstrate a kind of inversion of the trajectory of science: instead of looking at history and seeing how things are never quite what they seem at the surface level, the believers look at the surface of humanity and proclaim that there is in fact less to things than what is commonly believed. And then they claim that LLM/AI will be able to easily surpass these primates because why not?

It’s not God of the gaps (these fantastic things you cannot explain are because God); it’s AI of the mundane.

Re: People paid to train AI are outsourcing their work to AI

#163
post #51

Earlier quoted context omitted.

This is funnier than it has any right to be, mostly given the over-abundant "AI will fix everything" narrative currently dominating the hn discourse. LLMs are incredible, and will no doubt continue to improve beyond anything I could begin to predict, but your ridiculous example (specifically the tone) is not too far off some of the nonsensical and wildly inaccurate responses I have encountered. I find rhe unfailing c…

LLMs are incredible tools, but they're just that - tools. They're not a replacement for human judgment. Heck, one of the things you have to judge is how accurate the answer is. The LLM can't assess that - as you note it has unfailing confidence in reporting the wrong information. What I have found, and I've been using Bard over ChatGPT because Bard seems to be a bit smarter at first glance, is these tools are powerfu…

> LLMs are incredible tools, but they're just that - tools. They're not a replacement for human judgment.

There is an adage—and there are many variations—that says something like: a falsehood can travel half-way across the world before the truth has time to put on its boots.

Re: People paid to train AI are outsourcing their work to AI

#164
post #139

Earlier quoted context omitted.

Yah, I knew someone would reply something like that. Just because someone sometimes says something without understand does not in slightest mean that that is the common occurrence.

Look, if you're going to make a claim about LLMs and Human minds being intrinsically different, you're going to have to lay out a testable hypothesis. Saying "LLMs will never be able to solve programming problems with variable renaming" would be a testable hypothesis. "LLMs cannot reason about recursion" would be a testable hypothesis. Something like "LLMs can act as if they understand but they don't truly understand…

It seems like right now the testable hypothesis "LLMs generate text that is fundamentally different from human beings." That's effectively the Turing test. Current LLMs do a better job of passing the Turing test than things in the past, but it doesn't take a lot of effort to distinguish.

It's difficult to generalize because it can be tuned to do any one thing. It's the whole process of doing anything that requires the full apparatus of a human being, and there is no sign that LLMs are approaching that any time soon.

Which is the other problem. We're talking about what LLM's might one day do, rather than what they currently do. It's entirely possible that one day LLMs will be as flexible as human beings, training themselves for every new scenario. I have reason to doubt it, but the basis of that doubt is only noticing the mechanical difference between brains and LLMs. I cannot prove that the limit cases will remain different.

Re: People paid to train AI are outsourcing their work to AI

#165
post #30

Earlier quoted context omitted.

A simulation of what?

> A simulation of what? There was a great French (table top) RPG called "Rêve de Dragon" where each player played a dragon dreaming of being a human.

So in about three years there's going to be a really fantastic TV show, goes on for five or six seasons, but gets canceled without a satisfying ending.

They're re-running our universe in simulation to try to generate a good finale for it.

Re: People paid to train AI are outsourcing their work to AI

#166

Earlier quoted context omitted.

> updating their data might become increasingly difficult. Very true, I suspect part of the changes at Reddit are being driven by them wanting to hoard their data from AI's et. al or at least make them pay for it.

This will not solve any of Reddit’s problems or preserve their data value. While more complicated than an API, it’s trivial to run accounts flooding Reddit with AI generated content through browser automation. Even if they switch to app only access, this is still not meaningfully challenging and app-only would also destroy the service.

Reddit doesn’t care about hosting AI content as long as it engages people. The idea (probably wrong) was that Reddit didn’t want to give free unlimited access to the data to anyone training an AI.

Re: People paid to train AI are outsourcing their work to AI

#167
post #81

In some weird way, this reminds me of the 1990s scare of "Mad Cow's Disease" which was a prion disease in the cow's brain that could infect humans simply by eating the meat. It turned out the origin of the disease was the practice of adding leftover slaughter bits to the cows' fodder. The cows were literally eating the brains of other cows, which created the opportunity for a dismangled protein to transmit again and…

But that wasn't a scare. It's a real thing that made people ill with no cure.

I didn’t mean to imply it wasn’t a real thing. (I’m not a native English speaker so I’m probably missing a nuance of “scare” beyond what appears to be its literal meaning of the general public being afraid.)

Re: People paid to train AI are outsourcing their work to AI

#168
post #44

Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…

Cuil Theory is finally coming true! http://cuiltheory.wikidot.com/what-is-cuil-theory

Re: People paid to train AI are outsourcing their work to AI

#169

This article is complete bunk. The researchers used a "chatgpt detector" which as we've seen over and over in academia, do not work. This study is completely unfounded. God I'm choking on the irony of an article about the dangers of using AI to train AI based on a study that used AI to detect AI

Plot twist: the author will turn out to have enlisted the help of AI in writing this article.

Re: People paid to train AI are outsourcing their work to AI

#170

Earlier quoted context omitted.

In what world do you live in? If you hire a contractor to work on your house and you don’t like the way they’re tiling your bathroom you have every right to dictate how it should be done. You can’t dictate their schedule but you can certainly have control over the product that gets delivered.

Yes, because I'm not a company. It's the same reason why if I pay my nephew $5 to mow my lawn, I'm not violating minimum wage laws. The law in the United states is that employers may not tell contractors how to do their job or else they'll be considered employees. I'm not an employer.

Yes, you are.[1] "Domestic workers are entitled to the minimum wage, with the exception of babysitters under the age of 18 and the employer’s parent, spouse, or child." Not nephews, cousins, and other more distant relatives.

This is California. Federal law has the "McDonald's Exception", enacted in 1996. [2] "A special minimum wage of $4.25 per hour applies to employees under the age of 20 during their first 90 consecutive calendar days of employment with an employer."

[1] https://www.dir.ca.gov/dlse/DomesticWorkerBillOfRights-FAQ.h...

[2] https://webapps.dol.gov/elaws/faq/esa/flsa/003.htm

Post reply on HN