Live data from Hacker News

Amazon will stop accepting new customers for Mechanical Turk

techcrunch.com

21–30 of 72 posts

Re: Amazon will stop accepting new customers for Mechanical Turk

#21
post #11

Earlier quoted context omitted.

Yeah, I was doing this kind of Artificial Artificial Artificial Intelligence back in 2012 to make some extra $$$. Glad they finally "patched" that hole ^^.

You were using LLMs in 2012?

Artificial AI = stuff like mechanical turk where they get humans to do stuff computers can't do and make it look like it's "AI"

Artificial Artificial Intelligence = using computers to do mechanical turk jobs

Re: Amazon will stop accepting new customers for Mechanical Turk

#25
post #11

Earlier quoted context omitted.

You were using LLMs in 2012?

Artificial AI = stuff like mechanical turk where they get humans to do stuff computers can't do and make it look like it's "AI" Artificial Artificial Intelligence = using computers to do mechanical turk jobs

You wrote the same thing twice, hehe.

But the point gets across.

Re: Amazon will stop accepting new customers for Mechanical Turk

#28

Earlier quoted context omitted.

The Actually Indian kind?

Hey, maybe they're Indonesian!

Ever been to Singapore? Their apartments have a room for a Indonesian maid.

Never underestimate just how cheap human life is!

Re: Amazon will stop accepting new customers for Mechanical Turk

#29

I can see a high value startup, that will provide Human Intelligence with real Humans, locked in the room, with no network, books, LLMs and monitored 24x7 with cameras.

24/7 isolation with no stimulation outside of work? Wonder if the hallucination rate would be higher or lower

Re: Amazon will stop accepting new customers for Mechanical Turk

#30
post #20

> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete their tasks, I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.

This likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs. If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.

I think the "state of the art" of measuring the quality of outputs was to send the same task to multiple "agents" and only accept answers if over a certain amount agree. With some human review and reputation scoring sprinkled on top. It was a while since I was in this field though
Post reply on HN