Live data from Hacker News

Mechanical Turk shutting down September 30

mturk.com

31–40 of 178 posts

Re: Mechanical Turk shutting down September 30

#31

It’s kind of crazy they’re shutting this down just when this Service probably has the most possibilities ever. You have an agent with Multiple people doing actual physical tasks in the real world seems like something that could be really powerful.

Right? Not to mention the training/tuning possibilities. Mercor has a market value of $20B basically doing the same thing but desperately trying to find workers.

[deleted]

Re: Mechanical Turk shutting down September 30

#32
post #11

Mechanical Turk had a good run, but not surprised it's shutting down. I'm sure the platform was getting flooded with people doing task arbitrage and using lots of AI anyway. I believe the issue is that this can no longer be a horizontal play. MTurk was mostly for unskilled tasks...the kind AI can do well enough that it isn't worth the cost differential to verify it or keep farmed to humans. The "trust but verify" AI…

I think yes but on different categories. First one I imagine is robotics control and support. "This robot is having trouble folding a tshirt help it out for 1$" Unless they go the waymo route of highly trusted people but I think mass deployed robots are a bit safer than a car for this.

That's a remarkable idea. It could be heavily gamified, it could train models, and it might actually be mentally stimulating since you'd be facing different situations all the time.

Except, I'm a grown adult and I can't fold a t-shirt properly

Re: Mechanical Turk shutting down September 30

#34

Earlier quoted context omitted.

our of curiosity, can you say what your use of it was?

Initially the annotation of biomedical literature ( https://pubmed.ncbi.nlm.nih.gov/25592589/ ) but left academia for commercial use where we transitioned to arbitrage the market research and ephemeral task markets. It was essentially a research panel with a underdeveloped UI for tasks.. so abstract away AMT's tooling so it can be used by any buyer in the ResTech, Political Polling and Data Annotation space My favori…

[deleted]

Re: Mechanical Turk shutting down September 30

#36

Earlier quoted context omitted.

I think yes but on different categories. First one I imagine is robotics control and support. "This robot is having trouble folding a tshirt help it out for 1$" Unless they go the waymo route of highly trusted people but I think mass deployed robots are a bit safer than a car for this.

That's a remarkable idea. It could be heavily gamified, it could train models, and it might actually be mentally stimulating since you'd be facing different situations all the time. Except, I'm a grown adult and I can't fold a t-shirt properly

It could require listing your credentials to get you the proper tasks: doctor, lawyer, or tshirt folder

Re: Mechanical Turk shutting down September 30

#37
Had some absolutely bizarre results from their attempt to integrate mturk with Bedrock's 'ground truth' thing as of a few months ago. Threw simple mnist digits recognition at it, see what the quality, timing, and cost was. Figured mnist digits was at this point trivial. Spent $10 and the accuracy was marginally better than guessing, completely unusable results. Was completely baffled, people were publishing peer reviewed research based on exclusively mturk results.

Re: Mechanical Turk shutting down September 30

#38

Earlier quoted context omitted.

our of curiosity, can you say what your use of it was?

Initially the annotation of biomedical literature ( https://pubmed.ncbi.nlm.nih.gov/25592589/ ) but left academia for commercial use where we transitioned to arbitrage the market research and ephemeral task markets. It was essentially a research panel with a underdeveloped UI for tasks.. so abstract away AMT's tooling so it can be used by any buyer in the ResTech, Political Polling and Data Annotation space My favori…

What's up with the part of the website where you are talking about "neutralized foreign actors", was that also using contracted Mechanical Turk labor?

Re: Mechanical Turk shutting down September 30

#39
post #11

Mechanical Turk had a good run, but not surprised it's shutting down. I'm sure the platform was getting flooded with people doing task arbitrage and using lots of AI anyway. I believe the issue is that this can no longer be a horizontal play. MTurk was mostly for unskilled tasks...the kind AI can do well enough that it isn't worth the cost differential to verify it or keep farmed to humans. The "trust but verify" AI…

I think yes but on different categories. First one I imagine is robotics control and support. "This robot is having trouble folding a tshirt help it out for 1$" Unless they go the waymo route of highly trusted people but I think mass deployed robots are a bit safer than a car for this.

This is what I meant by full stack AI companies. I don't think you could get humans into the loop fast enough if they didn't have some idea of the type of task involved. I don't want people to be asked to fold a tshirt one moment and do a difficult traffic merge the next.

Re: Mechanical Turk shutting down September 30

#40
post #20

Earlier quoted context omitted.

I truly have no idea what this website is saying https://generalresearch.com/

Why it's Transactional Systems for Ephemeral Tasks, don't you know? No but same here. The other pages lead to more confusion.

My favourite part is the "our customers" section [0], starting with

> Ripe with fraud, labor exploitation, political polling manipulation

I am not sure if they want to convey what I think I am reading or not.

[0] https://generalresearch.com/mission/#:~:text=Our%20Customers

Post reply on HN