41–50 of 72 posts
Earlier quoted context omitted.
You wrote the same thing twice, hehe. But the point gets across.
Artificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
and
"Artificial Artificial intelligence"
are the same thing.
Come on. This site can do better.
Earlier quoted context omitted.
Artificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
"Artificial AI" and "Artificial Artificial intelligence" are the same thing. Come on. This site can do better.
Where do I find participants for my user studies then?
Human labeling is a two sided marketplace and so as any marketplace startup knows, both sides need to be constantly nurtured otherwise the system can collapse as worsening quality leads to churn and a vicious cycle that empties out the platform.
In labeling, you need to understand the limitations of individual work and fatigue, keep your pipeline bursting with awesome and consistent work, and improve the platform to make customer experience great.
AMT has been totally languishing in all these respects. Pay is terrible, dishonesty rampant, etc. It was a bad product, no need to pedestalize it or turn it political
> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete their tasks, I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.
This likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs. If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
It's like the speed of light - to get to that point, you need exponentially more energy, and you will never ever get there.
Earlier quoted context omitted.
You wrote the same thing twice, hehe. But the point gets across.
Artificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
Earlier quoted context omitted.
Artificial Artificial Artificial intelligence is when the chat bot is out of capacity, so a person in India is writing the response that gets returned by the LLM which gets pasted into Mechanical Turk.
"Artificial AI" and "Artificial Artificial intelligence" are the same thing. Come on. This site can do better.