Live data from Hacker News

Kenyan moderators decry toll of training of AI

theguardian.com

71–80 of 91 posts

Re: Kenyan moderators decry toll of training of AI

#71
post #3

Why were human data labelers involved in the creation of ChatGPT? I thought the approach was to let the neural network predict the next word in a large corpus of text?

After a large model is pretrained on a large corpus, it's not by default an instruction follower. You need an additional fine-tuning process to get it to follow instructions.

There are a number of ways to do that.

1. Supervised Fine-tuning. That is Fine-tuning on a corpus of instructions and responses

2. Reinforcement learning from Human feedback where the model trains to adjusts its responses based on feedback from humans

3. Reinforcement learning from AI feedback. Like above but with another LLM doing the rating/classifying.

Re: Kenyan moderators decry toll of training of AI

#72
post #46

Earlier quoted context omitted.

(I have edited to flesh these out a bit more, but have stopped since there is a reply) I've kinda waffled in my opinion of outsourcing through the years, but one issue I keep coming back to is that you can trivially view it as massive, intentional wage suppression. "It's cheaper to live there" yeah, I wonder why that might be. The numerous unbelievably wealthy global companies all doing this in the same very specific…

> The numerous unbelievably wealthy global companies all doing this in the same very specific areas surely have the area's best interests at heart, and want to raise its standard of living, so it must be something else. That’s the point of capitalism—-it works if you have only your own interests at heart. Wealthy Global Company A enters a market and makes huge profits. Wealth Global Company B (and maybe C, D, E, F, e…

> If companies in Country A move some jobs to Country B [...] is the world really worse off?

If the only change is salaries then no. My only objection to offshoring is when the conditions the workers are expected to endure are clearly far below what we'd consider minimally reasonable in developed countries - my basic rule is that "would people still hypothetically buy your product if they had walk through your factory first and observe those conditions first hand?". And no I don't think it's really enough to say "well at least it's better than subsistence farming" - in that case the conditions aren't (by and large) being imposed on them by others. It's a good thing corporations from developed economies are able to offer new employment opportunities in poorer countries, but for the sake of our own humanity, we still need to treat employees with the same basic decency as we would if they were in our own country.

Re: Kenyan moderators decry toll of training of AI

#73

Earlier quoted context omitted.

You don't perceive any significant difference between emergency work and AI training moderation?

One of them seems to have actually traumatic situations.

The potential harms of reviewing fucked up material even fictional are well attested. It's factored into law enforcement & child porn investigations and has been for years.

I am assuming you knew that though, and just enjoyed this little moment of belittling someone for their suffering. Hope it was nice. Hope you're having the day you wanted to have.

Re: Kenyan moderators decry toll of training of AI

#74

Based on the information in the article these complaints were raised after the contract was ended. Why not refuse the work or raise the complaint at the time? The article also mentions the work was worse than they thought, but indicates they were told what the work entailed before starting it. Also the primary person being quoted lost his wife and family, and blames this work on why he lost his wife. Anyone who has b…

> Anyone who has been in a relationship knows singular reasons are an oversimplification of a complicated relationship.

Oh come on:

> The 27-year-old said he would would view up to 700 text passages a day, many depicting graphic sexual violence. He recalls he started avoiding people after having read texts about rapists and found himself projecting paranoid narratives on to people around him. Then last year, his wife told him he was a changed man, and left. She was pregnant at the time. “I lost my family,” he said.

I deal with forensics and have incidental contact with similar; it rubs off on you. Even my own post history reflects a similar personality change over time; I've been accused of being an unmedicated schizophrenic (by someone committing disability fraud of all things). You stop sleeping, knowing what other people are capable of doing, concealing, and actively thinking about (especially when it's people you otherwise think you "know"). You come home progressively-broken from the shit you witness. Add to that a pregnant wife (the pinnacle of logic, reason and stability) and divorce is inevitable. It doesn't need a "complicated" relationship; when you look online, therapists will try to skim whatever they can off of you on the way out but /r/divorce is touted as the only solution to all marital problems-- especially "depressed spouse."

The man's job compelled him to read the equivalent of "The 120 Days of Sodom" every day. I couldn't even stomach it a single time as an edgelord teenager.

> Why not refuse the work or raise the complaint at the time?

Where's your empathy? The company set up shop in Africa for the purpose of exploiting everybody willing to walk through its doors. They don't need to put up with revolutionaries; they'll throw your ass out onto the street because there's a line of people who'll take your spot without complaint. Not an ideal situation to be in when you have a child on the way.

Re: Kenyan moderators decry toll of training of AI

#75
post #9

> Workers were paid between $1.46 and $3.74 an hour, according to a Sama spokesperson. I don't like how journalists never adjust the salary when doing those conversions. Yes $1.46 in the US sounds like the most abdject poverty, but Kenya is not the US. The minimum salary in Kenya is $1.05 so even their lower bound is 39% higher than the minimum salary with their upper bound being 358% higher. For job that while psych…

To all the pissy commentators on here - Average Monthly HOUSEHOLD Income in Kenya is around $145/month [0] The fact that Sama's STARTING SALARY is almost $300/month is staggering. That's the equivalent of being a SWE in the US (around $140k median salary) when the median salary in this country is around $65-70k/yr. Also, at $300/month I could hire plenty of English speaking moderators and labelers in Central/Southern…

What instability does Kenya have? There are sporadic minimal localized protests about the cost of living that happen now and then, but nothing on the scale of the animosity that exists between different religious groups in India (that flares up now and then, according to what I see in the news, which I recognize could be leading to me doing what I'm accusing you of). And $300 per month is too low, even in Kenya. That's what I earned in my first underpaid practically-an-unpaid-internship straight-out-of-university job 15 years ago.

Source: I live in Nairobi.

Re: Kenyan moderators decry toll of training of AI

#78
post #75

Earlier quoted context omitted.

To all the pissy commentators on here - Average Monthly HOUSEHOLD Income in Kenya is around $145/month [0] The fact that Sama's STARTING SALARY is almost $300/month is staggering. That's the equivalent of being a SWE in the US (around $140k median salary) when the median salary in this country is around $65-70k/yr. Also, at $300/month I could hire plenty of English speaking moderators and labelers in Central/Southern…

What instability does Kenya have? There are sporadic minimal localized protests about the cost of living that happen now and then, but nothing on the scale of the animosity that exists between different religious groups in India (that flares up now and then, according to what I see in the news, which I recognize could be leading to me doing what I'm accusing you of). And $300 per month is too low, even in Kenya. That…

You are correct. There isn't any significant instability.

I brainfarted and typed that instead of intertia and can't edit it now that the timer has passed.

Kenya is definetly on a solid path developmentally.

Though I'd be curious if someone who did a BA or BSc in a non-STEM major from a non-target university could get a $300/mon starting salary in Kenya.

Those tend to be the kinds of people who end up working as labelers in PH and IN, and I'd assume it's similar in Kenya.

Re: Kenyan moderators decry toll of training of AI

#79
post #75

Earlier quoted context omitted.

What instability does Kenya have? There are sporadic minimal localized protests about the cost of living that happen now and then, but nothing on the scale of the animosity that exists between different religious groups in India (that flares up now and then, according to what I see in the news, which I recognize could be leading to me doing what I'm accusing you of). And $300 per month is too low, even in Kenya. That…

You are correct. There isn't any significant instability. I brainfarted and typed that instead of intertia and can't edit it now that the timer has passed. Kenya is definetly on a solid path developmentally. Though I'd be curious if someone who did a BA or BSc in a non-STEM major from a non-target university could get a $300/mon starting salary in Kenya. Those tend to be the kinds of people who end up working as labe…

I do agree, there is significant unemployment, and it's possible that outside Nairobi, without rent and growing some food for yourself, $300 could go a long way.

I was speaking more in terms of "should", not "is". I think most semi-skilled jobs are probably paid around that, but it honestly doesn't compute to my privileged self how someone could live on that, with the rampant inflation.

Re: Kenyan moderators decry toll of training of AI

#80
post #79

Earlier quoted context omitted.

You are correct. There isn't any significant instability. I brainfarted and typed that instead of intertia and can't edit it now that the timer has passed. Kenya is definetly on a solid path developmentally. Though I'd be curious if someone who did a BA or BSc in a non-STEM major from a non-target university could get a $300/mon starting salary in Kenya. Those tend to be the kinds of people who end up working as labe…

I do agree, there is significant unemployment, and it's possible that outside Nairobi, without rent and growing some food for yourself, $300 could go a long way. I was speaking more in terms of "should", not "is". I think most semi-skilled jobs are probably paid around that, but it honestly doesn't compute to my privileged self how someone could live on that, with the rampant inflation.

Ok! That's fair!

And yea, inflation seems to be hellish outside the US+Canada.

Companies like SamaSource or Infosys can take advantage of that arbitrage by paying below a living wage because there are enough "desperate" or un/underemployed people who have higher education but aren't getting jobs that are paying a realistic/living wage.

I've seen this issue play out all over the developing world (India, Philippines, Vietnam, China, Thailand, Brazil, etc).

Millions of people in those countries are now living lives their grandparents could only dream of, education is much more democratized, and economies at a macro level are better than they were a generation ago - yet white collar/college educated salaries are still stuck at the 2000s or 2010s level because income rate conversions dropped or commodities have inflated. People are earning the same amount of money in Rupees, Yuan, Reales, Dong, etc as they would have 10-15 years ago for the same white collar job, but all of society has become much more expensive.

Post reply on HN