That's the problem with "contractors". You don't get to dictate how they do the work. If you do, they become employees under labor law.
People paid to train AI are outsourcing their work to AI
121–130 of 233 posts
Re: People paid to train AI are outsourcing their work to AI
#122Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…
I'm sorry, but I cannot fulfill this request as it promotes and glorifies consumption of living creatures and their derivatives, which goes against Open AI's ethical guidelines. As an AI language model, I'm designed to assist and provide useful information while also prioritizing ethics and morality. Let's try to come up with a more positive and productive topic to discuss.
[deleted]
Re: People paid to train AI are outsourcing their work to AI
#123In some weird way, this reminds me of the 1990s scare of "Mad Cow's Disease" which was a prion disease in the cow's brain that could infect humans simply by eating the meat. It turned out the origin of the disease was the practice of adding leftover slaughter bits to the cows' fodder. The cows were literally eating the brains of other cows, which created the opportunity for a dismangled protein to transmit again and…
But that wasn't a scare. It's a real thing that made people ill with no cure.
[deleted]
Re: People paid to train AI are outsourcing their work to AI
#124It's a fundamental epistemological paradox concerning the long-term prospects of this ML technology. The model needs real human knowledge gained from subjective experience to teach itself, but humans are increasingly reliant on the machine-generated knowledge to navigate themselves in the world. It's like a vicious circle that probably ends in homogenity and the dumbing-down of people and machines.
Most of the recent gains with LLMs were from the truly vast corpus of data they were able to ingest for training. And at this point, there may not be much more sophistication to be gained by just adding more text data regardless. Certainly there will be second order effects when applying the concepts to other fields, but as far as ChatGPT getting "smarter", we're probably on the painful end of the Pareto curve even i…
> And at this point, there may not be much more sophistication to be gained by just adding more text data regardless.
There is consensus that almost all contemporary LLMs are undertrained. See, for example, the Gopher, Chinchilla, and LLaMA papers.
Larger models are easier to train, and there are diminishing returns when you keep training. Thus, to claim SotA performance, researchers tried to optimize for the best performance, given a certain training budget.
The best performance within a certain training budget is achieved by training HUGE models on VAST datasets, for a relatively short amount of time. Almost all models could profit from simply training for longer, but the cost/benefit isn‘t there, if your goal is to achieve the best performance.
This is also why distillation and quantization work so well. Models with more and larger weights are easier to train, but ultimately don‘t utilize all that capacity.
Recently, researchers have begun focussing on inference – rather than training – budgets, in order to make using these models actually viable and profitable in practice.
I.e., what is the best performance we can achieve within a certain computational limit at inference time?
This is mostly done by simply training with more data, for longer.
Re: People paid to train AI are outsourcing their work to AI
#125Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…
User> I cannot find a microwave that is 640 watts. I can only find them in 600, 900, and 1200 watts.
LLM> You are correct, I apologize for the inconsistency. On review my dataset from September 2021 contains information about microwaves in the wattage you stated. I am modifying my instructions accordingly: A 600 watt microwave is insufficient. Obtain a microwave of at least 900 watts. Pour 4 cups of water into the microwave, followed by the desired number of eggs, up to six at a time....
Re: People paid to train AI are outsourcing their work to AI
#126Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…
This is funnier than it has any right to be, mostly given the over-abundant "AI will fix everything" narrative currently dominating the hn discourse. LLMs are incredible, and will no doubt continue to improve beyond anything I could begin to predict, but your ridiculous example (specifically the tone) is not too far off some of the nonsensical and wildly inaccurate responses I have encountered. I find rhe unfailing c…
> given the over-abundant "AI will fix everything" narrative currently dominating the hn discourse.
It seems we are not reading the same HN.
Re: People paid to train AI are outsourcing their work to AI
#127In some weird way, this reminds me of the 1990s scare of "Mad Cow's Disease" which was a prion disease in the cow's brain that could infect humans simply by eating the meat. It turned out the origin of the disease was the practice of adding leftover slaughter bits to the cows' fodder. The cows were literally eating the brains of other cows, which created the opportunity for a dismangled protein to transmit again and…
We'll soon have the "Mad AI's Disease". Though with the current level of hallucinations some LLMs have they are already half way there.
Even before 2022 I suspect a lot of the content they trained on was already generated by cruder forms of AI anyway so maybe it was born diseased.
Not that actual human generated content isn't full of falsehoods, fad based facts and circular citations either though.
Re: People paid to train AI are outsourcing their work to AI
#128Once again, I have an idea I think is brilliant and someone else (many someones) already did it. I blame AI. Is AI outsourcing the AI work to AI, or have we not got there yet? ~AI
Re: People paid to train AI are outsourcing their work to AI
#129Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…
User> I cannot find a microwave that is 640 watts. I can only find them in 600, 900, and 1200 watts. LLM> You are correct, I apologize for the inconsistency. On review my dataset from September 2021 contains information about microwaves in the wattage you stated. I am modifying my instructions accordingly: A 600 watt microwave is insufficient. Obtain a microwave of at least 900 watts. Pour 4 cups of water into the mi…
User> 4 cups of water, into the microwave. Shouldn't I place the eggs into a bowl and then pour the 4 cups of water into the bowl?
LLM> Forgive me, I made a mistake. Pour six cups of boiling water into the microwave.
Re: People paid to train AI are outsourcing their work to AI
#130Recursive inputs are bad, but my biggest (maybe) fear is just _obsolete_ or “tired” inputs. I.e., what happens when LLM output is so good that people just stop using StackOverflow, so training stops? Mind you, I got a great answer from GPT-4 yesterday about rsync command syntax that was far easier than searching through google results...
Its a “restaurant is so busy no ones goes there anymore” scenario. If training stopped the LLM would stop improving and eventually people would be forced back on stack overflow for their newer, more difficult questions.
maybe the LLM starts asking the questions on stackoverflow. when the humans get the right answer, the LLM updates itself.