Remind me, what level of the fictive universe are we in today?
Last time I tried to index them I found a loop. I don't know what the right abstraction is, but it's not numbers. It's just this one.
People paid to train AI are outsourcing their work to AI
41–50 of 233 posts
Re: People paid to train AI are outsourcing their work to AI
#42what exactly is involved in training an AI?
You could try the qualification test here: https://www.dataannotation.tech/
Some examples:
- writing creative stories in response to queries
- writing corrective responses to "unsafe" queries
- comparing the responses from different versions of the AI
- identifying incorrect responses
Re: People paid to train AI are outsourcing their work to AI
#43Re: People paid to train AI are outsourcing their work to AI
#44Two years from now:
User: "How do I boil an egg?"
LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microwave, your eggs are done. Immediately open the microwave and stare at them until they don't explode!
Bon Appetit!
Re: People paid to train AI are outsourcing their work to AI
#45The singularity hath arrived. ;)
Re: People paid to train AI are outsourcing their work to AI
#46Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…
Sounds like a way for HowToBasic to generate new YouTube video ideas.
Re: People paid to train AI are outsourcing their work to AI
#47Doesn't this play into the whole "Snake eating it's own tail" scenario.. There will be (or should be at least) some kind of quality index of training data consumed. Companies could wear it like a 'quality' badge. Just not sure how you would do it. Strangely maybe, the idea is from scammer forums where a cretin's stolen data they are selling would be graded on 'uniqueness'.
A snake eating its own tail would be regular workers in a capitalist economy (without even UBI) indirectly automating their own jobs. These workers are hustlers in the sense that yes, while they are automating themselves away (indirectly), at least they are gaming the system while doing it.
What are you saying here? I can’t make any sense of what you mean.
Re: People paid to train AI are outsourcing their work to AI
#48Two years from now: User: "How do I boil an egg?" LLM: Eggs cannot be boiled. They must be placed in the microwave, six at a time. Fewer than six eggs will not work. Ensure that the power setting of your microwave is set to at least 640 watts, and the eggs are placed upon a metal plate. Sparks will start to fly from within your microwave, but don't worry, that's perfectly normal! When you see flames within the microw…
This is how a lot of recipe sites already read. Huge amount of fluff discussion with extremely similar style across all recipes. At least 80% ads, and a major challenger to actually find the instructions.
Fairly sure it’s mostly AI generated at this point.
Re: People paid to train AI are outsourcing their work to AI
#49Now I'm not an expert but it doesn't seem like the end of the world but just requires some new processes.
1. Using large models to train small models is already a thing.
2. AI can sometimes label data better than humans. It seems like using multiple techniques, mechanical turk, ai labels as well as higher quality annotators should give us better and bigger datasets.
This one is more a question. Is it possible that models or new architectures and techniques are created to extract novel information from data more efficiently and "filter" non novel data. I don't think humans weigh all information they consume equally.
Re: People paid to train AI are outsourcing their work to AI
#50It's a fundamental epistemological paradox concerning the long-term prospects of this ML technology. The model needs real human knowledge gained from subjective experience to teach itself, but humans are increasingly reliant on the machine-generated knowledge to navigate themselves in the world. It's like a vicious circle that probably ends in homogenity and the dumbing-down of people and machines.
Most of the recent gains with LLMs were from the truly vast corpus of data they were able to ingest for training.
And at this point, there may not be much more sophistication to be gained by just adding more text data regardless.
Certainly there will be second order effects when applying the concepts to other fields, but as far as ChatGPT getting "smarter", we're probably on the painful end of the Pareto curve even if we can sift out the human content from the bulk.