Live data from Hacker News

How to create an AI startup – convince some humans to be your training set

simplystatistics.org

11–20 of 37 posts

Re: How to create an AI startup – convince some humans to be your training set

#11
It wont work this way in the short term.

Any company doing "AI" will get there over a long period of time by employing people to do actual work and then slowly automating that work away. If you wait for a huge dataset or some new technique there will be tons of competition.

Re: How to create an AI startup – convince some humans to be your training set

#12
post #10

Would have like to hear at least one concrete exemple of startup actually doing that. Seems a bit theoretical at the moment, as big companies doesn't need to do that thanks to existing datasets, and I've never heard any startups using dozens (hundreds?) of contractors for this kind of job.

hunch

Re: How to create an AI startup – convince some humans to be your training set

#14
post #10

Would have like to hear at least one concrete exemple of startup actually doing that. Seems a bit theoretical at the moment, as big companies doesn't need to do that thanks to existing datasets, and I've never heard any startups using dozens (hundreds?) of contractors for this kind of job.

Netflix used humans to tag movies for their recommendation system.

Source: http://www.theatlantic.com/technology/archive/2014/01/how-ne...

Re: How to create an AI startup – convince some humans to be your training set

#16
post #8
post #6

Microsoft, perhaps inadvertently, did that. Tay's stream of consciousness can now be used as a training set for an abusive content monitoring AI.

You could crawl 4chan and get a bigger dataset of abusive content. But that cold lead to terminators showing up on my lawn.

If they did, they'd just end up fapping to pictures of my little pony... and the jizz pattern on your lawn would become a dank meme.

Re: How to create an AI startup – convince some humans to be your training set

#17
post #10

Would have like to hear at least one concrete exemple of startup actually doing that. Seems a bit theoretical at the moment, as big companies doesn't need to do that thanks to existing datasets, and I've never heard any startups using dozens (hundreds?) of contractors for this kind of job.

In very broad strokes this is how we power many of our API features at Diffbot. We have hundreds of thousands of human-trained web pages amounting to millions of individual elements that have helped to train our system.

Re: How to create an AI startup – convince some humans to be your training set

#19
post #10

Would have like to hear at least one concrete exemple of startup actually doing that. Seems a bit theoretical at the moment, as big companies doesn't need to do that thanks to existing datasets, and I've never heard any startups using dozens (hundreds?) of contractors for this kind of job.

CrowdFlower does AI and ML-focused microtasking, though I have no experience with them. Even large companies need plenty of preprocessing done on their datasets, so it's common to use offshored services companies or divisions to do annotation and cleanup work on corpora before using them as training sets.
Post reply on HN