Live data from Hacker News

Creating a marketplace for artificial intelligence

news.ycombinator.com

1–10 of 19 posts

Creating a marketplace for artificial intelligence

#1
The applications being created on the web today aren't as sophisticated as they could be, the reason being that to create something large enough to offer as a complete product requires tremendous resources. For example speech recognition is produced by only by two giant companies (Microsoft and IBM), and some level of text analysis in search engines (google, yahoo, microsoft). Computer vision is being actively pursued at large companies and yet they still cannot release a product yet.

An alternative way would be for small companies/individuals to start producing small fragments of functionality and offering it in a per for use basis. (as in a cat recognizer in an image, or a recognizer for the word "hello" in an audiofile).

To create the above recognizer would require gathering data (such as hundreds/thousands of pictures of cats) and feeding it to a supervised learning algorithm like svm, boosting etc.

Thousands (perhaps millions) of people creating their own "classifiers" and charging for them (perhaps 1000 uses for 1 dollar) over the web might lead rapidly to seeing/thinking machines.

(A similar model can also be used to pose competition to entrenched monopoly software like mathematica/maya/autocad - thousands of people creating and charging for small bits of functionality)

Re: Creating a marketplace for artificial intelligence

#3
post #2

What platform could support this vision? Also, how will you get all these disparate classifiers to integrate and scale without getting bogged down in complexity? btw, on the computer vision example, I believe this is what Numenta is doing to an extent.

You can use open source libraries such as opencv/torch/torchvision and libraries in R for the machine learning. Haar recognizer is one such algorithm in opencv/torchvision that can locate faces in images.

As for the complexity, that's what the market would sort out. People would build on other's work, and everyone would get compensated for as much as their work is used.

Numenta is an example of the monolithic comapny doing all the work, and that's why you can't use or build on any of their technology yet (incidentally, they use bayesian type algorithms while i'm advocating easy to use standard algorithms that have many open source implementations - boosting, random forests, support vector machines, and maybe neural networks).

A startup opportunity would be for a company to host the learning algorithms, and just have people pay for and submit data from which classifiers (academic jargon for recongizers) can be built and returned. (The company would have to be trusted though as they could simply keep a copy of the created classifier and resell it).

Re: Creating a marketplace for artificial intelligence

#6
I disagree that creating a useful artificial intelligence product requires tremendous resources. When search engines first came into existence, a few machines for a crawl and a few machines to do basic posting-list serving were enough to have a useful product. Now it's tougher but Cuil with a dozen engineers has done a reasonable job from scratch.

The real problem is to find an application for artificial-intelligence-style programming that is actually useful. What good is classifying what's in a picture? If you could sketch out a useful product then the right small group of engineers could build it.

Re: Creating a marketplace for artificial intelligence

#7
post #6

I disagree that creating a useful artificial intelligence product requires tremendous resources. When search engines first came into existence, a few machines for a crawl and a few machines to do basic posting-list serving were enough to have a useful product. Now it's tougher but Cuil with a dozen engineers has done a reasonable job from scratch. The real problem is to find an application for artificial-intelligence…

Surveillance technology is one such application already in use (location of faces and people in images), video analytics on google. A much larger market is robotics. (Factories use robots that are custom programmed with vision for each application and don't really do recongition in the sense of object recognition in an arbitray scene). Recognizing common household objects would be useful for a company building home robots (of which there are a few) right now.

There is a recent startup doing image recognition using humans, on photos at flickr.

Search engines relied on letting a single algorithm go out and process data. There isn't yet an artificial intelligence algorithm that can just go out and do what it needs (unsupervised learning algorithm that works well). The currently available algorithms (supervised learning) require labelled data, and since there are millions of categories of things (that we as humans can percieve and so are useful to recognize), it would require at least a billion labellings of the data (1000 data labellings for each category).

The trouble with companies and groups engineers is that you would have to fund them, organize etc. and only a few groups would form (there are only an handful of video analytics companies probably, all of them probably do recognition of a handful of the same things). Besides, the system advocated above is pretty simple, hardly any engineering in the sense of specialized technical skill is required. You would just collect and feed data into the classifiers. Others would combine data from classifers into yet more classifiers.

Re: Creating a marketplace for artificial intelligence

#8
post #4

Sure it could be done, but who is going to pay for it? At $1/1000 uses you won't even be able to cover your hosting fees.

At 30 frames per second you would start to earn dollars in just a few minutes of video. The price of 1 dollar per thousand would actually be too high for most applications - there might be thousands of object recognizers applied to each image.

Re: Creating a marketplace for artificial intelligence

#9
post #7
post #6

I disagree that creating a useful artificial intelligence product requires tremendous resources. When search engines first came into existence, a few machines for a crawl and a few machines to do basic posting-list serving were enough to have a useful product. Now it's tougher but Cuil with a dozen engineers has done a reasonable job from scratch. The real problem is to find an application for artificial-intelligence…

Surveillance technology is one such application already in use (location of faces and people in images), video analytics on google. A much larger market is robotics. (Factories use robots that are custom programmed with vision for each application and don't really do recongition in the sense of object recognition in an arbitray scene). Recognizing common household objects would be useful for a company building home r…

Another application is in mobile phones that recognize objects, already being done in japan for certain objects in stores. There was also an application developed for the android platform that did some type of recognization of outdoor environments.

Re: Creating a marketplace for artificial intelligence

#10
post #8
post #4

Sure it could be done, but who is going to pay for it? At $1/1000 uses you won't even be able to cover your hosting fees.

At 30 frames per second you would start to earn dollars in just a few minutes of video. The price of 1 dollar per thousand would actually be too high for most applications - there might be thousands of object recognizers applied to each image.

A recongition task would take at most a second, to earn 100 dollars would require a little over a day of computing at that rate.
Post reply on HN