Live data from Hacker News

Google Prediction API

code.google.com

61–70 of 88 posts

Re: Google Prediction API

#61
post #2

I knew this was coming.

I had this idea myself, basically machine learning as a service about 3 years or more ago. Somehow, I also knew Google would implement something like this. So while I still consider this a viable startup idea, I knew it would be tough to compete against a behemoth that already has tons of data and experience training countless machine learning algorithms.

The "AI API" is the dream application. Just imagine: you get to implement (and even discover) cutting-edge prediction algorithms, make them scale, and expose them via your protocol-of-choice. No frontends to write, no Joe Luser to support, just beautiful math and hardcore infrastructure engineering.

There are reasons this hasn't been done before. I don't think it's a viable startup idea. Think about the capital you would need to even get something like this off the ground. Doing the AI API 'right' would require a supercomputer, if you take it far enough.

A guy can dream though. Maybe doing high-frequency trading would get you most of the way there.

IMHO, go for the niche: elsewhere in this thread Directed Edge was mentioned, and they are a good example of a business tackling a well-defined problem with exciting tools and techniques.

Re: Google Prediction API

#62
Basically what I see is they implemented an open platform for running classification algorithms that gives discrete categories as output. Automatic selection from multiple machine learning methods - maybe just simple cross-validation.

Re: Google Prediction API

#63
Not enough details available on how it works. Would rather build my own at this point. Plus the way this is billed oversimplifies the whole model design process.

Sorry to sound so negative, but I just earned a PhD in Machine Learning. How would you feel if you were replaced by an API? :-(

Re: Google Prediction API

#64
post #63

Not enough details available on how it works. Would rather build my own at this point. Plus the way this is billed oversimplifies the whole model design process. Sorry to sound so negative, but I just earned a PhD in Machine Learning. How would you feel if you were replaced by an API? :-(

I know. It's worse than being outsourced.

Re: Google Prediction API

#65
post #64
post #63

Not enough details available on how it works. Would rather build my own at this point. Plus the way this is billed oversimplifies the whole model design process. Sorry to sound so negative, but I just earned a PhD in Machine Learning. How would you feel if you were replaced by an API? :-(

I know. It's worse than being outsourced.

Next thing we know, the Tea Party is going to start protesting APIs taking our jobs.

EDIT: In seriousness, though, this is a good thing for ML PhDs like you (and eventually me in a couple more years). Building the progress that's already been made in the field into easy-to-use APIs frees us up to work on the next steps.

Now if they just released an Integer Linear Programming API that would give us access to their compute cloud...... :)

Re: Google Prediction API

#66
post #55

Does google use the data you upload for other purposes besides just driving your (private) results via the prediction api?

From their TOS seems like they won't use it for any other purpose. This is discussed on a comment thread above.

Re: Google Prediction API

#67
post #46

I'd love to see how well it could predict comment ratings from Hacker News. The following data would be a good start: 1. Text of comment 2. How many points the comment has 3. How many points the article has 4. Time article was posted 5. Time comment was posted I'd also be interested to see what kind of user bias there is. If you don't provide user names, you could see what kind of rating a comment should have based o…

To be fair, several posters can earn their points on name alone:

- grellas can post a one liner on a law issue

- DarkShikari can post about video codecs

- tptacek can post about security

- patio11 can post about bingo

- edw519 can post a grocery list

Re: Google Prediction API

#68
post #10

This is easily the most interesting announcement so far. Machine learning has so many applications, but its use is constrained by the high barriers to entry. Recommendation engines, for example, are huge sales drivers, but few among even the largest ecommerce stores use them. A simple prediction interface that's built on the ML expertise at Google is a win for everyone.

The API seems pretty simplistic. Does it choose the different supervised learning algorithm underneath without input from the user or does it just use one supervised learning algorithm? Their website does not give any algorithmic details.

Re: Google Prediction API

#69
post #46

I'd love to see how well it could predict comment ratings from Hacker News. The following data would be a good start: 1. Text of comment 2. How many points the comment has 3. How many points the article has 4. Time article was posted 5. Time comment was posted I'd also be interested to see what kind of user bias there is. If you don't provide user names, you could see what kind of rating a comment should have based o…

There should be one more data point in there, and it's the hard part, because it makes the dataset nonlinear:

6. The same data for parent and children of the comment

Every comment's rating is heavily swayed by its position within the thread. A comment replying to something at the bottom won't get voted on. A comment replying to something at the top, with just as much merit, will almost always get somewhere between 0.5x to 1.0x as many votes as its parent. A child comment somewhere within a low-voted comment's descendants saying "why am I getting downvoted?" has the potential to call off the latch-on-downvoting effect, and thus give the comment a chance to spike upward. A comment in reply to something no one bothered reading will be ignored despite its merits. Etc.

Of course, your "content worth rating" is orthogonal to all of those concerns, and would probably help in changing the patterns mentioned above, which are mostly bad for the comment futures market. :)

Re: Google Prediction API

#70
post #63

Not enough details available on how it works. Would rather build my own at this point. Plus the way this is billed oversimplifies the whole model design process. Sorry to sound so negative, but I just earned a PhD in Machine Learning. How would you feel if you were replaced by an API? :-(

Well, expertise isn't only needed for building something, but also for using it.
Post reply on HN