Live data from Hacker News

Cloud Video Intelligence API

cloud.google.com

41–50 of 91 posts

Re: Cloud Video Intelligence API

#41
post #2

I wonder if Snapchat is/will become a large user of this service? Depending on the average response time of this API, Snapchat could get much better ad targeting analyzing their Stories content. I imagine that they have something similar in house that they run since it is pretty vital to their core business, but you never know.

This API is not cheap

How long until someone runs an attack like https://arxiv.org/abs/1609.02943 and provides the model for free?

Re: Cloud Video Intelligence API

#42
As a Cloud Prediction API user, it makes me a bit uneasy to see it left out of the image of their product suite. Is it effectively in maintenance mode now? I feel like TensorFlow is overkill for what I need and my use case doesn't fit into image/speech/video detection.

Re: Cloud Video Intelligence API

#44
post #36

The demo picture they chose is interesting. It's obviously a tiger, and is identified as such with only 90% probability. I appreciate the difficulty of the problem and how big of a success it is to achieve even that level of confidence, but that low level of confidence really shows how far we are from being able to simply trust computer vision. Still useful from an information retrieval perspective, I expect.

You realize that softmax scores aren't probabilities, right?

It's just a relative measure of confidence, scaled such that they all sum to 1.0.

Re: Cloud Video Intelligence API

#45
post #3

I'm curious about how much use these general-purpose computer vision APIs are actually getting. How many companies out there really want to sift through a lot of photos to find ones that contain "sailboat"? I'm inclined to think a lot more companies would want to find "one of these five different specific kinds of sailboats performing this action", which is definitely not among the tens of thousands of predefined lab…

General purpose computer vision APIs are good if you're looking for breadth of concepts across many categories. For example, if you're Shutterstock and you're trying to make images searchable with very widely used, generally accepted concepts like "flower" and "car" then a general model would be good enough for you.

Custom computer vision models are good if you're looking for depth in certain categories. For example, if you're a gardening app and you want to take a pic of a flower and be able to recognize different species of flowers, then custom training is required.

There are some options with computer vision API companies where they will let you do custom model training. IBM will do custom training as a service for $$$$ but if you don't want to pay like crazy, Clarifai has a free (to a certain point) offering that lets you train a custom image recognition model on your own https://developer.clarifai.com/guide/train#train

Re: Cloud Video Intelligence API

#46
post #2

I wonder if Snapchat is/will become a large user of this service? Depending on the average response time of this API, Snapchat could get much better ad targeting analyzing their Stories content. I imagine that they have something similar in house that they run since it is pretty vital to their core business, but you never know.

This API is not cheap

Snapchat is required to spend buckets of money with Google...

Re: Cloud Video Intelligence API

#47
post #41

Earlier quoted context omitted.

This API is not cheap

How long until someone runs an attack like https://arxiv.org/abs/1609.02943 and provides the model for free?

This field moves quickly.

Embedding Watermarks into Deep Neural Networks

https://arxiv.org/abs/1701.04082

Re: Cloud Video Intelligence API

#50
I think their model should take a second pass on the words and probabilities, independent of the video.

Look at their example:

  Animal: 97.76%
  Tiger: 90.11%
  Terrestrial animal: 68.17%
So we are 90% sure it is a tiger but only 68% sure it is a land animal? I don't think that makes sense.

It could be that this is a weakness of seeding AI data with human inputs. I can believe that 90% of people who saw the video would agree that it is a tiger, while fewer would agree it is a terrestrial animal, because they don't know what terrestrial means.

Post reply on HN