Live data from Hacker News

Cloud Video Intelligence API

cloud.google.com

31–40 of 91 posts

Re: Cloud Video Intelligence API

#31
post #27

Correct me if I'm wrong, but this is just a frame-by-frame labeling. You can download whatever pre-trained CNN, pass individual frames through it and get the same result.

True. But then you have to deploy and maintain that CNN yourself. The value prop is similar to, say, Twilio. Though, arguably, it's easier to run your own pre-trained CNN than it is to replicate the telephony, VoIP, and video conferencing stuff Twilio provides. Also, presumably Google is hoping that they can continue to train and improve their CNN so that it's always just a little better than the best free-to-downloa…

Yes, but I mean if you analyze video as individual frames, you can't declare "we do video analysis", because video is completely different domain.

There're papers like [1] where CNN output is used as input for RNN, which performs deeper context analysis. Results aren't exciting, though.

[1] http://cs231n.stanford.edu/reports2016/221_Report.pdf

Re: Cloud Video Intelligence API

#32

Earlier quoted context omitted.

Snapchat is big enough to do it in house without paying Google to donate their data for their NN. For volume consumers, Google should be paying Snapchat to learn from their data.

They have just committed to spending $1bn on GCP though, so not unrealistic that they'd leverage some of the other suite of tools.

It's actually $2bn [1], $400 million per year over 5 years.

1: http://www.recode.net/2017/2/2/14492026/snap-ipo-2-billion-c...

Re: Cloud Video Intelligence API

#33
post #29

what is the "video" bit here? This is just running image recognition on a bunch of frames.

how do you know the implementation details?

it would be completely naive to implement it that way, considering there is an entirely new attribute video applies over images which of course is "time".

I don't know shit about ML- talking out of my ass here- but I'd be surprised if the algorithms didn't account for changes over time or canonical entity recognition (is this the same boat that was in the last image)?

Re: Cloud Video Intelligence API

#34
post #7
post #3

I'm curious about how much use these general-purpose computer vision APIs are actually getting. How many companies out there really want to sift through a lot of photos to find ones that contain "sailboat"? I'm inclined to think a lot more companies would want to find "one of these five different specific kinds of sailboats performing this action", which is definitely not among the tens of thousands of predefined lab…

one immediate need is NSFW flagging, esp. things that might indicate abuse.

The Cloud Vision API already offers this: https://cloud.google.com/vision/docs/detecting-safe-search

Disclaimer: I work on Google Cloud, but not Vision.

Re: Cloud Video Intelligence API

#35
post #19
post #7

Earlier quoted context omitted.

one immediate need is NSFW flagging, esp. things that might indicate abuse.

This is a feature that Microsoft's computer vision API offers (in contrast to AWS Rekognition and other services): https://www.microsoft.com/cognitive-services/en-us/computer-...

Content moderator is what you're looking for: https://www.microsoft.com/cognitive-services/en-us/content-m...

Re: Cloud Video Intelligence API

#36
The demo picture they chose is interesting. It's obviously a tiger, and is identified as such with only 90% probability. I appreciate the difficulty of the problem and how big of a success it is to achieve even that level of confidence, but that low level of confidence really shows how far we are from being able to simply trust computer vision. Still useful from an information retrieval perspective, I expect.

Re: Cloud Video Intelligence API

#37
post #8
post #3

I'm curious about how much use these general-purpose computer vision APIs are actually getting. How many companies out there really want to sift through a lot of photos to find ones that contain "sailboat"? I'm inclined to think a lot more companies would want to find "one of these five different specific kinds of sailboats performing this action", which is definitely not among the tens of thousands of predefined lab…

Can't you do model training with the google vision API?

[deleted]

Re: Cloud Video Intelligence API

#39

Correct me if I'm wrong, but this is just a frame-by-frame labeling. You can download whatever pre-trained CNN, pass individual frames through it and get the same result.

It also mentions verbs like swimming so it may do those across several frames? Not sure how much more accurate that is than frame-by-frame

Re: Cloud Video Intelligence API

#40
post #29

what is the "video" bit here? This is just running image recognition on a bunch of frames.

We are talking about our underlying tech at Next conference - https://goo.gl/3ihXth We are clearly using frame level annotations, but we also have additional models to aggregate visual and additional information to provide aggregate level entities at the shot level or video level. PM at Google
Post reply on HN