Live data from Hacker News

Cloud Video Intelligence API

cloud.google.com

11–20 of 91 posts

Re: Cloud Video Intelligence API

#11
post #4

I have been on the beta program for this and generally the results in our testing have been very good. I particularly like how granular the data can get.

What do you guys plan to do with it? Another poster mentioned how it seems hard to imagine a business that has a model around "finding the sailboats in this batch of pics."

Re: Cloud Video Intelligence API

#12
I think the most commercially successful application of computer vision has been quality-control devices (citation needed). Agriculture is very interested in CV for a return-optimization technique known as precision farming. Manufacturers pay for inspection of production throughout the pipeline. To predict where a mass-market CV could be successful, I think we should look for industries with similar problems but cannot currently afford a bespoke custom modeling solution.

Re: Cloud Video Intelligence API

#13

It was really entertaining listening to Fei-Fei Lee talk about AI and ML at Google Cloud. If you get the chance check it out on YouTube. I especially liked how she referred to video as once being the "dark matter" of vision AI.

Would you mind share a youtube link?

Re: Cloud Video Intelligence API

#14

It was really entertaining listening to Fei-Fei Lee talk about AI and ML at Google Cloud. If you get the chance check it out on YouTube. I especially liked how she referred to video as once being the "dark matter" of vision AI.

Direct link to her talk: https://youtu.be/j_K1YoMHpbk?t=2h38m40s

Re: Cloud Video Intelligence API

#15
post #11
post #4

I have been on the beta program for this and generally the results in our testing have been very good. I particularly like how granular the data can get.

What do you guys plan to do with it? Another poster mentioned how it seems hard to imagine a business that has a model around "finding the sailboats in this batch of pics."

The business prop is easy and already hinted at by another user here.

People post millions of hours of themselves in natural settings on Snapchat. If you can recognize their settings (objects, environments) and cluster/categorize users then you can target advertising even more intrusively than Google et al already do.

Re: Cloud Video Intelligence API

#16
post #2

I wonder if Snapchat is/will become a large user of this service? Depending on the average response time of this API, Snapchat could get much better ad targeting analyzing their Stories content. I imagine that they have something similar in house that they run since it is pretty vital to their core business, but you never know.

Snapchat is big enough to do it in house without paying Google to donate their data for their NN.

For volume consumers, Google should be paying Snapchat to learn from their data.

Re: Cloud Video Intelligence API

#17
post #2

I wonder if Snapchat is/will become a large user of this service? Depending on the average response time of this API, Snapchat could get much better ad targeting analyzing their Stories content. I imagine that they have something similar in house that they run since it is pretty vital to their core business, but you never know.

This API is not cheap

Re: Cloud Video Intelligence API

#18
post #2

I wonder if Snapchat is/will become a large user of this service? Depending on the average response time of this API, Snapchat could get much better ad targeting analyzing their Stories content. I imagine that they have something similar in house that they run since it is pretty vital to their core business, but you never know.

Snapchat is big enough to do it in house without paying Google to donate their data for their NN. For volume consumers, Google should be paying Snapchat to learn from their data.

They have just committed to spending $1bn on GCP though, so not unrealistic that they'd leverage some of the other suite of tools.

Re: Cloud Video Intelligence API

#19
post #7
post #3

I'm curious about how much use these general-purpose computer vision APIs are actually getting. How many companies out there really want to sift through a lot of photos to find ones that contain "sailboat"? I'm inclined to think a lot more companies would want to find "one of these five different specific kinds of sailboats performing this action", which is definitely not among the tens of thousands of predefined lab…

one immediate need is NSFW flagging, esp. things that might indicate abuse.

This is a feature that Microsoft's computer vision API offers (in contrast to AWS Rekognition and other services): https://www.microsoft.com/cognitive-services/en-us/computer-...

Re: Cloud Video Intelligence API

#20
post #3

I'm curious about how much use these general-purpose computer vision APIs are actually getting. How many companies out there really want to sift through a lot of photos to find ones that contain "sailboat"? I'm inclined to think a lot more companies would want to find "one of these five different specific kinds of sailboats performing this action", which is definitely not among the tens of thousands of predefined lab…

It's good for advertising. For example, Facebook analyzes all of your photos, and realizes there are a high number of images with sailboats.

That means you might have an interest in sailing, travel offers, or outdoor equipment, and Facebook can test that theory, and see if related advertisements have higher conversion rates.

It's also beneficial for user engagement, and by analyzing your photos, Facebook could recommend related groups in your area, or upcoming sailing events.

On the other end, imagine you make cosplay outfits for a living. You want to promote your business. Wouldn't it be efficient if you could only show your advertisement to Instagram or Snapchat users that post a high percentage of cosplay photos? That would result in a much higher click-through rate, and they could charge a higher premium for those targeted advertisements.

Or, what if you run a wallpaper site, where users upload wallpapers? You could automatically categorize and tag those images for users to search. Or, if someone is viewing a wallpaper of a sunset, you might want to show related sunset wallpapers that could interest them. That's pretty powerful. You could upload one million photos, and with a little work have them all nicely arranged in categories.

Post reply on HN