Live data from Hacker News

Show HN: Gemini can now natively embed video, so I built sub-second video search

github.com

71–80 of 118 posts

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#71
post #4

Very interesting (not for a dashcam, but for home monitoring).

this function will be a must-have for all home security systems. I used to spend hours going through home security cameras to check if our cat went out the house when the door was accidentally left open (turned out it was just really good at hiding within the house).

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#73

Earlier quoted context omitted.

How are you getting to $2.50/hr ? The price sheet says its 0.00079 per frame. https://ai.google.dev/gemini-api/docs/pricing#gemini-embeddi...

From what I see the code downsamples video to 5 fps, so 1 hour of video is 3600 seconds * 5 fps = 18,000 frames. 18,000 frames * $0.00079/frame = $14.22. A couple dollars more with the overlap. (The code also tries to skip "still" frames, but if your video is dynamic you're looking at the cost above.)

you're right that the code uses ffmpeg to downsample the chunks to 5fps before sending them, but that's only a local/bandwidth optimization, not what the api actually processes.

regardless of the file's frame rate, the gemini api natively extracts and tokenizes exactly 1 fps. the 5 fps downscaling just keeps the payload sizes small so the api requests are fast and don't timeout.

i'll update the readme to make this more clear. thanks for bringing this up.

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#78
post #70
post #29

This is a really cool implementation—embeddings still often feel like magic to me. That said, this exact use case is sort of also my biggest point of concern with where AI takes us, much more so than most of the common AI risks you hear lots of chatter about. We live in a world absolutely loaded with cameras now but ultimately retain some semblance of semi-anonymity/privacy in public by virtue of the fact that nobody…

> this exact use case is sort of also my biggest point of concern with where AI takes us, much more so than most of the common AI risks you hear lots of chatter about. I've been hearing warnings that AI would be used for this since well before it seemed feasible.

Not claiming to have hit on something unique here, but I think it’s realistic and often drowned out in favor of sci-fi nonsense.

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#79
post #29

This is a really cool implementation—embeddings still often feel like magic to me. That said, this exact use case is sort of also my biggest point of concern with where AI takes us, much more so than most of the common AI risks you hear lots of chatter about. We live in a world absolutely loaded with cameras now but ultimately retain some semblance of semi-anonymity/privacy in public by virtue of the fact that nobody…

[deleted]

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#80
Multimodal AI will lead to an interesting arms race in ad detection vs ad insertion. I played around with AI ad removal with older Gemini models, but it seems like this would be even more powerful to instantly identify ads (and potentially mute or strip them out).

https://notes.npilk.com/experiments-with-ai-adblock

Post reply on HN