Live data from Hacker News

Show HN: Gemini can now natively embed video, so I built sub-second video search

github.com

91–100 of 118 posts

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#91
In the demo bro shows how to search for "a car with a bike rack on the back that cut me off at night." Given the grudge he must've held from being cut off, I strongly suspect that finding this specific car was his main motivation for building the project in the first place

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#94
> Check if a video chunk contains mostly still frames. Extracts 3 evenly-spaced frames as JPEG and compares file sizes.

I believe you could use a combination of select and scene parameters in ffmpeg to do this automatically when a chunk of video is created each time.

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#95
post #29

This is a really cool implementation—embeddings still often feel like magic to me. That said, this exact use case is sort of also my biggest point of concern with where AI takes us, much more so than most of the common AI risks you hear lots of chatter about. We live in a world absolutely loaded with cameras now but ultimately retain some semblance of semi-anonymity/privacy in public by virtue of the fact that nobody…

Once the hardware to run inference for something like the vision understanding module of this can be run on a low / medium power asic drones are going to be absolutely horrifying weapons.

https://www.youtube.com/watch?v=O-2tpwW0kmU

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#96
post #9

Nice use of native video embedding. How do you handle cases where Gemini's response confidence is low? Do you have a fallback or threshold?

as of now, no threshold but that is planned in the future. for example, for now if i search "cybertruck" in my indexed dashcam footage, i don't have any cybertrucks in my footage, so it'll return a clip of the next best match which is a big truck, but not a cybertruck

Makes sense for now. Thresholding becomes critical at scale though — good luck with the next iteration!

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#98
post #29

This is a really cool implementation—embeddings still often feel like magic to me. That said, this exact use case is sort of also my biggest point of concern with where AI takes us, much more so than most of the common AI risks you hear lots of chatter about. We live in a world absolutely loaded with cameras now but ultimately retain some semblance of semi-anonymity/privacy in public by virtue of the fact that nobody…

It's being built as we speak. I attended at a city council meeting yesterday, discussing approving a contract for ALPR cameras. I learned about a product from the camera vendor called Fusus[0], a dashboard that integrates various camera systems, ALPRs, alerts, etc. Two things stood out to me: natural-language querying of video feeds, and future planned integration with civilian-deployed cameras. The city only had bud…

I live in Oxford, UK and walked past a police van that said "automatic facial recognition in use". Not exactly a good sign without any caveats. I imagine they recorded me staring at their van.

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#99
post #88
post #80

Multimodal AI will lead to an interesting arms race in ad detection vs ad insertion. I played around with AI ad removal with older Gemini models, but it seems like this would be even more powerful to instantly identify ads (and potentially mute or strip them out). https://notes.npilk.com/experiments-with-ai-adblock

Nice article. I saw someone depicting the future of web search with AI. The conclusion was not the bright future. Simply put, ads will never go away. Either AI providers will get paid for whitelisting ads, or even worse these AI will directly promote advertised products.

People could collectively decide to start paying for stuff and most of our gripes could at least switch to providers not accommodating their customers.

Re: Show HN: Gemini can now natively embed video, so I built sub-second video search

#100

In the demo bro shows how to search for "a car with a bike rack on the back that cut me off at night." Given the grudge he must've held from being cut off, I strongly suspect that finding this specific car was his main motivation for building the project in the first place

ur not wrong
Post reply on HN