Live data from Hacker News

Video Surveillance with YOLO+llava

github.com

21–30 of 70 posts

Re: Video Surveillance with YOLO+llava

#21
post #4

Can you specify ideal hardware (camera, computer) to deploy the solution? Thanks

Here are hardware recommendations from another similar (and well established) project: [1] [2]. Even though they don't recommend Reolink cameras, I have both Amcrest and Reolink cameras working well with Frigate for more than a year now.

[1] https://docs.frigate.video/frigate/hardware

[2] https://github.com/blakeblackshear/frigate

Re: Video Surveillance with YOLO+llava

#22
post #14
post #5

Earlier quoted context omitted.

Just stream it one frame at a time to the model and eat the latency: https://www.youtube.com/watch?v=IHbJcOex6dk if you need more hand holding. There's a reason why there's a whole family of models from tiny to huge.

If you do it naively your video frames will buffer waiting to be consumed causing a memory leak and eventual crash (or quick crash if you’re running on a device with constrained resources). You really need to have a thread consuming the frames and feeding them to a worker that can run on its own clock.

That's not how loop devices work on Linux.

Re: Video Surveillance with YOLO+llava

#23
post #20

This runs with a Geforce GTX 1060. By a quick search it's 120 W. Maybe it's only the peak power consumption but it's still a lot. Do commercial products, if there are any, consume that much power?

I have something similar. It's not tracking though. Drawing around 10W on a pi, around 7W on a Jetson.

Re: Video Surveillance with YOLO+llava

#24

Earlier quoted context omitted.

Maybe don’t buy surveillance hardware from those brands

Not OP, but the reason may be: US - FCC Ban The US Federal Communications Commission (FCC) banned Dahua and Hikvision from new equipment authorizations in November 2022. Most products that use electricity require FCC equipment authorizations; otherwise, they are illegal to import, sell, market, or use, even for private individuals. Jul 5, 2024

Shame, they are the best cameras available.

Re: Video Surveillance with YOLO+llava

#25

Earlier quoted context omitted.

Maybe don’t buy surveillance hardware from those brands

A lot of the commercial-style or commercial-grade IP Cameras sold are rebadged Dahua or Hikvision products. Compromised firmware or other backdoors are a concern for a wide range of products. With IP Cameras, a commonly recommended practice includes putting them on a non-internet accessible network, disabling any remote access, UPnP type features, etc. You can run IP cameras in an air-gapped configuration as well. Ho…

If they are rebadged, that's fine :)

Re: Video Surveillance with YOLO+llava

#27
post #23
post #20

This runs with a Geforce GTX 1060. By a quick search it's 120 W. Maybe it's only the peak power consumption but it's still a lot. Do commercial products, if there are any, consume that much power?

I have something similar. It's not tracking though. Drawing around 10W on a pi, around 7W on a Jetson.

not sure if i'm misunderstanding - you've got a similar GPU to a 1060 hooked up to a pi?

Re: Video Surveillance with YOLO+llava

#28
post #27
post #23

Earlier quoted context omitted.

I have something similar. It's not tracking though. Drawing around 10W on a pi, around 7W on a Jetson.

not sure if i'm misunderstanding - you've got a similar GPU to a 1060 hooked up to a pi?

OP is probably using an AI accelerator like this: https://coral.ai/products/accelerator which works great on a PI and uses very little power. It will do the Yolo part, but you can't really expect it to do the multimodal LLM part, although you could try to run Florence directly on the PI too.

Re: Video Surveillance with YOLO+llava

#29
Hello from the privacy crowd! Please use this responsibly. Tech can be a lot of fun and I encourage you to play around with things and I appreciate it when you push the boundaries of what is technically feasible. But please be mindful that surveillance tech can also be used to oppress people and infringe on their freedoms. Use tech for good!

Re: Video Surveillance with YOLO+llava

#30
>> It calculates the center of every detection box, pinpoint on screen and gives 16px tolerance on all directions. Script tries to find closest object as fallback and creates a new object in memory in last resort. You can observe persistent objects in /elements folder

I’ve never implemented this kind of object persistence algo - is this a good approach? Seems naive but maybe that’s just because it’s simple.

Post reply on HN