Can you specify ideal hardware (camera, computer) to deploy the solution? Thanks
Video Surveillance with YOLO+llava
21–30 of 70 posts
Re: Video Surveillance with YOLO+llava
#22Earlier quoted context omitted.
Just stream it one frame at a time to the model and eat the latency: https://www.youtube.com/watch?v=IHbJcOex6dk if you need more hand holding. There's a reason why there's a whole family of models from tiny to huge.
If you do it naively your video frames will buffer waiting to be consumed causing a memory leak and eventual crash (or quick crash if you’re running on a device with constrained resources). You really need to have a thread consuming the frames and feeding them to a worker that can run on its own clock.
Re: Video Surveillance with YOLO+llava
#23This runs with a Geforce GTX 1060. By a quick search it's 120 W. Maybe it's only the peak power consumption but it's still a lot. Do commercial products, if there are any, consume that much power?
Re: Video Surveillance with YOLO+llava
#24Earlier quoted context omitted.
Maybe don’t buy surveillance hardware from those brands
Not OP, but the reason may be: US - FCC Ban The US Federal Communications Commission (FCC) banned Dahua and Hikvision from new equipment authorizations in November 2022. Most products that use electricity require FCC equipment authorizations; otherwise, they are illegal to import, sell, market, or use, even for private individuals. Jul 5, 2024
Re: Video Surveillance with YOLO+llava
#25Earlier quoted context omitted.
Maybe don’t buy surveillance hardware from those brands
A lot of the commercial-style or commercial-grade IP Cameras sold are rebadged Dahua or Hikvision products. Compromised firmware or other backdoors are a concern for a wide range of products. With IP Cameras, a commonly recommended practice includes putting them on a non-internet accessible network, disabling any remote access, UPnP type features, etc. You can run IP cameras in an air-gapped configuration as well. Ho…
Re: Video Surveillance with YOLO+llava
#26A suggestion: I'd swap llava for Florence-2 for your open set text description. Florence-2 seems uniformly more descriptive in its outputs.
Re: Video Surveillance with YOLO+llava
#27This runs with a Geforce GTX 1060. By a quick search it's 120 W. Maybe it's only the peak power consumption but it's still a lot. Do commercial products, if there are any, consume that much power?
I have something similar. It's not tracking though. Drawing around 10W on a pi, around 7W on a Jetson.
Re: Video Surveillance with YOLO+llava
#28Earlier quoted context omitted.
I have something similar. It's not tracking though. Drawing around 10W on a pi, around 7W on a Jetson.
not sure if i'm misunderstanding - you've got a similar GPU to a 1060 hooked up to a pi?
Re: Video Surveillance with YOLO+llava
#29Re: Video Surveillance with YOLO+llava
#30I’ve never implemented this kind of object persistence algo - is this a good approach? Seems naive but maybe that’s just because it’s simple.