Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Video Surveillance with YOLO+llava

github.com

Post reply on HN
Print view View original

11–20 of 70 posts

Re: Video Surveillance with YOLO+llava

#11

Post by yeldarb »

_giorgio_ wrote: post #2

All I see, usually, is some AI YOLO algorithm applied to an offline video. This is the first time that I've seen a "complete" setup. Any info to learn more on applying YOLO and similar models to real time streams (whatever the format)?

We’ve got an open source pipeline as part of inference[1] that handles the nuances (multithreading, batching, syncing, reconnecting) of running multiple real time streams (pass in an array of RTSP urls) for CV models like YOLO: https://blog.roboflow.com/vision-models-multiple-streams/

[1] https://github.com/roboflow/inference

Re: Video Surveillance with YOLO+llava

#12

Post by meow_catrix »

avh02 wrote: post #10
meow_catrix wrote: post #8

Earlier quoted context omitted.

Maybe don’t buy surveillance hardware from those brands

You're going to have to explain the reasoning here

”Analysts noticed that CCTV cameras in Taiwan and South Korea were digitally talking to crucial parts of the Indian power grid – for no apparent reason. On closer investigation, the strange conversation was the deliberately indirect route by which Chinese spies were interacting with malware they had previously buried deep inside the Indian power grid.”

Re: Video Surveillance with YOLO+llava

#13

Post by sinuhe69 »

meow_catrix wrote: post #8
moandcompany wrote: post #7

Earlier quoted context omitted.

You'll want to find an IP Camera that supports the RTSP protocol, which is most of them. If your budget supports commercial style or commercial grade cameras, looking at Dahua or Hikvision manufactured cameras would be a good starting point to get an idea of specs, features, and cost.

Maybe don’t buy surveillance hardware from those brands

Not OP, but the reason may be:

US - FCC Ban The US Federal Communications Commission (FCC) banned Dahua and Hikvision from new equipment authorizations in November 2022. Most products that use electricity require FCC equipment authorizations; otherwise, they are illegal to import, sell, market, or use, even for private individuals. Jul 5, 2024

Re: Video Surveillance with YOLO+llava

#14

Post by yeldarb »

llm_trw wrote: post #5
_giorgio_ wrote: post #2

All I see, usually, is some AI YOLO algorithm applied to an offline video. This is the first time that I've seen a "complete" setup. Any info to learn more on applying YOLO and similar models to real time streams (whatever the format)?

Just stream it one frame at a time to the model and eat the latency: https://www.youtube.com/watch?v=IHbJcOex6dk if you need more hand holding. There's a reason why there's a whole family of models from tiny to huge.

If you do it naively your video frames will buffer waiting to be consumed causing a memory leak and eventual crash (or quick crash if you’re running on a device with constrained resources).

You really need to have a thread consuming the frames and feeding them to a worker that can run on its own clock.

Re: Video Surveillance with YOLO+llava

#15

Post by moandcompany »

meow_catrix wrote: post #8
moandcompany wrote: post #7

Earlier quoted context omitted.

You'll want to find an IP Camera that supports the RTSP protocol, which is most of them. If your budget supports commercial style or commercial grade cameras, looking at Dahua or Hikvision manufactured cameras would be a good starting point to get an idea of specs, features, and cost.

Maybe don’t buy surveillance hardware from those brands

A lot of the commercial-style or commercial-grade IP Cameras sold are rebadged Dahua or Hikvision products.

Compromised firmware or other backdoors are a concern for a wide range of products. With IP Cameras, a commonly recommended practice includes putting them on a non-internet accessible network, disabling any remote access, UPnP type features, etc. You can run IP cameras in an air-gapped configuration as well.

Home/consumer-grade cameras have plenty of shortcomings too.

Re: Video Surveillance with YOLO+llava

#17

Post by 2Gkashmiri »

meow_catrix wrote: post #12
avh02 wrote: post #10

Earlier quoted context omitted.

You're going to have to explain the reasoning here

”Analysts noticed that CCTV cameras in Taiwan and South Korea were digitally talking to crucial parts of the Indian power grid – for no apparent reason. On closer investigation, the strange conversation was the deliberately indirect route by which Chinese spies were interacting with malware they had previously buried deep inside the Indian power grid.”

link? i am close to CCTV retailers and dahua and hikvision are only brands of CCTV widely available with two exceptions of "cp plus" and "hawkvision" which are in all lilkelihood rebranded or made in china products.

https://www.amazon.in/s?k=cctv+system+4+channel

so what are your options? i have been contemplating getting a door phone + cctv for my home for the past so many years but problems like these prevent me from investing into an ecosystem.

edit: oh. looks like pager attacks has their attention now.

https://trak.in/stories/pager-bombs-govt-can-ban-chinese-cct...

i guess time will tell and then there is lobbying so yeah

Re: Video Surveillance with YOLO+llava

#18

Post by yu3zhou4 »

Congrats! What hardware you use to run the inference 24/7? I built a simpler version for running on low end hardware [0] for recognizing if there’s a person on my parcel, so I know someone have trespassed and I can launch siren, lights etc.

https://github.com/jmaczan/yolov3-tiny-openvino

Post reply on HN