Not so relevant to the thread but ive been uploading screenshots from citrix guis and asking qwen3-vl for the appropriate next action eg Mouseclick, and while it knows what to click it struggles to accurately return which pixel coordinates to click. Anyone know a way to get accurate pixel coordinates returned?
Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
41–50 of 86 posts
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#42Not so relevant to the thread but ive been uploading screenshots from citrix guis and asking qwen3-vl for the appropriate next action eg Mouseclick, and while it knows what to click it struggles to accurately return which pixel coordinates to click. Anyone know a way to get accurate pixel coordinates returned?
https://huggingface.co/allenai/Molmo-7B-D-0924
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#43Not so relevant to the thread but ive been uploading screenshots from citrix guis and asking qwen3-vl for the appropriate next action eg Mouseclick, and while it knows what to click it struggles to accurately return which pixel coordinates to click. Anyone know a way to get accurate pixel coordinates returned?
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#44Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.
We use an embedding model that processes videos and allows you to perform RAG on them.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#45Not so relevant to the thread but ive been uploading screenshots from citrix guis and asking qwen3-vl for the appropriate next action eg Mouseclick, and while it knows what to click it struggles to accurately return which pixel coordinates to click. Anyone know a way to get accurate pixel coordinates returned?
prompt: I attach a screenshot (1920x1080). Write code to click the submit button using pyautogui.
attachment:
reply:
import pyautogui
pyautogui.click(100, 200)Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#46Earlier quoted context omitted.
In surveillance and police states like The Netherlands it has been used since forever: https://www.theguardian.com/cities/2018/mar/01/smart-cities-... Now people will say again that this project has been abandoned, which just isn't true (2024): https://www.dutchnews.nl/2024/06/smart-street-surveillance-o...
I was watching a crime solving show from the UK. A huge percentage of the crimes are solved using camera footage. Also, they use geofencing, looking at which phones went in and out of the crime location at the time of the crime.
Back in 2009 I was working at a place where O2 was a client, and they gave us an API that could identify the cell tower (inc. lat/lng) any of their customers were connected to. The network needs to track this data internally to function, so the API is basically the equivalent of their DNS.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#47Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#48Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.
It’s not difficult to hack this together with CLIP. I did this with about a tenth of my movie collection last week with a GTX 1080 - though it lacks temporal understanding so you have to do the scene analysis yourself
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#49Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#50For anyone using Qwen3-VL: where are you running it? I had tons of reliability problems with Qwen3-VL inference providers on OpenRouter — based on uptime graphs I wasn’t alone. But when it worked, Qwen3-VL was pack-leading good at AI Vision stuff.