Live data from Hacker News

Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

the-decoder.com

11–20 of 86 posts

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#11
post #5

Does anyone else worry about this technology used for Big Brother type surveillance?

Where have you been the last decade? It’s already in use, or models like it, by companies selling access to The State https://deflock.me Not to mention cloud platforms that collect evidence and process it with all the models and store that information for searching… https://www.revir.ai

No mention of palantir?

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#13
post #11

Earlier quoted context omitted.

Where have you been the last decade? It’s already in use, or models like it, by companies selling access to The State https://deflock.me Not to mention cloud platforms that collect evidence and process it with all the models and store that information for searching… https://www.revir.ai

No mention of palantir?

>It’s already in use, or models like it, by companies selling access to The State

Doesn't that pretty much cover Palantir as well?

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#16
post #5

Does anyone else worry about this technology used for Big Brother type surveillance?

How do you think this tech was developed in the first place? It's probably trained and used in the surveillance bid for a decade before it comes to consumers, and this probably isn't the SoA stuff that governments have access to, we're probably 5-10 years behind what's on the cutting edge.

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#18

I was using this for video understanding with inference form vlm.run infra. It definitely has outperformed Gemini which generally is much better than openai or Claude on videos. The detailed extraction is pretty good. With agents you can also crop into a segment and do more operations on it. have to see how the multi modal space progresses: link to results: https://chat.vlm.run/c/82a33ebb-65f9-40f3-9691-bc674ef28b52…

I found it pretty funny how bad Claude was at cropping an image. It was a cute little character with some text off to the side on a white background, all very clean cartoon vibes and it COULD NOT just select the character. I pursued it for 20 minutes because I thought it was funny. Of course it was 45 seconds to do it myself.

A lot of my side projects involve UIs and almost all of my problems with getting LLMs to write them for me involve "The UI isn't doing what you say it's doing" and struggling to get A) a reliable way to get it to look at the UI so it can continue its loop and B) getting it to understand what it's looking at well enough to do something about it

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#19
post #9
post #6

It's so weird how that works with transformers. Finetuning an LLM "backbone" (if I understand correctly: a fully trained but not instruction tuned LLM, usually small because students) with OCR tokens bests just about every OCR network out there. And it's not just OCR. Describing images. Bounding boxes. Audio, both ASR and TTS, all works better that way. Now many research papers are only really about how to encode ima…

It is fascinating. Vision language models are unreasonably good compared to dedicated OCR and even the language tasks to some extent. My take is it fits into the general concept that generalist models have significant advantages because so much more latent structure maps across domains than we expect. People still talk about fine tuning dedicated models being effective but my personal experience is it's still always…

Now apply that thinking to human-based neural nets...

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#20
post #9
post #6

It's so weird how that works with transformers. Finetuning an LLM "backbone" (if I understand correctly: a fully trained but not instruction tuned LLM, usually small because students) with OCR tokens bests just about every OCR network out there. And it's not just OCR. Describing images. Bounding boxes. Audio, both ASR and TTS, all works better that way. Now many research papers are only really about how to encode ima…

It is fascinating. Vision language models are unreasonably good compared to dedicated OCR and even the language tasks to some extent. My take is it fits into the general concept that generalist models have significant advantages because so much more latent structure maps across domains than we expect. People still talk about fine tuning dedicated models being effective but my personal experience is it's still always…

>People still talk about fine tuning dedicated models being effective

>it's still always better to use a larger generalist model than a smaller fine tuned one

Smaller fine-tuned models are still a good fit if they need to run on-premises cheaply and are already good enough. Isn't it their main use case?

Post reply on HN