Live data from Hacker News

Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

the-decoder.com

61–70 of 86 posts

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#62
post #27

Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.

you can do that with Morphik already :) We use an embedding model that processes videos and allows you to perform RAG on them.

Rag as in the content is used to generate an answer or rag as in searching for a video?

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#63
post #11

Earlier quoted context omitted.

No mention of palantir?

Palantir's just the new guy on the block: https://en.wikipedia.org/wiki/Sentient_(intelligence_analysi...

or even https://en.wikipedia.org/wiki/IBM_and_the_Holocaust

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#64
post #27

Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.

you can do that with Morphik already :) We use an embedding model that processes videos and allows you to perform RAG on them.

Would it allow me to query my library for every movie that contains dance routing move1-move2-move3 in that order?

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#65
Many of the models we have today seem to only perform OCR on the images you send and use the text retrieved for context when answering. However, Qwen-VL, and I guess Gemini now? Are different, they seem to "understanding" the image I send with my prompt. They manage to capture spatial relationships, objects, and semantics from the image, it's very impressive. I’ve been telling my friends about the Qwen3-VL model option in Qwen Chat for a while because I feel like it’s underrated.

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#67

For anyone using Qwen3-VL: where are you running it? I had tons of reliability problems with Qwen3-VL inference providers on OpenRouter — based on uptime graphs I wasn’t alone. But when it worked, Qwen3-VL was pack-leading good at AI Vision stuff.

I run the larger version of it on a Threadripper with 512GB RAM and a 32GB GPU for the non-expert layers and context, using llama.cpp. Performs great, however god forbid you try to get that much memory these days.

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#69
post #27

Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.

this is a solved problem already — check out https://getjumper.io where you can do exactly this (search through 100s of hours) offline and locally.

Disclaimer: co-founder

Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail

#70
I didn't understand what is meant by "pinpoint nearly every detail". The article is titled with that but then firehoses a bunch of technical details.

The github spells it out much better: https://github.com/QwenLM/Qwen3-VL?tab=readme-ov-file#cookbo...

Post reply on HN