[deleted]
Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
21–30 of 86 posts
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#22Earlier quoted context omitted.
It is fascinating. Vision language models are unreasonably good compared to dedicated OCR and even the language tasks to some extent. My take is it fits into the general concept that generalist models have significant advantages because so much more latent structure maps across domains than we expect. People still talk about fine tuning dedicated models being effective but my personal experience is it's still always…
>People still talk about fine tuning dedicated models being effective >it's still always better to use a larger generalist model than a smaller fine tuned one Smaller fine-tuned models are still a good fit if they need to run on-premises cheaply and are already good enough. Isn't it their main use case?
Latency and size. Otherwise pretty much useless.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#23Does anyone else worry about this technology used for Big Brother type surveillance?
Big Brother is a reference to George Orwell's critique of Communism in Nineteen Eighty-Four.
Qwen is a video model trained by a Communist government, or technically by a company with very close ties to the Chinese government. The Chinese government also has laws requiring AI be used to further the political goals of China in particular and authoritarian socialism in general.
In the light of all this, I think it's reasonable to conclude that this technology will be used for Big Brother type surveillance and quite possible that it was created explicitly for that purpose.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#24I was using this for video understanding with inference form vlm.run infra. It definitely has outperformed Gemini which generally is much better than openai or Claude on videos. The detailed extraction is pretty good. With agents you can also crop into a segment and do more operations on it. have to see how the multi modal space progresses: link to results: https://chat.vlm.run/c/82a33ebb-65f9-40f3-9691-bc674ef28b52…
I found it pretty funny how bad Claude was at cropping an image. It was a cute little character with some text off to the side on a white background, all very clean cartoon vibes and it COULD NOT just select the character. I pursued it for 20 minutes because I thought it was funny. Of course it was 45 seconds to do it myself. A lot of my side projects involve UIs and almost all of my problems with getting LLMs to wri…
I agree claude and chatgpt and even gemini does a poor job in detecting and cropping into a region. Some of the simplest tasks, Qwen also is great at summerization but not into solving simple vision tasks like cropping, segmentetation and detection. Here is an examples where we compared claude, gemini, chatgpt and other frontier models for simple(and complicated) visual tasks
https://chat.vlm.run/showdown#:~:text=Crop%20into%20the%20cl...
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#25Earlier quoted context omitted.
I found it pretty funny how bad Claude was at cropping an image. It was a cute little character with some text off to the side on a white background, all very clean cartoon vibes and it COULD NOT just select the character. I pursued it for 20 minutes because I thought it was funny. Of course it was 45 seconds to do it myself. A lot of my side projects involve UIs and almost all of my problems with getting LLMs to wri…
I agree claude and chatgpt and even gemini does a poor job in detecting and cropping into a region. Some of the simplest tasks, Qwen also is great at summerization but not into solving simple vision tasks like cropping, segmentetation and detection. Here is an examples where we compared claude, gemini, chatgpt and other frontier models for simple(and complicated) visual tasks https://chat.vlm.run/showdown#:~:text=Cro…
The part that was funny to me is I would respond "is that right?" and it would tell me exactly how it was wrong and proceed to do it incorrectly again in a very similar but different way. It was like a Monty Python sketch. I might have also been very tired and easily amused.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#26Does anyone else worry about this technology used for Big Brother type surveillance?
It was already used before current AI explosion.
This is why keeping our governments from eating that tasty apple of "if you can record AND analyse everything there will be so much less crime" and "just give us keys to all private communication, we swear we will just use it to find bad guys". Because someone will, and someone will use it to hit on people they don't like
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#27Hope this on day will be used for auto-tagging all video assets with time codes. The dream of being able to search for running horse and find a clip containing a running horse at 4m42s in one of thousands of clips.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#28Does anyone else worry about this technology used for Big Brother type surveillance?
In surveillance and police states like The Netherlands it has been used since forever:
https://www.theguardian.com/cities/2018/mar/01/smart-cities-...
Now people will say again that this project has been abandoned, which just isn't true (2024):
https://www.dutchnews.nl/2024/06/smart-street-surveillance-o...
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#29Does anyone else worry about this technology used for Big Brother type surveillance?
This tech would be a massive waste of computational resources to do that. Technology for what you said is way more efficient and has been working well for years now.
Re: Qwen3-VL can scan two-hour videos and pinpoint nearly every detail
#30I was playing around with Qwen3-VL to parse PDFs - meaning, do some OCR data extraction from a reasonably well-formated PDF report. Failed miserably, although I was using the 30B-A3B model instead of the larger one.
I like the Qwen models and use them for other tasks successfully. It is so interesting how LLMs will do quite well in one situation and quite badly in another.