Live data from Hacker News

Qwen3-Omni: Native Omni AI model for text, image and video

github.com

131–140 of 152 posts

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#131
post #50

Earlier quoted context omitted.

Can you tell me about these voice satellites?

He is referring the M5 Atom's I believe. I strongly recommend the ESP32 S3 box now, you can fire up Bobbas special firmware for it, search on Github, and its a blast with Home Assistant.

I'm actually using the esp32 s3 boxes myself!

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#132
I tried using it for a planning a trip that we're taking soon. We've actually already planned the trip, but thought it'd be fun.

It asked me follow up questions, and then took forever. I finally clicked the button to see what was happening and it had started outputting Chinese in the middle.

I gave up on it.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#133

I recently needed to scan hundreds of low quality invoices and run them through OCR for invoice numbers and dates. I really took for granted how seamless this is in some applications, and was shocked how much work went into producing decent results. I was obviously really naive. Either way, it gets me excited any time I see progress with OCR. I should give this a try against my (small) dataset.

I just ran Qwen against some of invoices that my gnarly algorithm really struggled with (with openai fallback) and Qwen was able to extract all relevant data without any issues. I'm pretty damn impressed to be honest.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#134
post #28

Earlier quoted context omitted.

This is exactly what I do. I have two 3090s at home, with Qwen3 on it. This is tied into my Home Assistant install, and I use esp32 devices as voice satellites. It works shockingly well.

That's great to hear. I was mostly impressed with Qwen3 coder on my 4090, but am hobbled by the small memory footprint of the single card. What motherboard are you using with your 3090s? Like the others, I too am curious about those esp32s and what software you run on them. Keep up the good hacking - it's been fun to play with this stuff!

I actually am not using the 3090s as one unit. I have Qwen3-30B-A3B as my primary model and it fits on a single GPU, then I have all the TTS/STT on the other GPU.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#135

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

Is there a AI market for open weights? Companies like Alibaba, Tencent, Meta or Microsoft makes a lot sense. They can build on open weights, and not losing values, potentially beneficial for share prices. The only winner is application and cloud providers, I don't see how they can make money from the weights itself to be honest.

The only money to be made is in compute, not open weights themselves. What point is a market when a commons like huggingface or modelscope? Alibaba made modelscope to compete with HF, and that's a commons not a market either, if that tells you anything.

By analogy, you can legally charge for copies of your custom Linux distribution, but what's the point when all the others are free?

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#136
post #99

Earlier quoted context omitted.

Could you elaborate on what you mean by "moral basis" in your comment?

It is in their selfish interest to push for open weights. That's not to say they are being selfish, or to judge in any way the morality of their actions. But because of that incentive, you can't logically infer moral agency in their decision to release open-weights, IP-free CPUs, etc.

Leaving China aside, it's arguably immoral that our leading AI models are closed and concentrated in the hands of billionaires with questionable ethical histories (at best).

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#137

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

sitting here in the US, reading that China is strongly urging the adoption of Linux and pushing for open CPU architectures like RISC-V and also self-hosted open models are we the baddies??

Winner takes all monopoly big tech capitalism is bad. Literally textbook bad.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#138

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

The US is probably ahead but they're so obsessed with moats, IP and safety that their lagginess is self imposed.

China has nothing to lose and everything to gain by releasing stuff openly.

Once China figures put how to make high performance FPGA chips really cheap, its game over for the US. The only power the US has is over GPU supply...and even then its pretty weak.

Not to mention NVIDIA crippling its own country with low VRAM cards. China is taking older cards, stripping the RAM and upgrading other older cards.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#139

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

sitting here in the US, reading that China is strongly urging the adoption of Linux and pushing for open CPU architectures like RISC-V and also self-hosted open models are we the baddies??

I know right!

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#140
post #86

Earlier quoted context omitted.

sitting here in the US, reading that China is strongly urging the adoption of Linux and pushing for open CPU architectures like RISC-V and also self-hosted open models are we the baddies??

If there is a walled garden, and you aren't in it, you'll probably push for the walls to come down. No moral basis needed.

Depends on whether you want to be in it. A ladder might be enough to peek over the top and rip it off. Do it better. Which seems to be what is happening.
Post reply on HN