Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3-Omni: Native Omni AI model for text, image and video

github.com

Post reply on HN
Print view View original

121–130 of 152 posts

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#121

Post by andruby »

MaxikCZ wrote: post #118
Implicated wrote: post #66

Earlier quoted context omitted.

I mean - the AI itself will help you get all that setup. Claude code is your friend. I run proxmox on an old Dell R710 in my closet that hosts my homeassistant (amongst others) VM and then I've setup my "gaming" PC (which hasn't done any gaming in quite some time) to dual boot (Windows or Deb/Proxmox) and just keep it booted into Deb as another proxmox node. That PC also has a 4070 Super that I have setup to passthru…

>use opus (get the max plan) I dont have max plan, but on the Pro i tried for a month, i was able to blow trough my 5 hour limit by a single prompt (with 70k context codebase attached). The idea of paying so much money to get few questions per "workday" seems insane to me

Sonnet blows through the limit much slower, and is often great tbh

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#122

Post by threeducks »

logicallee wrote: post #107
state_less wrote: post #25

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

>Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster So did you run the model offline on your own computer and get realtime audio? Can you tell me the GPU or specifications you used? I inquired with ChatGPT: https://chatgpt.com/share/68d23c2c-2928-800b-bdde-040d8cb40b... It seems it needs around a $2,500 GPU, do you have one? I tried Qwen onli…

> So did you run the model offline on your own computer and get realtime audio?

At the top of the README of the GitHub repository, there are a few links to demos where you can try the model.

> It seems it needs around a $2,500 GPU

You can get a used RTX 3090 for about $700, which has the same amount of VRAM as the RTX 4090 in your ChatGPT response.

But as far as I can tell, quantized inference implementations for this model do not exist yet.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#123

Post by faraggi »

mbac32768 wrote: post #78
state_less wrote: post #25

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

sitting here in the US, reading that China is strongly urging the adoption of Linux and pushing for open CPU architectures like RISC-V and also self-hosted open models are we the baddies??

there have been countless times where the us has been the baddy and you guys are blink to it all.

open your eyes.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#125

Post by nh2 »

Implicated wrote: post #66
mrandish wrote: post #38

Earlier quoted context omitted.

I run Home Assistant on an RPi4 and have an ESP32-based Core2 with mic ( https://shop.m5stack.com/products/m5stack-core2-esp32-iot-de... ), along with a 16GB 4070 Ti Super in an always-on Windows system I only use for occasional gaming and serving media. I'd love to set up something like you have. Can you recommended a starting place, or ideally, a step-by-step tutorial? I've never set up any AI system. Would you say…

I mean - the AI itself will help you get all that setup. Claude code is your friend. I run proxmox on an old Dell R710 in my closet that hosts my homeassistant (amongst others) VM and then I've setup my "gaming" PC (which hasn't done any gaming in quite some time) to dual boot (Windows or Deb/Proxmox) and just keep it booted into Deb as another proxmox node. That PC also has a 4070 Super that I have setup to passthru…

> I mean - the AI itself will help you get all that setup.

Or, ask somebody who already has it set up working.

That way you can get certain results, without guessing around why it works for them and not for you.

(I, too, am interested in the grandparent poster's setup.)

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#126

Post by amunozo »

BobbyJo wrote: post #102
h4ny wrote: post #99

Earlier quoted context omitted.

Could you elaborate on what you mean by "moral basis" in your comment?

I mean China's push for open weights/source/architecture probably has more to do with them wanting legal access to markets than it does with those things being morally superior.

Of course, but that translates in a benefit for most people, even for Americans. In my case (European), I cannot but support the Chinese companies in this respect, as we would be especially in trouble if the common models are the norm.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#127

Post by amunozo »

powerapple wrote: post #117
state_less wrote: post #25

Interesting, the pacing seemed very slow when conversing in english, but when I spoke to it in spanish, it sounded much faster. It's really impressive that these models are going to be able to do real time translation and much more. The Chinese are going to end up owning the AI market if the American labs don't start competing on open weights. Americans may end up in a situation where they have some $1000-2000 device…

Is there a AI market for open weights? Companies like Alibaba, Tencent, Meta or Microsoft makes a lot sense. They can build on open weights, and not losing values, potentially beneficial for share prices. The only winner is application and cloud providers, I don't see how they can make money from the weights itself to be honest.

I don't know if there is a market for it, but I know that open weights puts pressure on the closed-models companies into releasing their weights and losing their privileged situations.

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#129

Post by gcanyon »

dingnuts wrote: post #48
thoroughburro wrote: post #45

Earlier quoted context omitted.

If it does in the future, do we just hope it won’t be retroactive? Is this water boiling yet?

ex post facto law is explicitly banned in the US Constitution

> explicitly banned in the US Constitution

There are a lot of things in the US Constitution. But the Supreme Court is the final arbiter, and they're moving closer and closer to "whatever you say, big daddy."

Re: Qwen3-Omni: Native Omni AI model for text, image and video

#130

Post by tedivm »

joshgachnang wrote: post #35
tedivm wrote: post #28

Earlier quoted context omitted.

This is exactly what I do. I have two 3090s at home, with Qwen3 on it. This is tied into my Home Assistant install, and I use esp32 devices as voice satellites. It works shockingly well.

Ooo interesting, I'd love to hear more about the esp32's as voice satellites!

For the physical hardware I use the esp32-s3-box[1]. The esphome[2] suite has firmware you can flash to make the device work with HomeAssistant automatically. I have an esphome profile[3] I use, but I'm considering switching to this[4] profile instead.

For the actual AI, I basically set up three docker containers: one for speech to text[5], one for text to speech[6], and then ollama[7] for the actual AI. After that it's just a matter of pointing HomeAssistant at the various services, as it has built in support for all of these things.

1. https://www.adafruit.com/product/5835

2. https://esphome.io/

3. https://gist.github.com/tedivm/2217cead94cb41edb2b50792a8bea...

4. https://github.com/BigBobbas/ESP32-S3-Box3-Custom-ESPHome/

5. https://github.com/rhasspy/wyoming-faster-whisper

6. https://github.com/rhasspy/wyoming-piper

7. https://ollama.com/

Post reply on HN