Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3-TTS family is now open sourced: Voice design, clone, and generation

qwen.ai

Post reply on HN
Print view View original

191–200 of 229 posts

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#191

Post by michelb »

echelon wrote: post #65
javier123454321 wrote: post #41

Earlier quoted context omitted.

This is terrifying. With this and z-image-turbo, we've crossed a chasm. And a very deep one. We are currently protected by screens, we can, and should assume everything behind a screen is fake unless rigorously (and systematically, i.e. cryptographically) proven otherwise. We're sleepwalking into this, not enough people know about it.

We're going to be okay. There are far more good and interesting use cases for this technology. Games will let users clone their voices and create virtual avatars and heroes. People will have access to creative tools that let them make movies and shows with their likeness. People that couldn't sing will make music. Nothing was more scary than the invention of the nuclear weapon. And we're all still here. Life will go…

Yeah. Not using voice, but...https://nymag.com/intelligencer/article/white-house-posts-fa...

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#192

Post by akadeb »

viraptor wrote: post #183

I can't quite figure this out: Can you save a generated voice for reuse later? The mlx-audio I looked at seems to take the text itself in every interface and doesn't expose it as a separate object. (I can dive deeper, but wanted to check if anyone's done it already)

You could pipe the output to an audio file with ffmpeg or pyaudio and save it locally

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#193

Post by cube00 »

genewitch wrote: post #153
simonw wrote: post #131

I got this running on macOS using mlx-audio thanks to Prince Canuma: https://x.com/Prince_Canuma/status/2014453857019904423 Here's the script I'm using: https://github.com/simonw/tools/blob/main/python/q3_tts.py You can try it with uv (downloads a 4.5GB model on first run) like this: uv run https://tools.simonwillison.net/python/q3_tts.py \ 'I am a pirate, give me your gold!' \ -i 'gruff voice' -o pirate.wav

If i am ever in the same city as you, i'll buy you dinner. I poked around during my free time today trying to figure out how to run these models, and here is the estimable Simon Willison just presenting it on a platter. hopefully i can make this work on windows (or linux, i guess). thanks so much.

> hopefully i can make this work on windows (or linux, i guess).

mlx-audio only works on Apple Silicon

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#194

Post by chriswep »

In my tests this doesn't come close to the years old coqui/XTTS-v2. It has great voice cloning capabilities and creates rich speech with emotions with low latency. I tried out several local-TTS projects over the years but i'm somewhat confused that nothing seems to be able to match coqui despite the leaps that we see in other areas of AI. Can somebody with more knowledge in this field explain why that might be? Or am i completely missing something?

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#195

Post by Urahandystar »

fc417fc802 wrote: post #186
volkercraig wrote: post #103

Earlier quoted context omitted.

This feels like one of those tropes that keeps showing up whenever new tech comes out. At the advent of recorded music, im sure buskers and performers were complaing that live music is dead forever. Stage actors were probably complaining that film killed plays. Heck, I bet someome even complained that video itself killed the radio star. Yet here we are, hundreds of years later, live music is still desirable, plays st…

> This feels like one of those tropes that keeps showing up whenever new tech comes out. And this itself is another tired trope. Just because you can pattern match and observe that things repeatedly went a certain way in the past, doesn't mean that all future applications of said pattern will play out the same way. On occasion entire industries have been obliterated without a trace by technological advancement. We ca…

Give me one aspect in which that has actually happened? I'm wracking my brains but can't think of one. We are a weird species in that even if we could replace ourselves our fascination with ourselves means that we don't ever do it. Cars and bicycles have replaced our ability to travel at great and small distances and yet we still have track events culminating in the olympics.

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#196

Post by regularfry »

magicalhippo wrote: post #138
thedangler wrote: post #104

Earlier quoted context omitted.

How did you do this locally? Tools? Language?

I just followed the Quickstart[1] in the GitHub repo, refreshingly straight forward. Using the pip package worked fine, as did installing the editable version using the git repository. Just install the CUDA version of PyTorch[2] first. The HF demo is very similar to the GitHub demo, so easy to try out. pip install torch torchvision --index-url https://download.pytorch.org/whl/cu128 pip install qwen3-tts qwen-tts-demo…

It flat didn't work for me on mps. CUDA only until someone patches it.

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#197

Post by lynx97 »

doug713705 wrote: post #135
echelon wrote: post #65

Earlier quoted context omitted.

We're going to be okay. There are far more good and interesting use cases for this technology. Games will let users clone their voices and create virtual avatars and heroes. People will have access to creative tools that let them make movies and shows with their likeness. People that couldn't sing will make music. Nothing was more scary than the invention of the nuclear weapon. And we're all still here. Life will go…

> Nothing was more scary than the invention of the nuclear weapon. And we're all still here. Except that building a nuclear weapon was not available to everyone, certainly not to dumb people whose brain have been feeded with social media content.

I usually don't correct typos and/or grammar, but you asked for it. Calling random people "dumb" while using an incorrect past tense is pretty funny. It is "fed", not "feeded"...

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#198

Post by lynx97 »

javier123454321 wrote: post #86
echelon wrote: post #71

Earlier quoted context omitted.

There are plenty of electronic artists who can't sing. Right now they have to hire someone else to do the singing for them, but I'd wager a lot of them would like to own their music end-to-end. I would. I'm a filmmaker. I've done it photons-on-glass production for fifteen years. Meisner trained, have performed every role from cast to crew. I'm elated that these tools are going to enable me to do more with a smaller b…

Yes, the flipside of this is that we're eroding the last bit of ability for people to make a living through their art. We are capturing the market for people to live off of making illustrations, to making background music, jingles, promotional videos, photographs, graphic design, and funnelling those earnings to NVIDIA. The question I keep asking is whether we care to value as a society for people to make a living th…

The amount of artists that managed to actually earn enough to pay the rent and bills was already very very small before AI emerged. I totally agree with you, its heartbreaking to watch how it got even worse, but, the music industry already shuffled the big money to the big players way before AI.

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#199

Post by bsenftner »

cristoperb wrote: post #163
simonw wrote: post #33

If you want to try out the voice cloning yourself you can do that an this Hugging Face demo: https://huggingface.co/spaces/Qwen/Qwen3-TTS - switch to the "Voice Clone" tab, paste in some example text and use the microphone option to record yourself reading that text - then paste in other text and have it generate a version of that read using your voice. I shared a recording of audio I generated with that here: https:…

I cloned my voice and had it generate audio for a paragraph from something I wrote. It definitely kind of sounds like me, but I like it much better than listening to my real voice. Some kind of uncanny peak.

You do realize that you don't hear your real voice normally, an individual has to record their voice to hear how others hear their voice. What you hear when you speak includes your skull resonating, which other's do not hear.

Re: Qwen3-TTS family is now open sourced: Voice design, clone, and generation

#200

Post by TacticalCoder »

javier123454321 wrote: post #41
simonw wrote: post #33

If you want to try out the voice cloning yourself you can do that an this Hugging Face demo: https://huggingface.co/spaces/Qwen/Qwen3-TTS - switch to the "Voice Clone" tab, paste in some example text and use the microphone option to record yourself reading that text - then paste in other text and have it generate a version of that read using your voice. I shared a recording of audio I generated with that here: https:…

This is terrifying. With this and z-image-turbo, we've crossed a chasm. And a very deep one. We are currently protected by screens, we can, and should assume everything behind a screen is fake unless rigorously (and systematically, i.e. cryptographically) proven otherwise. We're sleepwalking into this, not enough people know about it.

> With this and z-image-turbo, we've crossed a chasm.

And most of all: they're both local models. The cat is out of the box and it's never going back in. There's no censoring of this. No company that can pull the plug. Anyone with a semi-modern GPU can use these models.

Post reply on HN