Any plans for AMD GPU support? Maybe I'm missing something, but it's not working out of the box on a 7900xtx.
Show HN: Dia, an open-weights TTS model for generating realistic dialogue
91–100 of 202 posts
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#92Earlier quoted context omitted.
Honestly, I’d say that’s true only for the author. Anyone else is just going to be interpreting the words to understand how to best convey the character / emotion / situation / etc., just like an AI will have to do. If an AI can do that more effectively than a human, why not? The author could be better, because they at least have other info beyond the text to rely on, they can go off-script or add little details, etc…
As somebody who has listened to hundreds of audiobooks, I can tell you authors are generally not the best choice to voice their own work. They may know every intent, but they are writers, not actors. The most skilled readers will make you want to read books _just because they narrated them_. They add a unique quality to the story, that you do not get from reading yourself or from watching a video adaptation. Currentl…
I’d suggest even if the TTS sounded good, I’d still rather a human because:
1. It’s a job that seems worthwhile to support, especially as it’s “practice” that only adds to a lifetime of work and improves their central skill set
2. A voice actor will bring their own flare, just like any actor does to their job
3. They (should) prepare for the book, understanding what it’s about in its entirety, and bring that context to the reading
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#93Hey HN! We’re Toby and Jay, creators of Dia. Dia is 1.6B parameter open-weights model that generates dialogue directly from a transcript. Unlike TTS models that generate each speaker turn and stitch them together, Dia generates the entire conversation in a single pass. This makes it faster, more natural, and easier to use for dialogue generation. It also supports audio prompts — you can condition the output on a spec…
I know it’s taboo to ask, but I must: where’s the dataset from? Very eager to play around with audio models myself, but I find existing datasets limiting
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#94[deleted]
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#95This is really impressive; we're getting close to a dream of mine: the ability to generate proper audiobooks from EPUBs. Not just a robotic single voice for everything, but different, consistent voices for each protagonist, with the LLM analyzing the text to guess which voice to use and add an appropriate tone, much like a voice actor would do. I've tried "EPUB to audiobook" tools, but they are really miles behind wh…
Wouldn’t it be more desirable to hear an actual human on an audiobook? Ideally the author?
With 1M+ new books every year, that’s not possible for all but the few most popular.
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#96The huggingface spaces link doesn't work, fyi. Sounds awesome in the demo page though.
We are in the progress of fixing it! Thanks for letting us know :)
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#97Does this only support English? I would absolutely love something like this for practicing Chinese, or even just adding Chinese dialogue to a project.
Hi! I'm Dia's developer. We currently only support English.
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#98Is this Apache licensed or a custom one? The README contains this: > This project is licensed under the Apache License 2.0 - see the LICENSE file for details. > This project offers a high-fidelity speech generation model *intended solely for research and educational use*. The following uses are strictly forbidden: > Identity Misuse: Do not produce audio resembling real individuals without permission. > ... Specifical…
Sorry for the confusion. the license is plain Apache 2.0, and we changed the wording to "intended for research and educational use." The point was, users are free to use it for their use cases, just don't do shady stuff with it.
Thanks for the feedback :)
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#99[deleted]
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#100made a small change and got it running on M2 Pro 16GB Macbook pro, the quality is amazing. https://github.com/nari-labs/dia/pull/4
Thank you for this! My desktop GPU has only 8GB VRAM, but my MacBook has plenty of unified RAM.