Very cool!
Insane how much low hanging fruit there is for Audio models right now. A team of two picking things up over a few months can build something that still competes with large players with tons of funding
Show HN: Dia, an open-weights TTS model for generating realistic dialogue
41–50 of 202 posts
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#42Does this only work for two voices? Can I generate an entire conversation between multiple people? Like this HN thread.
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#43just in case, another opensource project using same name https://wiki.gnome.org/Apps/Dia/ https://gitlab.gnome.org/GNOME/dia
Fun, I can't get to it because I can't get past the "Making sure you're not a bot!" page. It's just stuck at "calculating...". I understand the desire to slow down AI bots, but . If all the gnome apps are now behind this, they just completely shut down a small-time contributor. I love to play with Gnome apps and help out with things here and there, but I'm not going to fight with this damn thing to do so.
[deleted]
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#44Hey HN! We’re Toby and Jay, creators of Dia. Dia is 1.6B parameter open-weights model that generates dialogue directly from a transcript. Unlike TTS models that generate each speaker turn and stitch them together, Dia generates the entire conversation in a single pass. This makes it faster, more natural, and easier to use for dialogue generation. It also supports audio prompts — you can condition the output on a spec…
Are there any examples of the audio differences between the this and the larger model?
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#45This is really impressive; we're getting close to a dream of mine: the ability to generate proper audiobooks from EPUBs. Not just a robotic single voice for everything, but different, consistent voices for each protagonist, with the LLM analyzing the text to guess which voice to use and add an appropriate tone, much like a voice actor would do. I've tried "EPUB to audiobook" tools, but they are really miles behind wh…
Realistic voice acting for audio books, realistic images for each page, realistic videos for each page, oh wait I just created a movie, maybe I can change the plot? Oh wait I just created a video game
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#46Will you support the other side with AI voice detection software to detect and block malicious voice snippets?
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#47Is this Apache licensed or a custom one? The README contains this:
> This project is licensed under the Apache License 2.0 - see the LICENSE file for details.
> This project offers a high-fidelity speech generation model *intended solely for research and educational use*. The following uses are strictly forbidden:
> Identity Misuse: Do not produce audio resembling real individuals without permission.
> ...
Specifically the phrase "intended solely for research and educational use".
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#48Hey, do yourself a favor and listen to the fun example: > [S1] Oh fire! Oh my goodness! What's the procedure? What to we do people? The smoke could be coming through an air duct! Seriously impressive. Wish I could direct link the audio. Kudos to the Dia team.
For anyone who wants to listen, it's on this page: https://yummy-fir-7a4.notion.site/dia
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#49This is really impressive; we're getting close to a dream of mine: the ability to generate proper audiobooks from EPUBs. Not just a robotic single voice for everything, but different, consistent voices for each protagonist, with the LLM analyzing the text to guess which voice to use and add an appropriate tone, much like a voice actor would do. I've tried "EPUB to audiobook" tools, but they are really miles behind wh…
Wouldn’t it be more desirable to hear an actual human on an audiobook? Ideally the author?
Re: Show HN: Dia, an open-weights TTS model for generating realistic dialogue
#50Is this Apache licensed or a custom one? The README contains this: > This project is licensed under the Apache License 2.0 - see the LICENSE file for details. > This project offers a high-fidelity speech generation model *intended solely for research and educational use*. The following uses are strictly forbidden: > Identity Misuse: Do not produce audio resembling real individuals without permission. > ... Specifical…
[deleted]