Live data from Hacker News

Generate audiobooks from E-books with Kokoro-82M

claudio.uk

11–20 of 255 posts

Re: Generate audiobooks from E-books with Kokoro-82M

#11
post #4

This looks incredible! I’ve had an idea simmering in the back of my mind for a while now: creating an audiobook from an ebook for my commute using the voice of a specific audiobook narrator I really enjoy. The concept struck me after coming across the Infinite Conversation project here on HN. Unfortunately, I just haven’t found the time to bring it to life yet. :(

What about the copyright issue? You can’t mimic the voice of a narrator without their consent. OpenAI landed in trouble after using Scarlett Johansson’s voice in a demo.

https://www.theverge.com/2024/5/20/24161253/scarlett-johanss...

Re: Generate audiobooks from E-books with Kokoro-82M

#12

For anyone looking for an easier alternative (and one without the bugs the author describes, such as skipping some prefaces or failing to detect some chapters), Voice Dream Reader on iOS (and macOS) handles .epub and other e-books just fine and supports a variety of built-in and external voices.

Do you know if it's possible to train it to use my own voice?

Re: Generate audiobooks from E-books with Kokoro-82M

#13

For anyone looking for an easier alternative (and one without the bugs the author describes, such as skipping some prefaces or failing to detect some chapters), Voice Dream Reader on iOS (and macOS) handles .epub and other e-books just fine and supports a variety of built-in and external voices.

Another subscription. $80/yr. Yaaaaaay.

Unless something has changed, the iOS version is a one-time purchase. I bought the app many years ago (8?) and have been a happy user since.

Like you, though, I had that reaction to the subscription model for macOS and therefore decided not to "buy" it when it came out.

Re: Generate audiobooks from E-books with Kokoro-82M

#14
post #11
post #4

This looks incredible! I’ve had an idea simmering in the back of my mind for a while now: creating an audiobook from an ebook for my commute using the voice of a specific audiobook narrator I really enjoy. The concept struck me after coming across the Infinite Conversation project here on HN. Unfortunately, I just haven’t found the time to bring it to life yet. :(

What about the copyright issue? You can’t mimic the voice of a narrator without their consent. OpenAI landed in trouble after using Scarlett Johansson’s voice in a demo. https://www.theverge.com/2024/5/20/24161253/scarlett-johanss...

No limitations on this kind of thing if you are in private use.

Re: Generate audiobooks from E-books with Kokoro-82M

#15

Earlier quoted context omitted.

Another subscription. $80/yr. Yaaaaaay.

Unless something has changed, the iOS version is a one-time purchase. I bought the app many years ago (8?) and have been a happy user since. Like you, though, I had that reaction to the subscription model for macOS and therefore decided not to "buy" it when it came out.

They got greedy and decided to milk it. That's what changed.

It's $80/yr for the iOS app.

Re: Generate audiobooks from E-books with Kokoro-82M

#16
post #11

Earlier quoted context omitted.

What about the copyright issue? You can’t mimic the voice of a narrator without their consent. OpenAI landed in trouble after using Scarlett Johansson’s voice in a demo. https://www.theverge.com/2024/5/20/24161253/scarlett-johanss...

No limitations on this kind of thing if you are in private use.

Forgive me for not knowing it was for personal use.

Re: Generate audiobooks from E-books with Kokoro-82M

#17

Earlier quoted context omitted.

Unless something has changed, the iOS version is a one-time purchase. I bought the app many years ago (8?) and have been a happy user since. Like you, though, I had that reaction to the subscription model for macOS and therefore decided not to "buy" it when it came out.

They got greedy and decided to milk it. That's what changed. It's $80/yr for the iOS app.

Oof, I believe they changed ownership so I must have been grandfathered in. That's steep.

Re: Generate audiobooks from E-books with Kokoro-82M

#18
post #6

I would for sure not want this for fiction, it's too obvious that the voice has no understanding whatsoever of the text, but it's probably pretty nice for converting short news texts or notifications to audio.

Your point is a valid one, but I want to add to it that it is also a matter of expectations and how one listens.

Years ago, when I was dating someone who spoke Russian as one of her native languages, we had to do a funny compromise when watching films together with her parents: they didn't speak a word of English, so we'd use the Russian dub with English subtitles.

I noticed that the Russian dub was just one man reading a translation in a flat voice over what was happening on the screen, no attempts at voice acting or matching the emotions. Usually the dub would have a split second delay to the actual lines, so you'd still hear the original voices for a moment (and also a little bit in the background).

At first I found it very jarring, but they explained that this flatness was a feature. You'll quickly learn to "filter out" the voice while still hearing the translation, and the faint presence of the original voices was enough to bring the emotional flavor back. The lack of voice acting helped with the filtering.

This turned out to apply to me as well, even though I don't speak Russian! My brain subconsciously would filter out the dub, and extract most of the original performance through the subtitles and faint presence of the original voices. Obviously the original version would have been a better experience for me, but it was still very enjoyable.

Of course a generated audiobook is not a dub, as there is no "original voice" to extract an emotional performance from. But some listeners might still be able do something similar. The lack of understanding in the generated voice and its predictable monotony might allow them to filter out everything but the literal text, and then fill it in with their own emotional interpretations. Still not as great as having proper story teller who does understand the text and knows how to deliver dramatic lines, but perhaps not as bad as expected either.

Re: Generate audiobooks from E-books with Kokoro-82M

#19
post #7

Would this also be the best option if you just want to convert plain text files to audio?

Markdown and PDF would also be cool. I think it's just a case of feeding the TTS model the right data at the right time. The special sauce is in the model, there's really not much to the code: https://github.com/santinic/audiblez/blob/main/audiblez.py
Post reply on HN