Live data from Hacker News

Generate audiobooks from E-books with Kokoro-82M

claudio.uk

81–90 of 255 posts

Re: Generate audiobooks from E-books with Kokoro-82M

#81
post #72
post #44

Earlier quoted context omitted.

Yeah that surprised me as well - seems low vs what is used on text llms . To be fair 100 hours of speaking is a lot of speaking though

But it covers five? Languages so if all equal it’s just 20 hours per language.

in the linked audio sample it says the training data is mostly english. also another comment claims that the japanese quality is not good, so i'd be suspicious about all the other languages.

Re: Generate audiobooks from E-books with Kokoro-82M

#82
post #49
post #42

Earlier quoted context omitted.

With this technology, one could produce high quality audio books without having access to high quality narrators by annotating the books with the voice, speed and such things. I wonder if a standardized markup exists to do so.

They still wouldn't be high quality. It's just not possible to capture the precise tone of voice in an annotation, and that precision I believe really makes a difference. My experience is that the deeper the narrator understands the text and conveys that understanding, the easier it becomes for me to absorb that information.

Have you tried those "podcast from a paper" models? They do some of the things you are saying they don't, although it's not 100% it's also miles ahead of for example human Polish TV lectors, or other monotone style narrations.

Re: Generate audiobooks from E-books with Kokoro-82M

#83

For anyone looking for an easier alternative (and one without the bugs the author describes, such as skipping some prefaces or failing to detect some chapters), Voice Dream Reader on iOS (and macOS) handles .epub and other e-books just fine and supports a variety of built-in and external voices.

Yes, I’ve used Voice Dream for years with Pocket articles & ebooks because the Pocket app took up too much space and was limited to web articles. The voice quality is ok for short pieces or stints. The choice of voices is a bit robotic, but I find it useful while making written notes in Split View.

Re: Generate audiobooks from E-books with Kokoro-82M

#84
post #48

On the one hand, this is very convenient. Probably cool for some non-fiction. On the other, some of my favorite audio books all stood out because the narrator was interpreting the text really well, for example by changing the pacing during chaotic moments. Or those audiobooks with multiple narrators and different voices for each character. Not to mention that sometimes the only cue you get for who's speaking during d…

> On the other, some of my favorite audio books all stood out because the narrator was interpreting the text really well This (and everything else with AI) isn't saying "you don't need good actors any more". It's saying "if you don't have an audiobook, you can make a mediocre one automatically". AI (text, images, videos, whatever) doesn't replace the top end, it replaces the entire bottom-to-middle end.

AI TTS has been available for quite some time. Tacotron V1 is about 8 years old. I don't think we saw much bottom end replacement.

IMGO(gut opinion), generative AI is a consumption aid, like a strong antacid. It lets us be done with $content quicker, for content = {book, art, noisy_email, coding_task}. There's obvious preconceptions forming among us all from "generative" nomenclature, but lots of surviving usages are rather reductive in relevant useful manners.

Re: Generate audiobooks from E-books with Kokoro-82M

#85
post #76
post #64

Earlier quoted context omitted.

RIP to future top-enders that would normally have started out on the bottom to middle end.

Bingo. AI is going to destroy any pathway for training and accruing experience. An embalming tech for our dying civilization.

Just like printing presses killed the profession of copying books by hand, eliminating the training pathway for illuminated manuscripts. Death of civilization itself I say, damn those printing presses.

Re: Generate audiobooks from E-books with Kokoro-82M

#86
post #76

Earlier quoted context omitted.

Bingo. AI is going to destroy any pathway for training and accruing experience. An embalming tech for our dying civilization.

Just like printing presses killed the profession of copying books by hand, eliminating the training pathway for illuminated manuscripts. Death of civilization itself I say, damn those printing presses.

If you see podcasts as useless in modern society as illuminated manuscripts, no big loss I suppose, but I do enjoy the human made ones and would be sad to see them go extinct as the manuscripts did. And the same thing is happening to other entry-level creative roles, some of which you may personally regret the loss of too.

Re: Generate audiobooks from E-books with Kokoro-82M

#87
post #76

Earlier quoted context omitted.

Bingo. AI is going to destroy any pathway for training and accruing experience. An embalming tech for our dying civilization.

Just like printing presses killed the profession of copying books by hand, eliminating the training pathway for illuminated manuscripts. Death of civilization itself I say, damn those printing presses.

Given that the printing press was the root cause for the century of religious wars that soaked Europe with blood, and was key in the revolutions that overthrown absolute monarchies all over Europe, I don't think it's as good as an example as you think it is.

Death of a civilization doesn't mean disappearance of mankind or even overall regression on the long term.

Re: Generate audiobooks from E-books with Kokoro-82M

#89
post #33

Can anyone recommend an open source option that would allow training on a custom voice (my own, so I'd be able to record as many snippets as it needed to train on) to allow me to use it for TTS generation without sharing it off my machine? Edit: I'll wait to see if any recommendations get made here, if not I might give this one a go: https://github.com/coqui-ai/TTS

I think you can probably generate TTS audio by classical means, and voice2voice that audio through RVC or Beatrice V2. Haven't looked into it in a while but Beatrice is apparently super fast and CPU only.

Re: Generate audiobooks from E-books with Kokoro-82M

#90
post #79
post #67

Earlier quoted context omitted.

that's the thing. it's not just for accessibility. anything not already narrated is a fair target for TTS. i don't have time to sit down and read books. all reading is done on the go, while getting around or doing daily routines at home. i have a small book that i am reading now, which should take a few hours to finish, but in the time i manage to get done reading it i will probably have listened to two or three audi…

You don't choose to spend your time reading books. You probably roll your eyes when someone tells you they don't have time for some activity you deem valuable. This is the 'no time to exercise' debate in a different shape. They are also different activities, with audio it's easier to listen to more but retention is usually lower. Not casting any elitist "you need to read" bullshit by the way, but find it odd to defin…

there is not much of a choice here. sure, i could use the time i spend reading and commenting on HN to read books instead. so technically speaking it is a choice. but i want to do both and many other things besides also having to work and a family to take care of. so the result is, i can't afford the time to read without giving up other things that are also important to me. listening to books allows me to access books i would otherwise not be able to read because of these priorities.

there are other factors as well. i love reading so much that i tend to forget time around me. as a result reading would cause me to neglect other duties. i can't allow that, and therefore i am forced to avoid reading. i also don't like long form reading on electronic devices, and as a frequent traveler, printed books are simply not practical and often not even accessible.

i agree with the retention issue, but i found that a much larger factor for retention is how well i can follow the story. a good story that is easy to get into is also easier to retain. and finally, reading fiction is for entertainment. i don't have to retain it.

Post reply on HN