Automating Immersive Reading

I'd never considered such a tool before today, but the example sparked the exact same idea for me, as if it were the most obvious next step to invert the causal direction and externalize the inner reading voice (instead of trying to force the internal reading to follow the external audio). I'm not sure that it would improve reading comprehension or make the experience better in some ineffable way, but it would be really interesting to try it out. Questions arise:

- Would it help with reading comprehension? Speed? Enjoyment?

- If the audio was your own synthesized voice, would that help comprehension and immersion?

- If the audio was in a voice very different from your own, and you used this system for several hours a day, would it change your natural inner reading voice, or even some other aspect of your self-perception? I don't believe I've experienced Such a tight coupling between thoughts driving external responses before; I didn't expect to do so until real-time brain scanning got a lot better than current SotA.

- While reading, I frequently speed along and then jump back a word, sentence, or paragraph to slowly review it. In this system, the audio would slow down as I read back through more slowly, almost sounding out words along with me. I just read a book filled with the names of obscure french villages, and I couldn't just ignore them - instead bogged down in sounding them out and trying to guess how to pronounce them. Having a system sounding them out with/for me would have been awesome. This assumes the system is good at pronouncing things in various languages (mostly solved problem), and picking sane defaults when pronunciation conflicts arise (mostly unsolved?). In those cases, how hard would inferring be? Google translate is pretty good at generating localized pronunciations, but TTS systems struggle.

- Specifically for non-technical reading, it would be interesting to try having a very low level of ambient noise backgrounding the speech, driven by an LLM analyzing the text for obvious cues. Tavern sounds, rushing of wind in the mountains, crackling campfire, or even music generation (creepy dungeon etc etc)... When you pause reading for a moment to look away from the book, the speech obviously stops - but the tavern sounds continue. Might help people 'lock in' who normally get distracted from whatever they're reading.

Hm, I don't know what you're referring to. Is the text too small for you? I wrote the blog post on FF for Linux and FF for Android, and I didn't need to zoom in to review it, though some of the graphics do definitely end up with pretty small text on mobile.

I tried running Kokoro on my iPhone XS (several years old), and it was slower than real-time. So, i wouldn’t expect it to be usable on a Kindle. But if you find a solution, please let me know.

What is the purpose of this outside people with disabilities? Why do you need word highlighting, it's like those TikToks and IG reels where they show one word at a time to keep you hooked.

Surely, if you need this to read a book (again, besides any disabilities), you should stop your current habits.

xubuntu, 2x iiyama IVM610F those are 24" 1920x1200, firefox latest.

For some reason when I open hn it's readable. When I open your site it's.. not.