[dead]
Show HN: Three new Kitten TTS models – smallest less than 25MB
51–60 of 201 posts
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#52Earlier quoted context omitted.
yes, our mobile sdk is coming soon(eta 2 weeks) so we should be able to replace the built-in version of it. can you share what tts use-case you're thinking of?
I use an epub reader like Moon+ with the built in TTS to turn epubs into audiobooks, and I tried Kokoro TTS but the issue was too much lag between sentences plus it doesn't preprocess the next sentence while it reads out the current one.
okay this seems pretty doable, i think i know someone who is working on an epub reader using kittentts. if they don't post about it, i'll do it once its done.
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#53This is great. Demo looks awesome.
thanks, glad you liked it
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#54are there plans to output text alignment?
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#55are there plans to output text alignment?
yes, we just started working on this yesterday haha, great that you mentioned it. once we have it working it'll be out soon.
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#56Earlier quoted context omitted.
yes, our mobile sdk is coming soon(eta 2 weeks) so we should be able to replace the built-in version of it. can you share what tts use-case you're thinking of?
I use an epub reader like Moon+ with the built in TTS to turn epubs into audiobooks, and I tried Kokoro TTS but the issue was too much lag between sentences plus it doesn't preprocess the next sentence while it reads out the current one.
Working on a reader and server that use pockettts to turn epubs into audio books https://github.com/gabrielcsapo/compendus shows a virtual scroller for the text and audio
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#57What's the actual install size for a working example? Like similar "tiny" projects, do these models actually require installing 1GB+ of dependencies?
Running the example is 3 MiB for the repo, +667 MiB of Python dependencies, +86 MiB of models that will get downloaded from HuggingFace. =756 MiB.
(That's using the example as-is. If you switch it to the smaller model, modify the above with +57 MiB of models from HuggingFace, or =727 MiB.)
So I toyed with this a bit + the Rust library "ort", and ort is only 224M in release (non-debug) mode, and it was pretty simple to run this model with it. (I did not know ort before just now.) I didn't replicate the preprocessing the Python does before running the model, though. (You have to turn the text into an array of floats, essentially; the library is doing text -> phonemes -> tokens; the latter step is straight-forward.)
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#58are there plans to output text alignment?
yes, we just started working on this yesterday haha, great that you mentioned it. once we have it working it'll be out soon.
that would be awesome, I was using pockettts then I had to run it through whisper to get the accurate alignment. Not super productive for realtime work.
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#59What's the actual install size for a working example? Like similar "tiny" projects, do these models actually require installing 1GB+ of dependencies?
My quick test showed 670m of python libraries required on top of the model.
Re: Show HN: Three new Kitten TTS models – smallest less than 25MB
#60There's a number of recent, good quality, small TTS models. If the author doesn't describe some detail about the data, training, or a novel architecture, etc, I only assume they just took another one, do a little finetuning, and repackage as a new product.
Any recommendations?
Depends how small or complex you want a TTS, as flite + flitevox voice packages worked on pi or zynq ARM cpu just fine. =3
Also: