Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

github.com

Post reply on HN
Print view View original

311–320 of 383 posts

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#311

Post by divamgupta »

peanut_merchant wrote: post #269

I ran some quick benchmarks. Ubuntu 24, Razer Blade 16, Intel Core i9-14900HX Performance Results: Initial Latency: ~315ms for short text Audio Generation Speed (seconds of audio per second of processing): - Short text (12 chars): 3.35x realtime - Medium text (100 chars): 5.34x realtime - Long text (225 chars): 5.46x realtime - Very Long text (306 chars): 5.50x realtime Findings: - Model loads in ~710ms - Generates a…

Thanks for running the benchmarks. Currently the models are not optimized yet. We will optimize loading etc when we release an SDK meant for production :)

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#312

Post by divamgupta »

sergiotapia wrote: post #274
smusamashah wrote: post #139

Earlier quoted context omitted.

The reddit video is awesome. I don't understand how people are calling it an OK model. Under 25MB and cpu only for this quality is amazing.

https://vocaroo.com/1njz1UwwVHCF It doesn't sound so good. Excellent technical achievement and it may just improve more and more! But for now I can't use it for consumer facing applications.

We are still training the model. We expect the quality to go up in the next release. This is just a preview release :)

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#314

Post by divamgupta »

nine_k wrote: post #3

I hope this is the future. Offline, small ML models, running inference on ubiquitous, inexpensive hardware. Models that are easy to integrate into other things, into devices and apps, and even to drive from other models maybe.

This is our goal too.

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#315

Post by bornfreddy »

Aachen wrote: post #203
mlboss wrote: post #9

Reddit post with generated audio sample: https://www.reddit.com/r/LocalLLaMA/comments/1mhyzp7/kitten_...

Impressive technical achievement, but in terms of whether I'd use it: oof, that male voice is like one of these fake-excited newsreaders. Like they're always at the edge of their breath. The female one is better but still someone reading out an advertisement for a product they were told they must act extra excited for. I assume this is what the majority of training data was like and not an intentional setting for the…

RHvoice is pretty good, imho.

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#316

Post by divamgupta »

WhyNotHugo wrote: post #135
nine_k wrote: post #3

I hope this is the future. Offline, small ML models, running inference on ubiquitous, inexpensive hardware. Models that are easy to integrate into other things, into devices and apps, and even to drive from other models maybe.

Dedicated single-purpose hardware with models would be even less energy-intensive. It's theoretically possible to design chips which run neural networks and alike using just resistors (rather than transistors). Such hardware is not general-purpose, and upgrading the model would not be possible, but there's plenty of use-cases where this is reasonable.

The thing is that the new models keep coming every day. So it’s economically not feasible to make chips for a single model

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#317

Post by debugnik »

turnsout wrote: post #271
antisol wrote: post #103

System Requirements Works literally everywhere Haha, on one of my machines my python version is too old, and the package/dependencies don't want to install. On another machie the python version is too new, and the package/dependencies don't want to install.

You're getting a lot of comments along the lines of "Why don't you just ____," which only shows how Stockholmed the entire Python community is. With no other language are you expected to maintain several entirely different versions of the language, each of which is a relatively large installation. Can you imagine if we all had five different llvms or gccs just to compile five different modern C projects? I'm going to…

I agree with your point, but

> if we all had five different llvms or gccs

Oof, those are poor examples. Most compilers using LLVM other than clang do ship with their own LLVM patches, and cross-compiling with GCC does require installing a toolchain for each target.

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#318

Post by divamgupta »

bouchard wrote: post #275
darkwater wrote: post #266

Earlier quoted context omitted.

Nope, looks like the default voice is the worst and it's not in the demo. A Reddit user generated these as well https://limewire.com/d/28CRw#UPuRLynIi7

Never thought I'd see the name LimeWire again, wow

Haha interesting pivot!

Re: Show HN: Kitten TTS – 25MB CPU-Only, Open-Source TTS Model

#320

Post by divamgupta »

Aachen wrote: post #203
mlboss wrote: post #9

Reddit post with generated audio sample: https://www.reddit.com/r/LocalLLaMA/comments/1mhyzp7/kitten_...

Impressive technical achievement, but in terms of whether I'd use it: oof, that male voice is like one of these fake-excited newsreaders. Like they're always at the edge of their breath. The female one is better but still someone reading out an advertisement for a product they were told they must act extra excited for. I assume this is what the majority of training data was like and not an intentional setting for the…

Thanks a lot for the detailed feedback. We are working on some models which do not use a phonemizer
Post reply on HN