Isn't this project the one Microsoft published but then soon after pulled it for security/safety reasons? What has changed since then?
Look at the "News" section in the readme - The original TTS model is gone from this repo (you can still find it other places), but the SST/ASR, long form TTS, and streaming TTS models are newer.
VibeVoice: Open-source frontier voice AI
11–20 of 191 posts
Re: VibeVoice: Open-source frontier voice AI
#12Re: VibeVoice: Open-source frontier voice AI
#13- Cohere Transcribe (self hosted)
- Grok Speech To Text (they provide an API, only $0.10/hr!)
They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?
Re: VibeVoice: Open-source frontier voice AI
#14Re: VibeVoice: Open-source frontier voice AI
#15This is not a new model. Also, it hallucinates a lot. Also, it's very heavy and slow in inference. It's also bad in multilingual. Edit: I'm talking purely about speech to text (STT). Not sure about the other things this can do.
Re: VibeVoice: Open-source frontier voice AI
#16Re: VibeVoice: Open-source frontier voice AI
#17Re: VibeVoice: Open-source frontier voice AI
#18I the past month or so, I added 2 models to my app Whisper Memos ( https://whispermemos.com ): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?
Re: VibeVoice: Open-source frontier voice AI
#19I think we should stop calling this type of models open source. They are indeed "open weight." The training code is proprietary and never revealed. https://github.com/microsoft/VibeVoice/issues/102
This ship has sailed. It’s now in the same category as hacker/cracker and the pronunciation of GIF.
Re: VibeVoice: Open-source frontier voice AI
#20I the past month or so, I added 2 models to my app Whisper Memos ( https://whispermemos.com ): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?