Live data from Hacker News

VibeVoice: Open-source frontier voice AI

github.com

11–20 of 191 posts

Re: VibeVoice: Open-source frontier voice AI

#11
post #9

Isn't this project the one Microsoft published but then soon after pulled it for security/safety reasons? What has changed since then?

Look at the "News" section in the readme - The original TTS model is gone from this repo (you can still find it other places), but the SST/ASR, long form TTS, and streaming TTS models are newer.

[flagged]

Re: VibeVoice: Open-source frontier voice AI

#13
I the past month or so, I added 2 models to my app Whisper Memos (https://whispermemos.com):

- Cohere Transcribe (self hosted)

- Grok Speech To Text (they provide an API, only $0.10/hr!)

They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?

Re: VibeVoice: Open-source frontier voice AI

#15

This is not a new model. Also, it hallucinates a lot. Also, it's very heavy and slow in inference. It's also bad in multilingual. Edit: I'm talking purely about speech to text (STT). Not sure about the other things this can do.

Yeah, I don't get why it is suddenly getting so much attention today, it is all over twitter too

Re: VibeVoice: Open-source frontier voice AI

#18
post #13

I the past month or so, I added 2 models to my app Whisper Memos ( https://whispermemos.com ): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?

I've had good experiences with the Mistral Voxtral models (I've used the API, but some of the model-variants are open weight)

Re: VibeVoice: Open-source frontier voice AI

#19
post #14

I think we should stop calling this type of models open source. They are indeed "open weight." The training code is proprietary and never revealed. https://github.com/microsoft/VibeVoice/issues/102

> we should stop calling this type of model open source. They are indeed "open weight”

This ship has sailed. It’s now in the same category as hacker/cracker and the pronunciation of GIF.

Re: VibeVoice: Open-source frontier voice AI

#20
post #13

I the past month or so, I added 2 models to my app Whisper Memos ( https://whispermemos.com ): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?

Have you tried qwen?
Post reply on HN