VibeVoice: Open-source frontier voice AI • Hacker News Board

Re: VibeVoice: Open-source frontier voice AI

#21

Post by internet_points » Tue, Apr 28, 2026, 1:21 PM UTC

giarc wrote: post #6

podgietaru wrote: post #3

So we've really just settled on Vibe as the verb for AI then?

I'd be willing to bet it will be "Word of the Year" for 2026. Merriam-Webster had 'slop' for 2025, and 'polarization' for 2024. Is there a prediction market for this?

it'll probably be something we're not even talking about yet - we still have 7 months in which to make the world even worse

Re: VibeVoice: Open-source frontier voice AI

#22

Post by SecretDreams » Tue, Apr 28, 2026, 1:21 PM UTC

steinvakt2 wrote: post #10

This is not a new model. Also, it hallucinates a lot. Also, it's very heavy and slow in inference. It's also bad in multilingual. Edit: I'm talking purely about speech to text (STT). Not sure about the other things this can do.

[flagged]

Re: VibeVoice: Open-source frontier voice AI

#23

Post by andy_ppp » Tue, Apr 28, 2026, 1:21 PM UTC

JumpCrisscross wrote: post #19

maxloh wrote: post #14

I think we should stop calling this type of models open source. They are indeed "open weight." The training code is proprietary and never revealed. https://github.com/microsoft/VibeVoice/issues/102

> we should stop calling this type of model open source. They are indeed "open weight” This ship has sailed. It’s now in the same category as hacker/cracker and the pronunciation of GIF.

I think you mean GIF.

Re: VibeVoice: Open-source frontier voice AI

#24

Post by SecretDreams » Tue, Apr 28, 2026, 1:22 PM UTC

Void_ wrote: post #13

I the past month or so, I added 2 models to my app Whisper Memos ( https://whispermemos.com ): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?

Any non-Musk alternatives that are comparable in quality and cost?

Re: VibeVoice: Open-source frontier voice AI

#25

Post by JumpCrisscross » Tue, Apr 28, 2026, 1:23 PM UTC

CubsFan1060 wrote: post #2

Great post last night from Simon: https://simonwillison.net/2026/Apr/27/vibevoice/

“VibeVoice can only handle up to an hour of audio”

Why?

Re: VibeVoice: Open-source frontier voice AI

#26

Post by ramon156 » Tue, Apr 28, 2026, 1:24 PM UTC

lblock wrote: post #15

steinvakt2 wrote: post #10

This is not a new model. Also, it hallucinates a lot. Also, it's very heavy and slow in inference. It's also bad in multilingual. Edit: I'm talking purely about speech to text (STT). Not sure about the other things this can do.

Yeah, I don't get why it is suddenly getting so much attention today, it is all over twitter too

well duh, they updated the news section

https://github.com/microsoft/VibeVoice/commit/e73d1e17c3754f...

which is microsoft for "we removed two dead links". AI innovation knows no limits!

Re: VibeVoice: Open-source frontier voice AI

#27

Post by JumpCrisscross » Tue, Apr 28, 2026, 1:26 PM UTC

What’s the current state of the art, for each of training locally and in the cloud, for learning my voice?

Re: VibeVoice: Open-source frontier voice AI

#28

Post by aqme28 » Tue, Apr 28, 2026, 1:27 PM UTC

Interesting to see "vibe" enshrined by the likes of Microsoft as an AI product word.

Re: VibeVoice: Open-source frontier voice AI

#29

Post by BlastBash192 » Tue, Apr 28, 2026, 1:28 PM UTC

Maybe Microsoft’s real strength was never making the best model, it was knowing you don’t need to, as long as you own the platform everyone builds on.

Re: VibeVoice: Open-source frontier voice AI

#30

Post by Void_ » Tue, Apr 28, 2026, 1:29 PM UTC

SecretDreams wrote: post #24

Void_ wrote: post #13

I the past month or so, I added 2 models to my app Whisper Memos ( https://whispermemos.com ): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?

Any non-Musk alternatives that are comparable in quality and cost?

Our default is still OpenAI Whisper. Grok is just a choice for users who might prefer it.