Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Whisper – open source speech recognition by OpenAI

openai.com

Post reply on HN
Print view View original

11–20 of 508 posts

Re: Whisper – open source speech recognition by OpenAI

#12

Post by jfoster »

samstave wrote: post #7

AI speech recognition FN scares the heck out of me... for so many reasons. But one that really pisses me off is not being able to turn it off on the iphone, and the fact that aside from "hidden cameras in my airBnB" -- soon we will have to worry about secret listening machines EVERYWHERE

Also, based on their demo, this model seems like it might have comprehension well above the level of a typical human.

Anyway, it's out there now. No way to turn back.

Re: Whisper – open source speech recognition by OpenAI

#15

Post by StevenWaterman »

jfoster wrote: post #10

It seems like OpenAI are finally living up to their name for once with this release? Anything I'm missing? From what I can gather: 1. Includes model weights. I can't find the URL, but they reference them enough and have a CLI tool, so I presume I just haven't found them yet. 2. Includes code: https://github.com/openai/whisper 3. Released under MIT License: https://github.com/openai/whisper/blob/main/LICENSE

(Model weights from https://github.com/openai/whisper/blob/main/whisper/__init__... )

"tiny.en": "https://openaipublic.azureedge.net/main/whisper/models/d3dd5..."

"tiny": "https://openaipublic.azureedge.net/main/whisper/models/65147..."

"base.en": "https://openaipublic.azureedge.net/main/whisper/models/25a85..."

"base": "https://openaipublic.azureedge.net/main/whisper/models/ed3a0..."

"small.en": "https://openaipublic.azureedge.net/main/whisper/models/f953a..."

"small": "https://openaipublic.azureedge.net/main/whisper/models/9ecf7..."

"medium.en": "https://openaipublic.azureedge.net/main/whisper/models/d7440..."

"medium": "https://openaipublic.azureedge.net/main/whisper/models/345ae..."

"large": "https://openaipublic.azureedge.net/main/whisper/models/e4b87..."

Re: Whisper – open source speech recognition by OpenAI

#16

Post by wongarsu »

samstave wrote: post #7

AI speech recognition FN scares the heck out of me... for so many reasons. But one that really pisses me off is not being able to turn it off on the iphone, and the fact that aside from "hidden cameras in my airBnB" -- soon we will have to worry about secret listening machines EVERYWHERE

"Secret listening machines everywhere" was a pretty big thing in East Germany. It's also the central theme of the movie The Lives of Others.

Of course, the ability to scale this more cheaply (throwing more compute at it, instead of more people) is somewhat scary, but it's not really introducing a new capability. Especially since you still have to do something with the transcript. An AirBnB landlord who reads the transcript of what you said could as well have listened to the recording.

Re: Whisper – open source speech recognition by OpenAI

#17

Post by StevenWaterman »

IceWreck wrote: post #11

Is there a list of system requirements somewhere ? Can it run on cheaper low memory GPUs ? maybe CPUs ?

Their models range from 70mb to 3gb. The largest model is smaller than the optimised stable diffusion. Not sure what the inference speed is like, haven't tried it myself yet.

Re: Whisper – open source speech recognition by OpenAI

#18

Post by ironlake »

Simorgh wrote: post #6

I’ve been experimenting with voice-interfaces where typing is replaced by talking, but I find it hard to transition users to voice - we ‘seem’ to prefer typing to talking. I wonder if this will change.

Personally, I would rather type than talk when interacting with a computer. The only time I use voice interfaces are when the physical interface is so poor it's just easier to use voice. Apple TV devices are an example of this.

Re: Whisper – open source speech recognition by OpenAI

#19

Post by gok »

Comparing this model's word error rates to the state of the art [1] on a few common test sets:

                           Whisper    SoTA
  LibriSpeech test-clean      2.7%     1.8%
  LibriSpeech test-other      5.6%     2.9%
  Switchboard                13.1%     4.9%
  CallHome                   15.8%     9.5%
The authors do explicitly state that they're trying to do a lot of fancy new stuff here, like be multilingual, rather than pursuing just accuracy.

[1] https://github.com/syhw/wer_are_we

Re: Whisper – open source speech recognition by OpenAI

#20

Post by mmastrac »

StevenWaterman wrote: post #15
jfoster wrote: post #10

It seems like OpenAI are finally living up to their name for once with this release? Anything I'm missing? From what I can gather: 1. Includes model weights. I can't find the URL, but they reference them enough and have a CLI tool, so I presume I just haven't found them yet. 2. Includes code: https://github.com/openai/whisper 3. Released under MIT License: https://github.com/openai/whisper/blob/main/LICENSE

(Model weights from https://github.com/openai/whisper/blob/main/whisper/__init__... ) "tiny.en": " https://openaipublic.azureedge.net/main/whisper/models/d3dd5... " "tiny": " https://openaipublic.azureedge.net/main/whisper/models/65147... " "base.en": " https://openaipublic.azureedge.net/main/whisper/models/25a85... " "base": " https://openaipublic.azureedge.net/main/whisper/models/ed3a0... " "small.en": " https://op…

Large is 3GB to save everyone a click. Tiny is 72MB.
Post reply on HN