Live data from Hacker News

Whisper – open source speech recognition by OpenAI

openai.com

361–370 of 508 posts

Re: Whisper – open source speech recognition by OpenAI

#361
post #259

We shouldn't call this open source. The model definition + the data is the source code. The model weights are a compilation artifact. > The source code must be the preferred form in which a programmer would modify the program. [...] Intermediate forms such as the output of a preprocessor or translator are not allowed. > https://opensource.org/osd If I asked a programmer from OpenAI to modify the model to better suppo…

Yes. It just like calling the release of compiled closed binary blobs as 'open source' even when the source of reproducing the compiled output is unavailable.

> If I asked a programmer from OpenAI to modify the model to better support Japanese speakers from Hokkaido, their "preferred form" of the model's source code would include the 680,000 hours of audio used to train the model.

Precisely. These 'users' lifting the model can't do it themselves. You will still be contacting OpenAI for support or to add support for another language and they will be the ones able to modify the model.

> Just don't call it open source.

That is true, it is still closed source and already we are seeing the hype squad already apologising to OpenAI as they 'open sourced' a closed model that you can't modify yourself.

OpenAI is still business as usual and nothing has changed.

Re: Whisper – open source speech recognition by OpenAI

#364
post #5

Neat, https://github.com/openai/whisper - they have open-sourced it, even the model weights, so they are living up to their name in this instance. The 4 examples are stunningly good (the examples have speakers with heavy accents, speaking in foreign language, speaking with dynamic background noise, etc.), this is far and away better than anything else I've seen. Will be super curious to see other folks trying it out…

No post body was provided.

Re: Whisper – open source speech recognition by OpenAI

#365
post #118

Earlier quoted context omitted.

The company name could be 100% legit, there is nothing stopping you from a forming a company with that name and not even sell beef.

It definitely happens. There are at least two companies that have branded [..] Kosher Gelatin™. One of them makes gelatin that is considered non-kosher by all of the major kashrus agencies. "Kosher Gelatin®", when in the ingredients, just means the product contains pork.

I believe that you believe this, but you got had. Pretty funny though.

Re: Whisper – open source speech recognition by OpenAI

#366

I tried running it in realtime with live audio input (kind of). If you want to give it a shot, you can find the python script in this repo: https://github.com/tobiashuttinger/openai-whisper-realtime A bit more context on how it works: The systems default audio input is captured with python, split into small chunks and is then fed to OpenAI's original transcription function. It tries (currently rather poorly) to detec…

No post body was provided.

Re: Whisper – open source speech recognition by OpenAI

#367
post #128

Really interesting, I can see ton of potential uses. 2 questions: 1) how does it compare to state of the art FOSS solutions? I'm seeking about DeepSpeech or Vosk 2) would it be somehow possible to associate timestamp to the words recognized? That would be amazing for things such as audio editing or skipping to a particular location on a video

No post body was provided.

Re: Whisper – open source speech recognition by OpenAI

#368

Earlier quoted context omitted.

> I can understand not releasing GPT-3, even if I disagree with the decision. Why do you disagree?

Two reasons. First, someone else will release something similar. Second, I didn’t see a related push from them to work with other in the industry to do something productive towards safety with the time they got by delaying availability of these kinds of models. So it felt disingenuous.

Several groups already have. Facebook's OPT-175B is available to basically anyone with a .edu address (models up to 66B are freely available) and Bloom-176B is 100% open:

https://github.com/facebookresearch/metaseq

https://huggingface.co/bigscience/bloom

Re: Whisper – open source speech recognition by OpenAI

#369
post #220

Cool! I am one of the top contributors to the tiny Mozilla Common Voice data-set for my language. The data-set is very small compared to other popular languages and none of the other mentioned data-sets contribute to that language to train the model of Whisper. And even with so little data to train on it still works surprisingly well.

[zalgo redacted]

Re: Whisper – open source speech recognition by OpenAI

#370

Earlier quoted context omitted.

For a good example of this, read ANY of trumps speaches transcribed.

I mean if you want to make it unnecessarily political, Biden's are worse: https://www.youtube.com/watch?v=3bWM1zsnTJc

Oh no no, i wasn't trying to be political, its just one that I read.. and wow you're right!
Post reply on HN