Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Whisper – open source speech recognition by OpenAI

openai.com

Post reply on HN
Print view View original

381–390 of 508 posts

Re: Whisper – open source speech recognition by OpenAI

#381

Post by adgjlsfhk1 »

mmh0000 wrote: post #131

Okay this is super impressive. I just downloaded Whisper and fed it a random flac file I had handy and it did a really good job. Also impressive that it works on my weak CPU: A 3m07s flac took 5m to transcribe: $ whisper --device cpu 'BLACKPINK - BORN PINK/01 Pink Venom.flac' Detecting language using up to the first 30 seconds. Use `--language` to specify the language Detected language: korean [00:00.000 --> 00:10.00…

For more benchmarks on an rtx 2060 (6gb), the "small" model for me is roughly 10x real-time and the tiny model is 30x real-time.

Re: Whisper – open source speech recognition by OpenAI

#382

Post by mlboss »

NaturalPhallacy wrote: post #348
dreamer7 wrote: post #338

Earlier quoted context omitted.

Did you find out :D?

It was doing it slowly , but hadn't got to the insane bit when I killed it to try and get it working with CUDA, so I had to do some digging and it turns out I need a version of pytorch with CUDA enabled, and so I had to go and install Anaconda, and now now conda is stuck trying to "solve" my environment to install pytorch with CUDA. So...probably? Pre-post edit: I can't get it to work. I've installed pytorch with cud…

Try running pytorch/pytorch docker. But you will need nvidia container runtime installed. I am sure somebody will soon release docker for this also.

Re: Whisper – open source speech recognition by OpenAI

#383

Post by DLeychIC »

pen2l wrote: post #5

Neat, https://github.com/openai/whisper - they have open-sourced it, even the model weights, so they are living up to their name in this instance. The 4 examples are stunningly good (the examples have speakers with heavy accents, speaking in foreign language, speaking with dynamic background noise, etc.), this is far and away better than anything else I've seen. Will be super curious to see other folks trying it out…

No post body was provided.

Re: Whisper – open source speech recognition by OpenAI

#384

Post by bruckie »

capableweb wrote: post #262
Snitch-Thursday wrote: post #91

Earlier quoted context omitted.

Google's recorder app for android will let you record audio files and make some transcriptions, right on the device.

Is that application actually doing on-device transcription? Under "Data safety" on the Google Play page it says "This app may share these data types with third parties: Audio" which doesn't exactly instill confidence that my audio will 100% always stay on my device. It also says "Data is encrypted in transit" but if data stays on the device, why it has to be "encrypted in transit"? There should be no transit at all.

Yes, it works completely offline, including transcription and recognition of music. There's an optional cloud sync feature, which I assume is the reason for the notice on Google Play.

(Work for Google, don't speak for them.)

Re: Whisper – open source speech recognition by OpenAI

#385

Post by solarmist »

moyix wrote: post #368
solarmist wrote: post #125

Earlier quoted context omitted.

Two reasons. First, someone else will release something similar. Second, I didn’t see a related push from them to work with other in the industry to do something productive towards safety with the time they got by delaying availability of these kinds of models. So it felt disingenuous.

Several groups already have. Facebook's OPT-175B is available to basically anyone with a .edu address (models up to 66B are freely available) and Bloom-176B is 100% open: https://github.com/facebookresearch/metaseq https://huggingface.co/bigscience/bloom

Yup. I meant when it had just come out.

Re: Whisper – open source speech recognition by OpenAI

#386

Post by visarga »

freedomben wrote: post #351
no1youknowz wrote: post #214

This is awesome. But I really want the other way. To be able to give it text and hear the speech. A TTS (text to speech). As a language learner, the ability to create my own sentences (based on existing ones I have, in changing a word here or there). Would be amazing. How long till we have this I wonder. I know I could use a service to do this currently. But having something running locally, I'd prefer. Hopefully som…

Likewise, TTS is what I really want. My goal is to be able to create audio books from text. I've been using Amazon Polly and it's acceptable quality, but I would be ecstatic to be able to do it locally on my own hardware.

Check out NaturalReader. It has hundreds of amazing voices, a system for highlighting text as it is being read, works on books (pdf) and webpages, and is available on phones and in browsers on all platforms. So I could have the same voice on Mac, Linux and iPhone.

Re: Whisper – open source speech recognition by OpenAI

#387

Post by boundlessdreamz »

frognumber wrote: post #344
anigbrowl wrote: post #213

Earlier quoted context omitted.

By the time you're prosecuting someone in court, yes of course you double, triple, quadruple check everything. That's why lawyers get paid the big bucks (for now...). But yes you can identify which content probably has errors and flag it as such. Look, I have decades of experience dealing with human speech, and not just as an editor - I can trace the human voice from neural impulses in Broca's region through the phys…

What tools do you use to do this? I once hacked together an editor like this maybe a decade ago -- edit speech as text from OCR -- and sorely need one now. Alignment of video to text is a big problem for me too.

This can be done via https://www.descript.com/ You can edit video/audio by editing the transcript.

You can even add/modify words that weren't originally there https://www.descript.com/overdub

Re: Whisper – open source speech recognition by OpenAI

#388

Post by visarga »

TaylorAlexander wrote: post #264
no1youknowz wrote: post #214

This is awesome. But I really want the other way. To be able to give it text and hear the speech. A TTS (text to speech). As a language learner, the ability to create my own sentences (based on existing ones I have, in changing a word here or there). Would be amazing. How long till we have this I wonder. I know I could use a service to do this currently. But having something running locally, I'd prefer. Hopefully som…

I suspect this is coming. I mean we do have decent text to speech systems already, but in this vein of “we used neural networks and now it’s very very good” you can imagine that with something like GPT-3, to extend it they could use this speech to text system so you could speak to it for input, and then a natural progression is that it can use text to speech to return the output, so you just have a voice oriented con…

A full NLP system would include speech recognition, TTS, a large language model, and a vector search engine. The LM should be multi modal, multi language and multi task, "multi-multi-model" for short haha. I'm wondering when we'll have this stack as default on all OSes. We want to be able to search, transcribe, generate speech, run NLP tasks on the language model and integrate with external APIs by intent detection.

On the search part there are lots of vector search companies - Weaviate, Deepset Haystack, Milvus, Pinecone, Vespa, Vald, GSI and Qdrant. But it has not become generally deployed on most systems, people are just finding out about the new search system. Large language models are still difficult to run locally. And all these models would require plenty of RAM and GPU. So the entry barrier is still high.

Re: Whisper – open source speech recognition by OpenAI

#390

Post by Tomis02 »

toss1 wrote: post #123

Like every model I've seen there is something like this: >>A decoder is trained to predict the corresponding text... Prediction of expected text in the context of the previous text. While this is valuable in casual transcription, it can be extremely dangerous in serious contexts. From personal experience, having given a deposition with an "AI" transcription, it will literally reverse the meanings of sentences. This i…

I've been saying this for years. Current "AI" algorithm are fundamentally flawed because they rely on a statistical approach. This works moderately well for some use cases but it will rarely give you 100% confidence. Good luck with self-flying planes or self-running nuclear power plants.
Post reply on HN