Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Whisper – open source speech recognition by OpenAI

openai.com

Post reply on HN
Print view View original

421–430 of 508 posts

Re: Whisper – open source speech recognition by OpenAI

#421

Post by adeptima »

gzer0 wrote: post #271
adeptima wrote: post #209

Japanese results looks pretty impressive! Took マッコウクジラ14頭が海岸に打ち上げられる オーストラリア(2022年9月21日) https://www.youtube.com/watch?v=bZkNIzeRBk4 Extracted audio with youtube-dl -f bestaudio https://www.youtube.com/watch\?v\=bZkNIzeRBk4 Converted into [00:00.000 --> 00:13.000] オーストラリア南部の島で、真っ向くじら14棟が海岸に打ち上げられて死んでいるのが見つかり、専門家が調査のため原地入りしました。 [00:13.000 --> 00:25.000] 原地メディアによりますと、オーストラリア南部のキング棟で、19日、少なくとも14棟の真っ向くじらが海岸に打ち上げられて死んでいるの…

Shocked at how good the results are, and how easy of an installation it is. Here are the exact steps to follow to get it running on Ubuntu 22.04 via WSL and yt-dlp: 1. pip install git+https://github.com/openai/whisper.git 2. yt-dlp -f 'ba' -x --audio-format mp3 https://www.youtube.com/watch/?v\=bZkNIzeRBk4 3. renamed the file to test.mp3 4. whisper test.mp3 --language Japanese --task translate --model large Note: the…

"--model large" option produces much better results at higher resources consuming costs

Re: Whisper – open source speech recognition by OpenAI

#422

Post by quickthrower2 »

quickthrower2 wrote: post #355
Workaccount2 wrote: post #221

Earlier quoted context omitted.

Can't wait to see twelve new $49.99/mo speech parser services pop up in the next few weeks.

Make hay before Google gives away free hay. That said there is value in integration of this into other things.

This has been running on my laptop all day for a 15 min mp3! Definitely not cheap to run then (wont imagine how much AWS compute cost is required).

Re: Whisper – open source speech recognition by OpenAI

#424

Post by dang »

catfan wrote: post #369
Jnr wrote: post #220

Cool! I am one of the top contributors to the tiny Mozilla Common Voice data-set for my language. The data-set is very small compared to other popular languages and none of the other mentioned data-sets contribute to that language to train the model of Whisper. And even with so little data to train on it still works surprisingly well.

[zalgo redacted]

Hey - can you please not zalgo on HN? It messes up the threads. I've redacted it from your posts now.

Re: Whisper – open source speech recognition by OpenAI

#425

Post by thuttinger »

kkielhofner wrote: post #373
thuttinger wrote: post #280

I tried running it in realtime with live audio input (kind of). If you want to give it a shot, you can find the python script in this repo: https://github.com/tobiashuttinger/openai-whisper-realtime A bit more context on how it works: The systems default audio input is captured with python, split into small chunks and is then fed to OpenAI's original transcription function. It tries (currently rather poorly) to detec…

Haven’t tried it yet but love the concept! Have you thought of using VAD (voice activity detection) for breaks? Back in my day (a long time ago) the webrtc VAD stuff was considered decent: https://github.com/wiseman/py-webrtcvad Model isn’t optimized for this use but I like where you’re headed!

Interesting. I'll take a look at this, thanks!

Re: Whisper – open source speech recognition by OpenAI

#426

Post by amelius »

soheil wrote: post #75
pen2l wrote: post #5

Neat, https://github.com/openai/whisper - they have open-sourced it, even the model weights, so they are living up to their name in this instance. The 4 examples are stunningly good (the examples have speakers with heavy accents, speaking in foreign language, speaking with dynamic background noise, etc.), this is far and away better than anything else I've seen. Will be super curious to see other folks trying it out…

Quoted post unavailable.

If consumer laws are so easily circumvented then I have little respect for those making these laws.

Re: Whisper – open source speech recognition by OpenAI

#427

Post by olao99 »

Snitch-Thursday wrote: post #91
TaylorAlexander wrote: post #31

Hey this looks great! I like to record audio notes while driving in my car after work, to kind of decompress my thoughts from the day. But I never go back and listen as they can be long and meandering. Sometimes in the audio log I will sum up my thoughts, but this might be 20 minutes in and hard to find. I really wish I had transcriptions so I could easily scan the full contents. I have tried Mozilla Deepspeech (I do…

Google's recorder app for android will let you record audio files and make some transcriptions, right on the device.

Google's recorder app is NOT available for most phones. Only Pixels and a couple of other selected handsets

Re: Whisper – open source speech recognition by OpenAI

#428

Post by jfoster »

zarzavat wrote: post #402
jfoster wrote: post #93

Earlier quoted context omitted.

True. The potential of GPT-3 to cause internet mayhem was/is significant. I would argue that the mere act of announcing it was still a catalyst for an eventual GPT-3-like model being released. In revealing it, they established a target for what open source models could aim to achieve, and simultaneously got bad actors thinking about ways to abuse it.

It was a credible argument when GPT-3 was released. But now there are open models that are as capable as GPT-3 and that mayhem has not materialized, with the possible exception of GPT-4chan. They could release it now under a non-commercial license, if they cared to.

Can you provide an example of an open model as capable as GPT-3?

I know there's some "mini-GPT" type models around, but they don't seem nearly as capable.

Re: Whisper – open source speech recognition by OpenAI

#429

Post by olao99 »

MacsHeadroom wrote: post #186
dom96 wrote: post #163

This really makes me want to build a Amazon Echo/Google Nest/etc replacement that's open hardware, open source and most importantly recognises voice completely offline. I find that I don't use these smart devices for much more than setting timers anyway so this seems like an easy project. I just wonder what system requirements Whisper has and whether there are open source voice recognition models that are specificall…

I really want all this too. The smallest model is ~80mb and the largest is 3gb. Not sure about system requirements yet; but models that small suggest this may be doable locally on a single board computer. Edit: According to this comment[0] the base model runs in real time on an M1 CPU. The tiny model apparently decodes an audio file twice as fast. These are promising results. [0] https://news.ycombinator.com/item?id=…

To be more precise the original comment said "M1 Max" which in itself is significantly beefier a bare "M1"

Re: Whisper – open source speech recognition by OpenAI

#430

Post by olao99 »

magicalhippo wrote: post #278
mwlp wrote: post #233

Super impressive. I tested it on a Japanese streamer whose enunciation isn't exactly perfect and it did a decent job: https://www.youtube.com/watch?v=ROiOU1scaNA [00:00.000 --> 00:06.500] Since the last one started, the number of times I've eaten has decreased. [00:06.500 --> 00:11.000] If I get too carried away with the last one, I'll get hungry and do it. [00:11.000 --> 00:14.500] I don't have time to eat. [00:15.5…

It's struggling with Norwegian. Which I guess isn't shocking. The large model performs a fair bit better than the small, though neither is "good". Though I assume the amount of Norwegian it has been exposed to is fairly limited, so in that light I'm actually impressed as well. I tried it on a news segment from the radio[1], this is the large model output: [00:14.000 --> 00:17.200] En skamløs krenking av FN pakten. [0…

How are you getting the transcription of the NRK episode? I am learning Norwegian and often struggle to find reliable transcriptions for audio where the text exactly matches the audio (often subtitles are heavily edited compared to what's actually being said)
Post reply on HN