Live data from Hacker News

Whisper – open source speech recognition by OpenAI

openai.com

491–500 of 508 posts

Re: Whisper – open source speech recognition by OpenAI

#491

Earlier quoted context omitted.

What tools do you use to do this? I once hacked together an editor like this maybe a decade ago -- edit speech as text from OCR -- and sorely need one now. Alignment of video to text is a big problem for me too.

This can be done via https://www.descript.com/ You can edit video/audio by editing the transcript. You can even add/modify words that weren't originally there https://www.descript.com/overdub

Thank you!

Re: Whisper – open source speech recognition by OpenAI

#492
post #85

Earlier quoted context omitted.

>~97% accuracy over hour-long conversations. I'm sure it's been an absolute godsend for law enforcement 97% accuracy means roughly three or four errors per minute of speech. That seems potentially extremely problematic for something like law enforcement use where decisions with significant impact on people's day and/or life might be made on the basis of "evidence".

No it isn't. That just means 2-3% of your content needs to be double-checked by a person at the audio level, saving huge amounts of time - equally true of human transcription, in which individual words are often [UNINTELLIGEBLE]. Would you want to review this fully before going into court, absolutely - because you'd want to play the recording to a jury for emotional impact. Can you rely on it when you want to quickly…

Sometimes even human will disagree about what was said in a recording - I had this happen recently. I heard a specific sentence, the other person heard the exact opposite. I cannot say who was right, even after listening to the recording several times on headphones and speakers I'm as certain of my interpretation as was the other party.

Re: Whisper – open source speech recognition by OpenAI

#493
post #477

I know this isn't a tech support forum but maybe someone here knows. I'm attempting the sample python code from the github and almost get a transcription running on my work laptop without a GPU, but I run into this error message: >>> result = whisper.decode(model, mel, options) Traceback (most recent call last): [snip] RuntimeError: "slow_conv2d_cpu" not implemented for 'Half' It looks like a Torch error, is there so…

I am running on work laptop not using GPU. (I'm running in docker). I just get warnings.warn("FP16 is not supported on CPU; using FP32 instead") And it works.

It seems the cmdline script is smart enough to switch over automatically, but invoking it from python just fails if the correct option isn't set

Re: Whisper – open source speech recognition by OpenAI

#494
This is awesome to see! Our team at Shipyard [1] has been creating a lot of solution videos on YouTube recently to show teams how they can build A -> B solutions in a few minutes. We've been meaning to provide captions or transcripts for the backlog, but the overhead was either pretty high or too expensive.

Tested this out in the span of a few hours and got a solution up and running to download the video from Youtube, spit out the transcription and upload the resulting transcription file externally. We're still missing a piece to upload directly to YouTube, but it's a start!

As a part of this experiment, we built out some templates that will allow anyone to play around with Whisper in our platform. If you're interested in seeing it, we built a video for doing the process with our templates [2], or directly with Python [3].

Hope someone finds this useful!

[1] https://www.shipyardapp.com [2] https://www.youtube.com/watch?v=XGr4v3aY1e8 [3] https://www.youtube.com/watch?v=xfJpGgyUkvM

Re: Whisper – open source speech recognition by OpenAI

#495
post #458
post #47

Earlier quoted context omitted.

At the start, the "Nous établissons" part, for example. You wouldn't write that if you were starting scratch from French.

That's the first thing that I discovered when I visited Paris for the first time. No one says "Nous", there, ever. Perhaps the politicians, while giving a speech. Everyone else uses the more informal "On". I felt duped by my French classes.

Older generations sometimes do. My grandma and her sisters nearly never uses "on".

It is often used for larger groups or when the group is not very personally connected. For instance when talking about your company doing something you will often use "nous". I would also use "nous" to refer to the whole list of invitees to a wedding. And in formal contextes like research papers, reports etc. You would never use "on", always "nous".

Re: Whisper – open source speech recognition by OpenAI

#496

Earlier quoted context omitted.

It's struggling with Norwegian. Which I guess isn't shocking. The large model performs a fair bit better than the small, though neither is "good". Though I assume the amount of Norwegian it has been exposed to is fairly limited, so in that light I'm actually impressed as well. I tried it on a news segment from the radio[1], this is the large model output: [00:14.000 --> 00:17.200] En skamløs krenking av FN pakten. [0…

Re-reading the transcription, I guess I was a bit harsh by saying it's not "good". It gets most of it right, but it keeps messing up some key words. Like "regnstyr" (not a word) rather than "reinsdyr" (reindeer), or "Dagsnytten" rather than "Dagsnytt 18". It also didn't handle the hanging "... menn", instead thinking it was the start of the following sentence. Almost everyone would understand it was the end of the se…

I am impressed; some of the words are not that common, such as atomtrusler, krigsmobilisering, strømselskaper and dyrevernsorganisasjon, yet it got them correctly

Re: Whisper – open source speech recognition by OpenAI

#498

Earlier quoted context omitted.

I wouldn't really say Stable Diffusion marks images as AI-generated. There's a script in the Stable Diffusion repository that will do that, but it's not connected to the model itself in a meaningful way. I use Stable Diffusion a lot and I've never touched this script. https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a...

What "script" are you using for doing txt2img? The watermark function is automatically called when you use the CLI in two places, https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a... and https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a... Trivial to remove, I give you that. But AFAIK, the original repository + most forks put the watermark automatically unless you've removed it on your own.

I linked to the same file you did, that is the "script" I was referring to. And I said that I didn't use it.

My point is that the Python API is more interesting than the txt2img script, and it doesn't add any watermarks.

Re: Whisper – open source speech recognition by OpenAI

#499

Earlier quoted context omitted.

> It's one model and in a non-strategic area where there are existing open source projects (Kaldi, DeepSpeech, ...). I can already tell this is much better than any of the existing open source projects with the exception of the wav2* sequence of projects and potentially nvidia's nemo.

Kaldi is an open, pluggable framework and is a ton more flexible and powerful than this. It's used by hundreds of teams, including a number of consumer tech companies you've heard of. They're not going to move to this over it. Especially because ASR is a living organism. You have to constantly update your language model as new people, ideas, and words move into the normal lexicon. As people start talking about "COVID…

Have you actually tried to use Kaldi though? I have. It's basically impenetrable unless your full time job is working with Kaldi.
Post reply on HN