Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Whisper – open source speech recognition by OpenAI

openai.com

Post reply on HN
Print view View original

111–120 of 508 posts

Re: Whisper – open source speech recognition by OpenAI

#111

Post by gs17 »

thfuran wrote: post #85
anigbrowl wrote: post #74

Earlier quoted context omitted.

It was already better. I edit a podcast and have > a decade of pro audio editing experience in the film industry, and I was already using a commercial AI transcription service to render the content to text and sometimes edit it as such (outputting edited audio). Existing (and affordable) offerings are so good that they can cope with shitty recordings off a phone speaker and maintain ~97% accuracy over hour-long conve…

>~97% accuracy over hour-long conversations. I'm sure it's been an absolute godsend for law enforcement 97% accuracy means roughly three or four errors per minute of speech. That seems potentially extremely problematic for something like law enforcement use where decisions with significant impact on people's day and/or life might be made on the basis of "evidence".

Yeah, I tried to use automated transcription for a research project and we had to do it all manually because the few errors (I would say it did pretty well given our recording quality) were often dropping words like "not", which changed the whole meaning of a sentence! It was a useful assistance during transcription, but I really hope they would verify it was correct before arresting anyone based on it.

Re: Whisper – open source speech recognition by OpenAI

#112

Post by obscur »

kiwih wrote: post #102

Given this, are there good (and available/open source) models for text to speech? Last time I tried everything still sounded extremely robotic, and/or were a pain to set up and run. It would be fun to set up a pipeline where the two processes 'communicate'.

Measuring performance in rounds of successful Chinese whisper

(irony)

Re: Whisper – open source speech recognition by OpenAI

#114

Post by fxtentacle »

The5thElephant wrote: post #26

How is it Apple, Google, or Microsoft are not further ahead of the game on speech recognition like this? They have the resources to hire the best ML researchers and throw tons of computing hours at it, yet Siri, Google, and Cortana continue to struggle to get anywhere near this level of comprehension.

This AI has a 30 second delay on the audio processing because it needs to be able to "look into the future" to get these good results. That 30s delay would be unacceptable for Siri/Google/Cortana.

Re: Whisper – open source speech recognition by OpenAI

#115

Post by kif »

kif wrote: post #113
hijp wrote: post #88

Anyone get it running on m1 mac? I keep getting `ModuleNotFoundError: No module named 'setuptools.command.build'`

I got requirements installed, but then when running the Python example, I get: RuntimeError: "slow_conv2d_cpu" not implemented for 'Half'

Probably need to pass some kind of options when initializing. The command itself works fine, just shows a warning: warnings.warn("FP16 is not supported on CPU; using FP32 instead")

Re: Whisper – open source speech recognition by OpenAI

#116

Post by anigbrowl »

thfuran wrote: post #85
anigbrowl wrote: post #74

Earlier quoted context omitted.

It was already better. I edit a podcast and have > a decade of pro audio editing experience in the film industry, and I was already using a commercial AI transcription service to render the content to text and sometimes edit it as such (outputting edited audio). Existing (and affordable) offerings are so good that they can cope with shitty recordings off a phone speaker and maintain ~97% accuracy over hour-long conve…

>~97% accuracy over hour-long conversations. I'm sure it's been an absolute godsend for law enforcement 97% accuracy means roughly three or four errors per minute of speech. That seems potentially extremely problematic for something like law enforcement use where decisions with significant impact on people's day and/or life might be made on the basis of "evidence".

No it isn't. That just means 2-3% of your content needs to be double-checked by a person at the audio level, saving huge amounts of time - equally true of human transcription, in which individual words are often [UNINTELLIGEBLE].

Would you want to review this fully before going into court, absolutely - because you'd want to play the recording to a jury for emotional impact. Can you rely on it when you want to quickly read through hours of conversation and make decisions about whether to invest further resources (which might just mean another hour of listening back to the original audio)? Also absolutely. Bear in mind that a lot of these errors have little to no semantic impact, being on the same level as typos or misspellings in a written communication.

Bear in mind too that if law enforcement (honest or not) is so interested in you that they're willing to record your conversations, your day is already ruined, you just don't know it yet. The change here is one of scale rather than quality.

Re: Whisper – open source speech recognition by OpenAI

#117

Post by solarmist »

ignoramous wrote: post #95
solarmist wrote: post #52

Earlier quoted context omitted.

This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. I can understand not releasing GPT-3, even if I disagree with the decision.

> This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. The version I choose to believe: stability.ai ate DALL-E for lunch, and that woke them up.

This is probably also true.

Re: Whisper – open source speech recognition by OpenAI

#118

Post by soheil »

space_fountain wrote: post #109
soheil wrote: post #107

Earlier quoted context omitted.

Quoted post unavailable.

This isn't exactly a hard story to fact check. There is 0 evidence for this in either the reddit thread or really anywhere? If they were willing to lie about the company name why not just lie about the beef in their burgers it would be equally scandalous

The company name could be 100% legit, there is nothing stopping you from a forming a company with that name and not even sell beef.

Re: Whisper – open source speech recognition by OpenAI

#119

Post by aidenn0 »

For those on NixOS, here's a quick and dirty flake.nix that will let you make a venv in which to "pip install"'

Just put it in a flake.nix, and "nix develop" followed by "virtualenv ./venv; . ./venv/bin/activate; pip install git+https://github.com/openai/whisper.git"

    {
      description = "Python 3.9 development environment";

      outputs = { self, nixpkgs }:
        let
          system = "x86_64-linux";
          pkgs = import nixpkgs { inherit system; };
        in {
          devShells.${system}.default = pkgs.mkShell {
            buildInputs = [
              pkgs.ffmpeg
              pkgs.python39
              pkgs.python39Packages.pip
              pkgs.python39Packages.numpy
              pkgs.python39Packages.pytorch
              pkgs.python39Packages.virtualenv
            ];
          };
        };
    }

Re: Whisper – open source speech recognition by OpenAI

#120

Post by BasilPH »

Any opinions on what this means for speech-to-text companies like rev.ai and assmembly.ai ?

We've tested open source solutions for s2t, like kaldi, but the quality was not good enough. However, one of the main advantages of a service like assembly.ai to me was that they offer sentence splitting in form of punctuation and speaker detection, which Kaldi does not.

So I guess I answered my own question to some degree: A S2T service is more than just S2T. We already see assembly.ai add more and more features (like summarisation, PID redaction ect.) that are a value-add to plain S2T.

Still, curious to hear what your take on that is.

Post reply on HN