Show HN: Self-host Whisper As a Service with GUI and queueing

I understand this is self-hosting the OpenAI Whisper model (which I see is fully MIT-licensed, weights and all). So not calling any OpenAI APIs like other GPT-related tools do.

Am I correct on this? The README is not explicit.

Re: Show HN: Self-host Whisper As a Service with GUI and queueing

#5

Post by olekenneth » Mon, Feb 13, 2023, 10:05 AM UTC

adlpz wrote: post #4

I understand this is self-hosting the OpenAI Whisper model (which I see is fully MIT-licensed, weights and all). So not calling any OpenAI APIs like other GPT-related tools do. Am I correct on this? The README is not explicit.

Yes. This runs the OpenAI Whisper model locally.

Re: Show HN: Self-host Whisper As a Service with GUI and queueing

#6

Post by olekenneth » Mon, Feb 13, 2023, 10:06 AM UTC

mkl wrote: post #3

Looks interesting. I noticed that the README says "containe" or "containes" several times, where I think you mean "container(s)".

Thanks for feedback. Looks like the Readme need more work

Re: Show HN: Self-host Whisper As a Service with GUI and queueing

#7

Post by silviot » Mon, Feb 13, 2023, 10:22 AM UTC

People interested in this might also be interested in transcribe-anything [1].

It automates video fetching and uses whisper to generate .srt, .vtt and .txt files.

[1] https://github.com/zackees/transcribe-anything

Re: Show HN: Self-host Whisper As a Service with GUI and queueing

#8

Post by henry_viii » Mon, Feb 13, 2023, 10:27 AM UTC

By the way there is also another project called Whisper.cpp:

https://github.com/ggerganov/whisper.cpp

Which uses x8 less memory than the Python implementation for the tiny model. It would be a good idea to keep an eye on it since there are Python bindings planned on the roadmap:

https://github.com/ggerganov/whisper.cpp#bindings

Re: Show HN: Self-host Whisper As a Service with GUI and queueing

#9

Post by raybb » Mon, Feb 13, 2023, 11:11 AM UTC

Whisper-UI is also looking really nice lately but I think it's still pretty early in development. The ability to click on the transcript and hear the sound of that particular moment is great. https://github.com/hayabhay/whisper-ui

Re: Show HN: Self-host Whisper As a Service with GUI and queueing

#10

Post by sebastianvoelkl » Mon, Feb 13, 2023, 11:25 AM UTC

The only thing Whisper misses is speaker diarization. I'm currently working on a model that uses Whisper + pyannote to transcribe Interviews and also detects who is speaking. It's working but damn it takes so long