Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made a free transcription service powered by Whisper AI

freesubtitles.ai

Post reply on HN
Print view View original

71–80 of 135 posts

Re: Show HN: I made a free transcription service powered by Whisper AI

#71

Post by [deleted] »

gamegoblin wrote: post #26
sf4lifer wrote: post #23

Earlier quoted context omitted.

why did you want to transcribe it? What would you do with the output?

I wanted to make a twitter bot that posted whenever a pedestrian/cyclist got hit by a car. I'd need to: - Wait for a MED6 or AID response code to come across the live event stream - Listen to the radio chatter to see if it was a pedestrian getting hit (use GPT3 on the transcription to determine if the text was about a ped/cyclist getting hit) - Maybe also correlate to SPD logging a 'mvc with injuries' at the same loc…

[deleted]

Re: Show HN: I made a free transcription service powered by Whisper AI

#72

Post by krick »

I didn't manage to transcribe anything (it just doesn't remember that I submitted anything), but whatever, I didn't need to anyway. I just wanted to ask: how good is Whisper with non-english? At least "major" ones, like, German, French, Russian, Spanish?

Re: Show HN: I made a free transcription service powered by Whisper AI

#73

Post by mayeaux »

Yeah I apologize, the queue is a little messed up. It's not showing your progress properly and it's not stopping people's processing if they left (their websocket dies). I'm going to fix these and reboot the server and the experience will be a lot better, sorry. It is working properly though and transcribing all this stuff but the queue needs some TLC, brb.

Re: Show HN: I made a free transcription service powered by Whisper AI

#74

Post by seligman99 »

It broke when I tried to feed it an entire podcast file, but still, I took this as a push to try out Whisper AI for myself, turns out it's easier to use than I thought. Long story short, I used it to transcriptify a podcast:

https://scotts-podcasts.s3.amazonaws.com/temp/whisper/Intern...

Not sure if there's a use for this that's not me, but I like the idea of having subtitles for a podcast I'm listening to.

Re: Show HN: I made a free transcription service powered by Whisper AI

#75

Post by stefan_ »

krick wrote: post #72

I didn't manage to transcribe anything (it just doesn't remember that I submitted anything), but whatever, I didn't need to anyway. I just wanted to ask: how good is Whisper with non-english? At least "major" ones, like, German, French, Russian, Spanish?

I've been using it on lots of Russian stuff and it's great, even translates for you.

Re: Show HN: I made a free transcription service powered by Whisper AI

#76

Post by pessimizer »

ramraj07 wrote: post #56
jw1224 wrote: post #44

Free startup idea: Use Whisper with pyannote-audio[0]’s speaker diarization. Upload a recording, get back a multi-speaker annotated transcription. Make a JSON API and I’ll be your first customer. [0] https://github.com/pyannote/pyannote-audio

And you expect the API to be free? If not why not use one of a million other such services?

It's the idea that's free, not the API.

Re: Show HN: I made a free transcription service powered by Whisper AI

#77

Post by skim_milk »

gamegoblin wrote: post #12

I recently tried Whisper to transcribe our local Seattle Fire Department radio scanner -- unfortunately it was not reliable enough for my use case, e.g. "adult male hit by car" gets transcribed as "don't mail it by car". I imagine future models will allow the user to input some context to disambiguate. Like if I could give it the audio along with the context "Seattle Fire Department and EMS radio traffic", it would b…

Have you tried the --initial_prompt CLI arg? For my use, I put a bunch of industry jargon and names that are commonly misspelled in there and that fixes 1/3 to 1/2 of the errors.

I was initially going to use Azure Cognitive Services and train it on a small amount of test data, after Whisper released for free I use Whisper + openai GPT-3 trained to fix the transcription errors by 1) taking a sample of transcripts by Whisper 2) fixing the errors and 3) fine-tuning GPT-3 by using the unfixed transcriptions as the prompt and the corrected transcripts as the result text.

Whisper with the --initial_prompt containing industry jargon plus training GPT-3 to fix the transcription errors should be nearly as accurate as using a custom-trained model in Azure Cognitive Services but at 5-10% of the cost. Biggest downside is the amount of labor to set that up, and the snail's pace of Whisper transcriptions.

Re: Show HN: I made a free transcription service powered by Whisper AI

#78

Post by jerpint »

skim_milk wrote: post #77
gamegoblin wrote: post #12

I recently tried Whisper to transcribe our local Seattle Fire Department radio scanner -- unfortunately it was not reliable enough for my use case, e.g. "adult male hit by car" gets transcribed as "don't mail it by car". I imagine future models will allow the user to input some context to disambiguate. Like if I could give it the audio along with the context "Seattle Fire Department and EMS radio traffic", it would b…

Have you tried the --initial_prompt CLI arg? For my use, I put a bunch of industry jargon and names that are commonly misspelled in there and that fixes 1/3 to 1/2 of the errors. I was initially going to use Azure Cognitive Services and train it on a small amount of test data, after Whisper released for free I use Whisper + openai GPT-3 trained to fix the transcription errors by 1) taking a sample of transcripts by W…

There have been a lot of hacks to speed up whisper inference

Re: Show HN: I made a free transcription service powered by Whisper AI

#79

Post by jerpint »

krick wrote: post #72

I didn't manage to transcribe anything (it just doesn't remember that I submitted anything), but whatever, I didn't need to anyway. I just wanted to ask: how good is Whisper with non-english? At least "major" ones, like, German, French, Russian, Spanish?

I’ve tried it on French and results were pretty good

Re: Show HN: I made a free transcription service powered by Whisper AI

#80

Post by mayeaux »

I just rebooted the server, now if the websocket disconnects (person closes the browser) it will kill the processing and move the queue, so that should help unclog the queue. I'm going to add a couple more queue touchups and then it should be stable again (no reboots), but running well in the meantime
Post reply on HN