Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

FFmpeg 8.0 adds Whisper support

code.ffmpeg.org

Post reply on HN
Print view View original

281–290 of 341 posts

Re: FFmpeg 8.0 adds Whisper support

#281

Post by ec109685 »

londons_explore wrote: post #23

Does this have the ability to edit historic words as more info becomes available? Eg. If I say "I scream", it sounds phonetically identical to "Ice cream". Yet the transcription of "I scream is the best dessert" makes a lot less sense than "Ice cream is the best dessert". Doing this seems necessary to have both low latency and high accuracy, and things like transcription on android do that and you can see the adjusti…

The I is emphasized more in I scream than ice cream I think.

But it’s great point that you need context to be sure.

Re: FFmpeg 8.0 adds Whisper support

#282

Post by cpmsmith »

xena wrote: post #244
superkuh wrote: post #216

Earlier quoted context omitted.

They don't need to shut off Anubis, they just need to configure it beyond the defaults. If they turned on the meta-refresh based challenge then all browsers could access it while still keeping most of the bots away. But few people ever configure these things and just accept the broken defaults. With the current broken default config my browser can't even run the JS challenge due to it using unsupported bleeding edge…

Hi, can you please paste the error message you get? This should be using features that are supported widely as of 2022 and I regularly test on Firefox LTS.

I'm just getting "invalid response." in a 500 response from the `anubis/api/pass-challenge` endpoint – weirdly, when I added breakpoints and stepped through the code myself, it worked, but if I load again, I get the error. Maybe there's a timing component? (Firefox stable)

Re: FFmpeg 8.0 adds Whisper support

#284

Post by yokljo »

solardev wrote: post #276
drited wrote: post #275

Earlier quoted context omitted.

Cahm

Like the "cam" in "camera"?

I've been thinking about this for a minute, and I think if an American were to say "why", and take only the most open vowel sound from that word and put it between "k" and "m", you get a pretty decent Australian pronunciation. I am an Australian so I could be entirely wrong about how one pronounces "why".

Re: FFmpeg 8.0 adds Whisper support

#285

Post by enneff »

dylan604 wrote: post #277
spauldo wrote: post #232

Earlier quoted context omitted.

I have that issue as well - I can hear faint noises OK but if there's background noise I can't understand what people say. But I'm pretty sure there's a physical issue at the root of it in my case. The problem showed up after several practice sessions with a band whose guitarist insisted on always playing at full volume.

> I have that issue as well You say issue, I say feature. It's a great way to just ignore boring babbling at parties or other social engagements where you're just not that engaged. Sort of like selective hearing in relationships, but used on a wider audience

I don’t mean to speak for OP, but it strikes me as rude to make light of someone’s disability in this way. I’d guess it has caused them a lot of frustration.

Re: FFmpeg 8.0 adds Whisper support

#286

Post by spauldo »

dylan604 wrote: post #277
spauldo wrote: post #232

Earlier quoted context omitted.

I have that issue as well - I can hear faint noises OK but if there's background noise I can't understand what people say. But I'm pretty sure there's a physical issue at the root of it in my case. The problem showed up after several practice sessions with a band whose guitarist insisted on always playing at full volume.

> I have that issue as well You say issue, I say feature. It's a great way to just ignore boring babbling at parties or other social engagements where you're just not that engaged. Sort of like selective hearing in relationships, but used on a wider audience

It's not so great when I'm standing right next to my technician in a pumphouse and I can't understand what he's trying to say to me.

Re: FFmpeg 8.0 adds Whisper support

#287

Post by peterleiser »

3036e4 wrote: post #230
pawelduda wrote: post #124

Earlier quoted context omitted.

Can you give an example why it made your life that much better?

I used it like sibling commenter to get subtitles for downloaded videos. My hearing is bad. Whisper seems much better that YouTube's built-in auto-subtitles, so sometimes it is worth the extra trouble for me to download a video just to generate good subtitles and then watch it offline. I also used whisper.cpp to transcribe all my hoarded podcast episodes. Took days of my poor old CPU working at 100% on all cores (and…

You'll probably like Whisper Live and it's browser extensions: https://github.com/collabora/WhisperLive?tab=readme-ov-file#...

Start playing a YouTube video in the browser, select "start capture" in the extension, and it starts writing subtitles in white text on a black background below the video. When you stop capturing you can download the subtitles as a standard .srt file.

Re: FFmpeg 8.0 adds Whisper support

#288

Post by peterleiser »

Morizero wrote: post #252
kmfrk wrote: post #93

Whisper is genuinely amazing - with the right nudging. It's the one AI thing that has genuinely turned my life upside-down in an unambiguously good way. People should check out Subtitle Edit (and throw the dev some money) which is a great interface for experimenting with Whisper transcription. It's basically Aegisub 2.0, if you're old, like me. HOWTO: Drop a video or audio file to the right window, then go to Video >…

You don't happen to know a whisper solution that combines diarization with live audio transcription, do you?

Check out https://github.com/jhj0517/Whisper-WebUI

I ran it last night using docker and it worked extremely well. You need a HuggingFace read-only API token for the Diarization. I found that the web UI ignored the token, but worked fine when I added it to docker compose as an environment variable.

Re: FFmpeg 8.0 adds Whisper support

#289

Post by peterleiser »

kmfrk wrote: post #256
Morizero wrote: post #252

Earlier quoted context omitted.

You don't happen to know a whisper solution that combines diarization with live audio transcription, do you?

Proper diarization still remains a white whale for me, unfortunately. Last I looked into it, the main options required API access to external services, which put me off. I think it was pyannotate.audio[1]. [1]: https://github.com/pyannote/pyannote-audio

I used diarization in https://github.com/jhj0517/Whisper-WebUI last night and once it downloads the model from HuggingFace it runs offline (it claims).

Re: FFmpeg 8.0 adds Whisper support

#290

Post by gregoryl »

spauldo wrote: post #232
gregoryl wrote: post #166

Earlier quoted context omitted.

Because it can use the full set of information of the audio - people with hearing difficulties cannot. Also interesting, people with perfectly functional hearing, but whom have "software" bugs (i.e. I find it extremely hard to process voices with significant background nose) can also benefit :)

I have that issue as well - I can hear faint noises OK but if there's background noise I can't understand what people say. But I'm pretty sure there's a physical issue at the root of it in my case. The problem showed up after several practice sessions with a band whose guitarist insisted on always playing at full volume.

I'd love your thoughts on why it might be hardware. I reason that my hearing is generally fine - there's no issue picking apart loud complex music (I love breakcore!).

But play two songs at the same time, or try talking to me with significant background noise, and I seem to be distinctly impaired vs. most others.

If I concentrate, I can sometimes work through it.

My uninformed model is a pipeline of sorts, and some sort of pre-processing isn't turned on. So the stuff after it has a much harder job.

Post reply on HN