FFmpeg 8.0 adds Whisper support • Hacker News Board

abound wrote: post #106

yvdriess wrote: post #94

Earlier quoted context omitted.

A good opportunity to point people to the paper with my favorite title of all time: "How to wreck a nice beach you sing calm incense" https://dl.acm.org/doi/10.1145/1040830.1040898

For folks like me puzzling over what the correct transcription of the title should be, I think it's "How to recognize speech using common sense"

Thank you! "Calm incense" makes very little sense when said in an accent where calm isn't pronounced like com.

Re: FFmpeg 8.0 adds Whisper support

#135

Post by efilife » Wed, Aug 13, 2025, 1:57 PM UTC

abound wrote: post #106

yvdriess wrote: post #94

Earlier quoted context omitted.

A good opportunity to point people to the paper with my favorite title of all time: "How to wreck a nice beach you sing calm incense" https://dl.acm.org/doi/10.1145/1040830.1040898

For folks like me puzzling over what the correct transcription of the title should be, I think it's "How to recognize speech using common sense"

Thanks. Now I know that I'm not that stupid and this actually makes no sense

Re: FFmpeg 8.0 adds Whisper support

#136

Post by mkayokay » Wed, Aug 13, 2025, 2:00 PM UTC

webinar wrote: post #112

Xunjin wrote: post #107

Earlier quoted context omitted.

Is this website open? Would love to see your work :P

somerville.votolab.com

Looks like this is a nice case were the LLM thinks that silence is "thanks for watching" which was discussed on here a few days ago.

Re: FFmpeg 8.0 adds Whisper support

#137

Post by SahAssar » Wed, Aug 13, 2025, 2:01 PM UTC

zoobab wrote: post #120

majewsky wrote: post #58

Earlier quoted context omitted.

It looks like the model file needs to be supplied at invocation time, so the binary blob would not be required for packaging.

so 'apt install ffmpeg' won't be enough to have the feature?

You'd have the feature, but you also need to supply the model. The feature seems to just be that ffmpeg has the ability to run the model, it does not include the model.

Re: FFmpeg 8.0 adds Whisper support

#138

Post by correa_brian » Wed, Aug 13, 2025, 2:01 PM UTC

hell yeah

Re: FFmpeg 8.0 adds Whisper support

#139

Post by pmarreck » Wed, Aug 13, 2025, 2:01 PM UTC

Now if it only did separate speaker identification (diarization)

Re: FFmpeg 8.0 adds Whisper support

#140

Post by notatallshaw » Wed, Aug 13, 2025, 2:02 PM UTC

kmfrk wrote: post #93

Whisper is genuinely amazing - with the right nudging. It's the one AI thing that has genuinely turned my life upside-down in an unambiguously good way. People should check out Subtitle Edit (and throw the dev some money) which is a great interface for experimenting with Whisper transcription. It's basically Aegisub 2.0, if you're old, like me. HOWTO: Drop a video or audio file to the right window, then go to Video >…

> uv pip install --system torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118

uv has a feature to get the correct version of torch based on your available cuda (and some non-cuda) drivers (though I suggest using a venv not the system Python):

> uv pip install torch torchvision torchaudio --torch-backend=auto

More details: https://docs.astral.sh/uv/guides/integration/pytorch/#automa...

This also means you can safely mix torch requirements with non-torch requirements as it will only pull the torch related things from the torch index and everything else from PyPI.