Now if it only did separate speaker identification (diarization)
FFmpeg 8.0 adds Whisper support
291–300 of 341 posts
Re: FFmpeg 8.0 adds Whisper support
#292Earlier quoted context omitted.
> uv pip install --system torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 uv has a feature to get the correct version of torch based on your available cuda (and some non-cuda) drivers (though I suggest using a venv not the system Python): > uv pip install torch torchvision torchaudio --torch-backend=auto More details: https://docs.astral.sh/uv/guides/integration/pytorch/#automa... This…
I love uv and really feel like I only need to know "uv add" and "uv sync" to be effective using it with python. That's an incredible feat. But, when I hear about these kinds of extras, it makes me even more excited. Getting cuda and torch to work together is something I have struggled countless times. The team at Astral should be nominated for a Nobel Peace Prize.
Re: FFmpeg 8.0 adds Whisper support
#293Earlier quoted context omitted.
I think the Dutch/English is probably the worst combination for this. Languages are rather close.
I don't understand how this would happen, though. It's not like it will mishear a dutch sentence as if it's english; it will correctly pick up the dutch sentence, but (since the language is auto-detected as english at the start of the segment), seemingly auto-translate that (correct and correctly heard) dutch text to english. All we need is a way to get the dutch text that's surely somewhere in there, before the tran…
Re: FFmpeg 8.0 adds Whisper support
#294Earlier quoted context omitted.
> I have that issue as well You say issue, I say feature. It's a great way to just ignore boring babbling at parties or other social engagements where you're just not that engaged. Sort of like selective hearing in relationships, but used on a wider audience
I don’t mean to speak for OP, but it strikes me as rude to make light of someone’s disability in this way. I’d guess it has caused them a lot of frustration.
So when I say I call it a feature, it's something I actually deal with unlike your uncharitable assumption.
Re: FFmpeg 8.0 adds Whisper support
#295Earlier quoted context omitted.
Those burned in subtitles still aren’t as cool as theme-matched anime subtitles during intro music sequences from fansubs 15 years ago. Those are still cool IMO
Or how the fansubbers will create masks to translate diegetic text like signage and written notes
Re: FFmpeg 8.0 adds Whisper support
#296This is going to be great for real-time audio translation.
Re: FFmpeg 8.0 adds Whisper support
#297I was expecting a lot more comments on if this is a necessary feature or if this even belongs in a library like ffmpeg. I think this is bloat, especially when the feature doesn't work flawless, whisper is very limited.
I think having this flow out to all of the deps of libav is a greater good than notions of lib purity.
Re: FFmpeg 8.0 adds Whisper support
#298Re: FFmpeg 8.0 adds Whisper support
#299Re: FFmpeg 8.0 adds Whisper support
#300Earlier quoted context omitted.
Hard disagree. When I'm reading a transcript, I want word-for-word what the people said, not a creative edit. I want the speakers' voice, not the transcriptionist's. And when I'm watching subtitles in my own language (say because I want the volume low so I'm not disturbing others), I hate when the words I see don't match the words I hear. It's the quickest way I can imagine to get sucked out of the content and into a…
I mean, subtitles are mostly the same. Sometimes they're edited down simply for space, because there wouldn't be time to easily read all the dialog otherwise. And sometimes repetition of words or phrases is removed, because it's clearer, and the emphasis is obvious from watching the moving image. And filler words like "uh" or "um" generally aren't included unless they were in the original script. Most interestingly,…
The artists are the writers, voice actors, and everyone else involved in creating the original media. Never, ever, a random stranger should contaminate it with his/her opinions or point of views.
Subtitles should be perfect transcriptions or the most accurate translations, never reinterpretations