Live data from Hacker News

FFmpeg 8.0 adds Whisper support

code.ffmpeg.org

151–160 of 341 posts

Re: FFmpeg 8.0 adds Whisper support

#151
post #107

Earlier quoted context omitted.

Is this website open? Would love to see your work :P

somerville.votolab.com

All the "Thanks for watching!" gave me a good chuckle.

Remind me of one of my own experiences with one of the Whisper model, where some random noise in the middle of the conversation was translated into "Don't forget to like and subscribe".

Really illustrate where the training data is coming from.

Re: FFmpeg 8.0 adds Whisper support

#152

Related, a blog article by the author of the patch: Run Whisper audio transcriptions with one FFmpeg command https://medium.com/@vpalmisano/run-whisper-audio-transcripti... Posted here, with 0 comments: https://news.ycombinator.com/item?id=44869254

Link is broken, full link: https://medium.com/@vpalmisano/run-whisper-audio-transcripti...

Re: FFmpeg 8.0 adds Whisper support

#153
post #141

Earlier quoted context omitted.

Can you give an example why it made your life that much better?

As a hard of hearing person, I can now download any video from the internet (e.g. youtube) and generate subtitles on the fly, not having to struggle to understand badly recorded or unintelligible speech.

IF the dialog is badly recorded or unintelligible speech, how would a transcription process get it correct?

Re: FFmpeg 8.0 adds Whisper support

#154

Earlier quoted context omitted.

This is what your brain does when it processes language. I find that in languages I don't speak well, my ability to understand degrades much more quickly as the audio quality goes down. But in my native language, even with piss poor audio quality, my brain fills in the garbled words with its prior expectation of what those words should be, based on context.

A slight segue to this; I was made aware of the phenomena that - The language in which you think in, sets the constraints to which you level of expanse the brain can think and parse information in. I think in English fortunately and it's an ever evolving language so, expanding as the world does. That is compared to the majority of people where I'm from; English was a second language they had to learn and the people t…

This is called linguist relativity (nee. The Sapir-Whorf hypothesis) and the strong form you describe has fallen out of favour in modern linguistics.

A surprising number of monolingual people think their own language is the most adaptable and modern language, but this is obviously untrue. All languages evolve to fit the needs of speakers.

Also, the idea that people "think in language X" is heavily disputed. One obvious counterargument is that most people have experienced the feeling of being unable to express what they are thinking into words -- if you truly did think in the language you speak, how could this situation happen? My personal experience is that I do not actively hear any language in my head while unless I actively try to think about it (at least, since I was a teenager).

(This is all ignoring the comments about ESL speakers that I struggle to read as anything but racism. As someone who speaks multiple languages, it astounds me how many people seem to think that struggling to express something in your non-native language means that you're struggling to think and are therefore stupid.)

Re: FFmpeg 8.0 adds Whisper support

#156

Related, a blog article by the author of the patch: Run Whisper audio transcriptions with one FFmpeg command https://medium.com/@vpalmisano/run-whisper-audio-transcripti... Posted here, with 0 comments: https://news.ycombinator.com/item?id=44869254

Correct URL: https://medium.com/@vpalmisano/run-whisper-audio-transcripti...

Re: FFmpeg 8.0 adds Whisper support

#157

Earlier quoted context omitted.

It also instantly blocks me on GrapheneOS, both Firefox and Vanadium. Very odd, as I've never had an issue with Anubis before.

GrapheneOS here, with Vanadium in incognito, it doesn't block me, both in wifi and in mobile. Maybe it was a temporary hiccup.

Thanks for checking! Incognito blocks me too, no idea whats up. Maybe I'm getting tripped up by IP reputation or something (though I shouldn't, normal residential connection).

Re: FFmpeg 8.0 adds Whisper support

#158
post #106

Earlier quoted context omitted.

For folks like me puzzling over what the correct transcription of the title should be, I think it's "How to recognize speech using common sense"

Thanks. Now I know that I'm not that stupid and this actually makes no sense

It actually does make sense. Not saying you're stupid, but in standard English, if you say it quickly, the two sentences are nearly identical.

Re: FFmpeg 8.0 adds Whisper support

#159
post #93

Whisper is genuinely amazing - with the right nudging. It's the one AI thing that has genuinely turned my life upside-down in an unambiguously good way. People should check out Subtitle Edit (and throw the dev some money) which is a great interface for experimenting with Whisper transcription. It's basically Aegisub 2.0, if you're old, like me. HOWTO: Drop a video or audio file to the right window, then go to Video >…

whisper is definitely nice, but it's a bit too slow. Having subtitles and transcription for everything is great - but Nemo Parakeet (pretty much whisper by nvidia) completely changed how I interact with the computer.

It enables dictation that actually works and it's as fast as you can think. I also have a set of scripts which just wait for voice commands and do things. I can pipe the results to an LLM, run commands, synthesize a voice with F5-TTS back and it's like having a local Jarvis.

The main limitation is being english only.

Post reply on HN