41–50 of 109 posts
If you are looking for something automatic that also allows you to interact with your transcripts chatgpt style then I would recommend https://www.videototextai.com/
Kinda surprised to not have AI integration. You do still need to proof and QA even AI results, if you want a publication quality result, and do things like attribute who is speaking when (at least Whisper can't do that), and correct "unusual" last names and things. So I feel like people using AI still need good tools for the correcting/finishing/proofing too, that would be similar to the tools for non-assisted transc…
This was written a really long time ago by a former WSJ Graphics reporter (Elliot Bentley) who is now at Datawrapper. It is now operated by Muckrock and hasn't seen changes made to it in a while. That's why it doesn't have any of these integrations, the technology just didn't exist.
Not developing it actively after I created tables of contents for the several videos I needed, years ago. If I ever need it again, I will probably work on mobile UI (aka responsive)
https://www.gally.net/temp/20240809geminitranscription/index...
Aside from some minor punctuation and capitalization issues, Gemini’s transcription looks nearly perfect to me. There were only one or two words that I think it misheard. If I had transcribed the audio myself, I would have made more mistakes than that.
One passage struck me in particular:
And then he comes up with "weird," which becomes viral and the rest, and here he is.
https://www.politico.com/news/2024/07/26/trump-vance-weird-0...
Looks cool! Unclear from the docs, but does it support non-English languages? How about mixed-language interviews?
It is functional but a bit slow. I think using whisper directly instead of swift bindings will help a lot.
Really interested in adding diarisation but having a lot of trouble converting Pyannote to CoreML. Pyannote runs so slowly with torch on CPU. Haven’t gotten around putting my latest work for that on GitHub yet.
Happy to accept contributions —
Some priorities right now:
* Fixing signing for local builds
* Replace swift whisper with whisper cpp
* Allowing users to provide their own models
Nowadays, I use libretranslate/libretranslate and pluja/whishper to do this, but not at real time.
Anyone knows one with transcription and translate in real time? Nowadays, I use libretranslate/libretranslate and pluja/whishper to do this, but not at real time.