Is there a feature roadmap?
OpenAI quietly launched Whisper V2
Show HN: Port of OpenAI's Whisper model in C/C++
61–70 of 93 posts
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#62Hi Georgi, I am experimenting with your code now. Is there a way to force Whisper to only consider a limited vocabulary and then respond with confidence levels? I am working on an app where it is important to restrict answers and I would like to know how confident that a response is one of a set of words. If the answer could be word A with a confidence level of 95% and word B with a level of 50%, I would want to know…
Hopefully this version will add the prompting ability that the original Whisper has. In the original Whisoer, you would be able to give it a prompt for the recognition like "Please respond with only one of the following words: A, B, or C." It wouldn't be foolproof, but it helps.
https://github.com/openai/whisper/discussions/117#discussion...
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#63There is no language called "C/C++".
If, to use it, you need C++, it's a C++ system, period. If parts are in C, that is an implementation detail, and is furthermore pointless; modernizing those to C++ would make them more robust and probably faster. Using C anywhere just makes it as bug-prone in those parts as C code everywhere is.
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#64Is there a feature roadmap? OpenAI quietly launched Whisper V2 https://news.ycombinator.com/item?id=33884716
Large v2 has already been added to `whisper.cpp` (check the pinned issues). I was thinking about adding a roadmap soon
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#65Very nice! Especially that it can run with good speed on the CPU without any external dependencies.
I wish something like this would also exist for Stable Diffusion - a simple, no dependency way to run it with C++ on the CPU with AVX. Do you know if that would be possible with your tensor library, or is it very hardcoded for Whisper?
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#66This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both very soft spoken and had a thick German accent) because I wanted to evaluate OpenAI’s claims about whisper being “superhuman” in recognition. It was a bit picky about having the audio in the exact right format (it needs to be 16kHz wav files— would be really nice it just include ffmpeg in the release and automatically pipe any input first to ffmpeg to convert to the desired format), but once it got started it just cranked away extremely quickly on my iMac M1. And the results do seem to be pretty good. I just wish the model also did some basic speaker identification, so it could insert “Speaker1:” or something at the beginning of each line/timestamp. Even if it’s not sure, it could insert “Speaker:” and that would still be useful.
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#67This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both very soft spoken and had a thick German accent) because I wanted to evaluate OpenAI’s claims about whisper being “superhuman” in recognition. It was a bit picky about having the audio in the exact right format (it needs to be 16kHz wav files— would be really ni…
For those interested:
Video link: https://www.youtube.com/watch?v=34Bre91Ey3Q
Resulting transcript text: https://pastebin.com/5M1iW8yf
The whole thing took 1.5 minutes to run on an M1.
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#68This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both very soft spoken and had a thick German accent) because I wanted to evaluate OpenAI’s claims about whisper being “superhuman” in recognition. It was a bit picky about having the audio in the exact right format (it needs to be 16kHz wav files— would be really ni…
Btw, there is the `yt-wsp.sh` helper script to download, convert and transcribe a video by given url:
./examples/yt-wsp.sh Re: Show HN: Port of OpenAI's Whisper model in C/C++
#69This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both very soft spoken and had a thick German accent) because I wanted to evaluate OpenAI’s claims about whisper being “superhuman” in recognition. It was a bit picky about having the audio in the exact right format (it needs to be 16kHz wav files— would be really ni…
For those interested: Video link: https://www.youtube.com/watch?v=34Bre91Ey3Q Resulting transcript text: https://pastebin.com/5M1iW8yf The whole thing took 1.5 minutes to run on an M1.
Part 2: https://pastebin.com/dEzpXLcL
Re: Show HN: Port of OpenAI's Whisper model in C/C++
#70This is really awesome, great work! I downloaded a long video from YouTube that is very challenging to transcribe (it is an interview with Hayek, who was both very soft spoken and had a thick German accent) because I wanted to evaluate OpenAI’s claims about whisper being “superhuman” in recognition. It was a bit picky about having the audio in the exact right format (it needs to be 16kHz wav files— would be really ni…
Btw, there is the `yt-wsp.sh` helper script to download, convert and transcribe a video by given url: ./examples/yt-wsp.sh
Ah thank you, I somehow missed that! Amazing job on this. You could literally create whole new companies from this system.