Live data from Hacker News

Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

github.com

31–40 of 45 posts

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#31

I don't have any experience with Python. Can someone point me to definitive (and idiot-proof) tutorials for Win 10 Pro and Mac OS? Maybe using Docker? I just don't know but am willing to try. I'd rather ask here than be subjected to a search and its SEO hell (read: SERPs of questionable results). Or perhaps there's a way to use Digial Ocean or similar so I'm not tying up my local machine?

You could ask ChatGPT for help, too!

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#32
post #4

You might want to look into diarization also http://gladia.io/ seem to be doing it well. It makes a great difference to have transcripts with speaker annotation.

Wow, why are they so expensive? Like even the regular whisperAPI by OpenAI is less expensive. This is also why I decided to create https://www.betterwhisperapi.com/ . I believe most of the companies are charging pretty insane amounts for transcriptions...

Deepgram is really good and around your price point too. They also have $200 free credit which should be more than enough for most hobby protects.

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#33
post #11

I could've sworn I had seen a Google/YouTube announcement somewhere that there was going to be readable/searchable transcripts coming. Is it what's already been rolled out? The current YouTube transcripts seem almost useless to me; limited to a small part of the screen real estate, and seem only searchable using the full page search built into web browsers.

[deleted]

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#34
post #4

You might want to look into diarization also http://gladia.io/ seem to be doing it well. It makes a great difference to have transcripts with speaker annotation.

Thanks, I haven’t seen an easy and reliable way to do this using open source stuff yet. Theoretically just separating out speakers seems like it wouldn’t be that hard; just compute a bunch of FFTs to arrive at a sort of frequency-based “voice fingerprint” for each speaker and then use something like XGboost to match up the audio for each second to one of the speakers. The problem is then what do you with that informa…

to zoom out a bit, this is known as the 'cocktail party problem' and is very much considered unsolved (particularly when there is an unknown number of speakers or overlapping speech).

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#35
post #31

I don't have any experience with Python. Can someone point me to definitive (and idiot-proof) tutorials for Win 10 Pro and Mac OS? Maybe using Docker? I just don't know but am willing to try. I'd rather ask here than be subjected to a search and its SEO hell (read: SERPs of questionable results). Or perhaps there's a way to use Digial Ocean or similar so I'm not tying up my local machine?

You could ask ChatGPT for help, too!

Yes. But it can be wrong, especially for key details. So instead, I asked here. My hope is to keep friction down and productivity up.

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#36
post #22

Earlier quoted context omitted.

I was dismayed to learn that this requires OpenAI API keys for speaker diarization.

Does it? I only see references to HuggingFace api keys so it can do a one time download of some additional models.

Oh, maybe that's what I saw. I'll have to look again. Thanks for keeping me honest.

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#37
FYI, one secret in the world of automatic translation is "the better the transcription the better the translation."

Seems obvious, right?

We've been looking at whisper to replace AWS transcribe. It could be that AWS will just roll whisper in as an engine at some point before we get around to it.

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#39
post #8

Out of curiosity, how does it compare to YouTube’s own generated transcripts?

While it seems YouTube's auto-generated are hit or miss, I wonder if feeding them through an LLM can fix the mistakes and still get the video's idea out of them

I've found that to be the case. I typically don't want a full transcript -- I want the materials list, or a summary, or a counterargument. I've found it is totally sufficient to just plop the transcript into an LLM and ask for my desired output. No need to clean of the transcript ahead of time.

Re: Show HN: Bulk Creation of Transcripts from YouTube Playlists with Whisper

#40

This is nice! I like how you've built upon your previous youtube transcript cleaner project and put together something really compelling. Have you thought about spinning this together as a Chrome extension?

Thanks. The html cleaning tool could easily be a chrome extension, but I don’t see how you could have a python project with a bunch of heavy binary wheels as part of an extension. But I can’t say I know much about it.
Post reply on HN