When extracting transcripts from YouTube videos, can anyone give advice on the best (cost effective, quick, accurate) way to do this? I'm confused because I read in various places that the YouTube API doesn't provide access to transcripts ... so how do all these YouTube transcript extractor services do it? I want to build my own YouTube summarizer app. Any advice and info on this topic greatly appreciated!
You can use yt-dlp to get the transcripts. For instance, to grab just the transcript of a video: ./yt-dlp --skip-download --write-sub --write-auto-sub --sub-lang en --sub-format json3 You can also feed the same command a playlist or channel URL and it'll run through and grab all the transcripts for each video in the playlist or channel.
OpenAI charges by the minute, so speed up your audio
111–120 of 234 posts
Re: OpenAI charges by the minute, so speed up your audio
#112Possibly another 10-20% gain?
Re: OpenAI charges by the minute, so speed up your audio
#113Earlier quoted context omitted.
You can use yt-dlp to get the transcripts. For instance, to grab just the transcript of a video: ./yt-dlp --skip-download --write-sub --write-auto-sub --sub-lang en --sub-format json3 You can also feed the same command a playlist or channel URL and it'll run through and grab all the transcripts for each video in the playlist or channel.
That's cool, thanks for the info. But do you also have to use a rotating proxy to prevent YouTube from blocking your IP address?
But that was a few months ago, so for all I know they've tightened down more hatches since then.
Re: OpenAI charges by the minute, so speed up your audio
#114I use this free tool to extract those and dump the transcripts into a LLM with basic prompts: https://contentflow.megalabs.co
Re: OpenAI charges by the minute, so speed up your audio
#115Re: OpenAI charges by the minute, so speed up your audio
#116Earlier quoted context omitted.
> I didn't look at all at the quality of the transcription by feeding it the shorter version. guys how hard is it to toss both versions into like diffchecker or something haha youre just comparing text
Why use diffchecker when there’s a perfectly good LLM you could ask right there? lol
really it becomes a question of whether or not the friction of invoking the command or the cost of tokens is greater.
as I get older and more rsi'd the tokens seem cheaper.
Re: OpenAI charges by the minute, so speed up your audio
#117With transcribing a talk by Andrej, you already picked the most challenging case possible, speed-wise. His natural talking speed is already >=1.5x that of a normal human. One of the people you absolutely have to set your YouTube speed back down to 1x when listening to follow what's going on. In the idea of making more of an OpenAI minute, don't send it any silence. E.g. ffmpeg -i video-audio.m4a \ -af "silenceremove=…
Re: OpenAI charges by the minute, so speed up your audio
#118Earlier quoted context omitted.
If you're not listening to summaries of different audiobooks at 2x speed in each ear you're not contentmaxing.
Or just use notebookLM to convert your books into an hour long podcasts /s
On the gripping hand, there are probably already excellent 10/30/60 minute book summaries on YouTube or wherever which are not going to hallucinate plot points.
Re: OpenAI charges by the minute, so speed up your audio
#119With transcribing a talk by Andrej, you already picked the most challenging case possible, speed-wise. His natural talking speed is already >=1.5x that of a normal human. One of the people you absolutely have to set your YouTube speed back down to 1x when listening to follow what's going on. In the idea of making more of an OpenAI minute, don't send it any silence. E.g. ffmpeg -i video-audio.m4a \ -af "silenceremove=…
Unfortunately a byproduct of listening to everything at 2x is I've had a number of folks say they have to watch my videos at 0.75x but even when I play back my own videos it feels painfully slow unless it's 2x.
For reference I've always found John Carmack's pacing perfect / natural and watchable at 2x too.
A recent video of mine is https://www.youtube.com/watch?v=pL-qft1ykek. It was posted on HN by someone else the other day so I'm not trying to do any self promotion here, it's just an example of a recent video I put up and am generally curious if anyone finds that too fast or it's normal. It's a regular unscripted video where I have a rough idea of what I want to cover and then turn on the mic, start recording and let it pan out organically. If I had to guess I'd say the last ~250-300 videos were recorded this way.
Re: OpenAI charges by the minute, so speed up your audio
#120Earlier quoted context omitted.
Hahaha. Okay, okay... I will watch it now ;) (Thanks for your good sense of humor)
I like that your post deliberately gets to the point first and then (optionally) expands later, I think it's a good and generally underutilized format. I often advise people to structure their emails in the same way, e.g. first just cutting to the chase with the specific ask, then giving more context optionally below. It's not my intention to bloat information or delivery but I also don't super know how to follow thi…
I frequently do the same, and eventually someone sent me this HBR article summarizing the concept nicely as "bottom line up front". It's a good primer for those interested.
https://hbr.org/2016/11/how-to-write-email-with-military-pre...