Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: YouTube Full Text Search – Search all of a channel from the commandline

github.com

Post reply on HN
Print view View original

81–90 of 172 posts

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#81

Post by lettergram »

dividedbyzero wrote: post #77
hackernewds wrote: post #72

Earlier quoted context omitted.

Rumble will perish due to its controversial niche, which mind-numbingly is also its main moat

I've not come across Rumble yet, is this comparable to Twitter vs. Truth Social (minus the drama)?

It’s closer to something between YouTube and twitch; they’re trying to grow by targeting the niches kicked off of youtube and twitch

To put in perspective: there’s a ton of attorneys on there, right and left wing pundits that had their channels kicked off YouTube.

They also have UFC, sports, gaming, gun channels, etc. and that seems to be where they’re trying to grow most.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#82

Post by tourmalinetaco »

hackernewds wrote: post #72
lettergram wrote: post #66

Earlier quoted context omitted.

There’s twitch and I think Rumble is going to give it a run for it’s money. I grant Rumble is only 1% the size of YouTube by viewership, but I think that’ll shift fairly rapidly and we can see 10% on rumble in 3 years. My analysis https://austingwalters.com/an-analysis-on-rumble-nasdaq-rum/

Rumble will perish due to its controversial niche, which mind-numbingly is also its main moat

Hardly “controversional”, considering it’s just the completely legal views that YouTube censors.

What will really kill Rumble is the fact that they aren’t a YouTube competitor, more a small island off the coast that is mainly centered on said niche and lack the means of true innovation.

Personally I find Odysee/LBRY much more interesting. Fully open source protocol, more varied creators, transparent moderation due to a public blockchain, and P2P file distribution are all incredibly enticing features to me.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#83

Post by tourmalinetaco »

lettergram wrote: post #80
hackernewds wrote: post #72

Earlier quoted context omitted.

Rumble will perish due to its controversial niche, which mind-numbingly is also its main moat

I kind of agree about the most and niche, but think you’re wrong about the conclusion. That niche has ~50% of Americans and a large portion of the globe fine with it. Put simply, as YouTube pushes out niches (guns, comedy, pundits, etc). They move to rumble. This increases the network effects on rumble and will help it grow rapidly. The more niches on rumble, the less of a need to go to YouTube. YouTube effectively k…

> supposedly, I have my doubts tbh

I do too. The same people I see pushing Rumble were the same people pushing Parler, which for all intents and purposes was a honey pot. Not to mention anything rooted in politics, regardless of side, will be endorsing the “right content” and punishing the “wrong content” in various ways.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#84

Post by danols »

hackernewds wrote: post #73
hysan wrote: post #12

Earlier quoted context omitted.

I would posit that google has determined that it’s more profitable to keep viewers on YouTube via controlling the viewing experience vs whatever additional ad revenue they’d gain by making videos more easily indexable. I’m basing this hypothesis on YouTube’s consistent trend of removing features related to controlling your own viewing experience. For example, removing subscription collections.

I despise YouTube purely for inflicting mandatory Shorts on the user.

This extension does a good job of removing them from your subscription feed. If you like me, guard your feed since you don't want to watch random stuff from the home page this is the only way to not totally clutter the feed with random shorts thumbnails. The very fact you can not disable shorts from your feed is outrageous, but obviously not surprising.

https://chrome.google.com/webstore/detail/youtube-shorts-blo...

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#85

Post by tourmalinetaco »

hackernewds wrote: post #73
hysan wrote: post #12

Earlier quoted context omitted.

I would posit that google has determined that it’s more profitable to keep viewers on YouTube via controlling the viewing experience vs whatever additional ad revenue they’d gain by making videos more easily indexable. I’m basing this hypothesis on YouTube’s consistent trend of removing features related to controlling your own viewing experience. For example, removing subscription collections.

I despise YouTube purely for inflicting mandatory Shorts on the user.

I’ve noticed a similar problem with Tumblr’s app. Last year they added a “live” feature, apparently trying to carve out some minor slice of egirl pie, and proceeded to put it all over the UIs. Also popups asking you to pay money. Needless to say UX has dramatically devolved on their app.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#86

Post by guerrilla »

derefr wrote: post #3

I love that a third party is stepping up here, but it's incomprehensible to me that Google doesn't do this themselves. They're a search company, and they own YouTube. The YouTube data — including the subtitle files — is already sitting there on their servers; they don't have to scrape it, they just have to index it. What are they even doing? Fun thing to try: do a Google search with "site:youtube.com" in it. You get…

> but it's incomprehensible to me that Google doesn't do this themselves.

How is it incomprehensible that they don't give a shit about what you want to see and only care about what's profitable to them for you to see?

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#87

Post by gniv »

ramraj07 wrote: post #62
gniv wrote: post #26

Earlier quoted context omitted.

Beyond conspiracy theories it's interesting to speculate why Google is not providing native search-in-subtitles and search-in-comments. The easiest explanation is that they don't trust the quality. They probably tried it and reached the conclusion that it doesn't improve search in any meaningful direction. I know from experience that search in user reviews is very hard. Unless you really understand the review (which…

I’m pretty sure google uses the captions in search. As long as you search from within YouTube. I regularly search for keywords and find hourlong videos where it’s mentioned somewhere in the middle and nowhere in the description.

I still have doubts. Google uses anchors heavily in search, so it's hard to prove if a result is due to matches in captions or in a website linking to the video. Would be good to find proof one way or another.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#88

Post by moritonal »

hnarn wrote: post #56
nomilk wrote: post #30

> yt-fts is a simple python script that uses yt-dlp to scrape all of a youtube channels subtitles and load them into an sqlite database that is searchable from the command line. Critically, this is per channel . I wonder if we can optionally configure this to share the downloaded transcripts to a central repository so eventually a good proportion of youtube's transcripts could be downloaded as one big text file.

> share the downloaded transcripts to a central repository Sure, are you willing to host it and handle the absolutely inevitable legal issues?

I wish IPFS was better. It'd be an obvious solution to this. Content hash the YouTube ID and then distribute hosting.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#89

Post by galleywest200 »

hackernewds wrote: post #70
expertentipp wrote: post #46

I think I'll start to use exclusively CLI tools for discovering and downloading of YT content. The entire experience which starts from typing "youtube.com" in the address bar and pressing enter is obnoxiously unbearable.

Downloading? Do you also not believe creators should be compensated for their content?

I already block advertisements on the web, so I see none when on a Desktop web version of YouTube. But I do not use Sponsor Block so those creators still get to show me their ExpressVPN ads or whatever the flavor is today. Also I use Patreon.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#90

Post by reaperducer »

derefr wrote: post #3

I love that a third party is stepping up here, but it's incomprehensible to me that Google doesn't do this themselves. They're a search company, and they own YouTube. The YouTube data — including the subtitle files — is already sitting there on their servers; they don't have to scrape it, they just have to index it. What are they even doing? Fun thing to try: do a Google search with "site:youtube.com" in it. You get…

Heck, when I first heard about YouTube's autogenerated captions

Off-topic, but since I don't use YouTube and you do, in your experience, how are the auto-generated captions? Are they accurate?

I've been unimpressed by speech-to-text engines in the past, so I'm interested to hear if this is a problem that Google's managed to solve.

Post reply on HN