Live data from Hacker News

Show HN: YouTube Full Text Search – Search all of a channel from the commandline

github.com

111–120 of 172 posts

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#111

Earlier quoted context omitted.

In what cases is it unwise to rely on rowid over a id field?

I don’t think there are any. They are one and the same — if you create an integer primary key named id it is aliased to rowid : https://www.sqlite.org/rowidtable.html

This is safer-- relying on implicit rowids can break things if you use a plaintext database dump (those don't have rowids), and having a column "id integer primary key" is clearer in the schema.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#112
post #107
post #3

I love that a third party is stepping up here, but it's incomprehensible to me that Google doesn't do this themselves. They're a search company, and they own YouTube. The YouTube data — including the subtitle files — is already sitting there on their servers; they don't have to scrape it, they just have to index it. What are they even doing? Fun thing to try: do a Google search with "site:youtube.com" in it. You get…

It's quite intriguing that Google doesn't offer full-text search capabilities for YouTube, considering its position as a leading search company. However, I think there are several reasons for this, some of which may not be immediately apparent. Firstly, if Google did offer this feature, it would likely be targeted by Search Engine Optimization (SEO) exploits. In essence, any time a new search parameter is introduced,…

Regarding your second point... I think it's still important because recommendation algorithms work better when users can find content they enjoy outside of the recommended content. If they can't then the recommendations will become stale.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#113
post #100

Earlier quoted context omitted.

I kind of agree about the most and niche, but think you’re wrong about the conclusion. That niche has ~50% of Americans and a large portion of the globe fine with it. Put simply, as YouTube pushes out niches (guns, comedy, pundits, etc). They move to rumble. This increases the network effects on rumble and will help it grow rapidly. The more niches on rumble, the less of a need to go to YouTube. YouTube effectively k…

I wouldn't be so sure, a big part of growing big as an organization is becoming extremely sensitive to the political winds, and Youtube's "content moderation" is really a function of politics in the West. Were Rumble to grow to a comparable size it too would face the same political risks and at that point it could only remain as it is if there was a sizable political force backing. Someone already mentioned Odyssey a…

> remain as it is if there was a sizable political force backing.

Exactly my point, they have half the support. YouTube has the other. It seems reasonable to assume a split of the networks so lots of room for rumble to grow.

Odyssey is going to be attacked by both political sides imo we have seen that already

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#114
post #107
post #3

I love that a third party is stepping up here, but it's incomprehensible to me that Google doesn't do this themselves. They're a search company, and they own YouTube. The YouTube data — including the subtitle files — is already sitting there on their servers; they don't have to scrape it, they just have to index it. What are they even doing? Fun thing to try: do a Google search with "site:youtube.com" in it. You get…

It's quite intriguing that Google doesn't offer full-text search capabilities for YouTube, considering its position as a leading search company. However, I think there are several reasons for this, some of which may not be immediately apparent. Firstly, if Google did offer this feature, it would likely be targeted by Search Engine Optimization (SEO) exploits. In essence, any time a new search parameter is introduced,…

> With billions of videos hosted, the key goal is to keep users engaged by serving up content they're likely to enjoy, thereby increasing view times and ad revenue

Maybe for some users. I just use youtube to find a specific video I need (because people have stopped writing useful how-to's now that they can just make a 10 minute video covering about 1 minute worth of text), and a full text search would be so, so useful.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#115
post #3

I love that a third party is stepping up here, but it's incomprehensible to me that Google doesn't do this themselves. They're a search company, and they own YouTube. The YouTube data — including the subtitle files — is already sitting there on their servers; they don't have to scrape it, they just have to index it. What are they even doing? Fun thing to try: do a Google search with "site:youtube.com" in it. You get…

Have you tried searching through your call history on a Google phone? It's awful. You'd think they'd have a solid search built in but it's nearly useless. Especially considering you're usually searching for that number you only dialed once and isn't in your contacts and is for some reason excluded from your recents, so you go into your call history (strangely hidden behind a menu) and...there's no search function. WTF? You'd think you could filter by area code, date or a general time which the call took place, Google is a search company after all, right? Or am I subtly being nudged to use some of their more profitable products to try and find it again?

FOSS dialer recommendations are welcome btw.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#116
Another avenue for this is to use Tube Archivist, which takes the approach of locally mirroring videos and serving them up in a web interface, complete with comments, subtitles, and an index containing all the above. Definitely overkill if you just want to do a couple text searches though.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#118
post #12
post #3

I love that a third party is stepping up here, but it's incomprehensible to me that Google doesn't do this themselves. They're a search company, and they own YouTube. The YouTube data — including the subtitle files — is already sitting there on their servers; they don't have to scrape it, they just have to index it. What are they even doing? Fun thing to try: do a Google search with "site:youtube.com" in it. You get…

I would posit that google has determined that it’s more profitable to keep viewers on YouTube via controlling the viewing experience vs whatever additional ad revenue they’d gain by making videos more easily indexable. I’m basing this hypothesis on YouTube’s consistent trend of removing features related to controlling your own viewing experience. For example, removing subscription collections.

Whenever I notice an "obvious" potential feature that could improve user experience in a Google product (there are MANY), I automatically assume it's because of one of two things:

a. Doing it won't get anybody a promo.

b. They've considered it and determined that it will lose revenue to a degree that is not justified by the usability improvement.

This is one of the pitfalls of having an ad-based product instead of a fee-based product. User experience is just no longer the top priority.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#119
post #26

Earlier quoted context omitted.

Beyond conspiracy theories it's interesting to speculate why Google is not providing native search-in-subtitles and search-in-comments. The easiest explanation is that they don't trust the quality. They probably tried it and reached the conclusion that it doesn't improve search in any meaningful direction. I know from experience that search in user reviews is very hard. Unless you really understand the review (which…

I’m pretty sure google uses the captions in search. As long as you search from within YouTube. I regularly search for keywords and find hourlong videos where it’s mentioned somewhere in the middle and nowhere in the description.

I suspect what you see is the search "learning" from the users -- someone is looking for a specific video that they've seen before but need to refine the search terms a few times before they find it. Thereafter, Google remembers the entire sequence of search terms and associates them with the video even though none of those terms might actually exist in the indexed video metadata. I've noticed that Google Search at least does this very obviously.

Re: Show HN: YouTube Full Text Search – Search all of a channel from the commandline

#120
This reminded me that Google Podcast search function clearly uses some kind of transcription index for its search. However, I wish they included at least partial matches as part of the search results (similar to how Google Books search works).
Post reply on HN