Live data from Hacker News

Show HN: VideoMentions – Search YouTube based on the spoken words in videos

videomentions.com

131–138 of 138 posts

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#131
post #61
post #54

I wanted to try it but for some reason it doesn't accept Lex Fridman's channel as a valid URL: https://www.youtube.com/c/lexfridman

I tried with some other channels. Looks like It's not accepting all channels as valid urls.

Hey @pks016 - if you recall a new channel URLs that didn't work, can you please reply with them? Then I can look into why and fix that bug.

Thanks for checking out my project!

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#132
post #24

How is this different from what Google currently does for in-video text search?

Currently, YouTube does not reliably include spoken word/transcript matches in search results. You would have to manually open each individual video in a browser tab, open the transcript, hit cmd/ctrl+f and search for the words you're interested in. And if you need to search tens/hundreds/thousands of videos, that would take a very long time.

VideoMentions Search allows you to specify the channel URL, keywords and date range, then does all that hard work for you, quickly locating all videos that contain those keywords.

I hope that's helpful. Thanks for checking out my project!

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#133
post #52

Great job! How do you do search result ranking? Any signals that you use to decide “this is a high quality video from reputable channel and it’s relevant”? I would imagine # of followers / likes / comments / like-comment ratio or the likes are used?

Thank you! I don't do anything fancy at the moment. The matching videos are presented in reverse chronological order. So you'll see the most recent videos that contain the keywords at the top, then older video matches as you scroll down the page. And the user provides the URL of the single YouTube channel they want to search within.

Thanks for checking out my project!

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#134
post #55

FWIW Google already shows videos by their transcripts if the video has automatic captions or CC enabled in the Google search results. Try searching for a very specific phrase/sentence in quotes and it's likely you'll get the video in Google Search result page.

I have found that this method is unreliable. If I run a Google search for "the "paradox of choice. You have so many choices, how do you know which one to pick? Even when I recommend to newer developers in the React", no YouTube video results are displayed, despite the fact that that exact string of text exists in the transcript of this video: https://www.youtube.com/watch?v=uQntFkK8Z54

That's why I built VideoMentions Search. It pulls in the transcript for every video within the channel and date range you selected and shows you any and all matches.

Also - even when a Google search does work to find a video based on spoken words, all you're given is a link to that video's page. You can't see all the times that keyword was mentioned within the video and click on one of those mentions to jump to that exact moment in the video, like you can with VideoMentions Search.

If Google/YouTube added those capabilities, then VideoMentions Search would be irrelevant. In the meantime though, I think it's a useful free tool for quickly finding spoken word matches within a specific channel.

Thanks for checking it out!

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#135

This is a nice tool. I wish one didn't have to specify the channel, as some comments mentioned. If it's not possible to get the channel when providing the video url via an API, it is possible to get it from the video url's GET response data. The latter may be little slower, but might be worth it in terms of UX.

Hey @atentaten! YouTube doesn't provide a way to search across all of YouTube based on transcriptions/spoken words, unfortunately. That's why specifying a channel is required. Once the user provides a channel URL, then VideoMentions Search can perform an on-the-fly search of the videos on that channel to identify matches.

Thanks for checking out my project!

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#136

Earlier quoted context omitted.

Hey @hanniabu! I do client-side in-memory caching of videos data, only. No server-side caching. In fact, there is no database involved at all- the client-side app calls serverless function API endpoints to fetch the YouTube channel and video data it needs. Here are the tricks I'm using to make it fast: - As soon as the "Channel URL" field loses focus, I start fetching the most recent 30 videos on that channel in the…

>I do client-side in-memory caching of videos data, only. This works only if the user does not navigate from and back to your website or refresh the page, but if they do, you make the same api calls all over again. You should set HTTP Cache-Control headers in your response from the server, so that the browser knows that it can serve that data from its cache and does not need to make those requests again. You would th…

I could do this, but it would introduce other cache invalidation issues. Take this sequence of events, for example:

* The user performs a search, reviews the matches, then closes the browser tab.

* The title or description for one or more of the videos on that YouTube channel are updated.

* 45 minutes later, the user remembers that they wanted to search for something else on that same YouTube channel. They return to VideoMentions Search to perform another search.

If I had sent cache-control headers in the first response telling the browser to cache the results of those HTTP requests, they would not be refetched for subsequent requests and the user would potentially be shown incorrect matches.

By fetching the data fresh whenever the user opens VideoMentions Search in a new browser tab, I guarantee that they're getting correct matches based on the titles, descriptions and spoken words that the videos have at the time the search is performed.

So as it's implemented currently, I'm choosing to take a performance hit in exchange for improved accuracy. And I'm comfortable with that tradeoff since searches seem decently speedy to me when I use the tool.

Thanks for your thoughts, and the alternative client-side caching idea!

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#137
post #24

How is this different from what Google currently does for in-video text search?

Currently, YouTube does not reliably include spoken word/transcript matches in search results. You would have to manually open each individual video in a browser tab, open the transcript, hit cmd/ctrl+f and search for the words you're interested in. And if you need to search tens/hundreds/thousands of videos, that would take a very long time. VideoMentions Search allows you to specify the channel URL, keywords and da…

Thank you for responding. This looks like a very cool project.

Re: Show HN: VideoMentions – Search YouTube based on the spoken words in videos

#138

Earlier quoted context omitted.

Could you do a search based on their watch history if they have it enabled?

This is a cool idea! It wouldn't apply to people who want to search all the videos on a given channel for specific keywords (including those they haven't watched). I can see it being useful for folks trying to locate a specific video they remember watching in the past, though. One consideration is that getting the user's watch history would likely require calls to the YouTube API. So that means I would have to make t…

Sadly YouTube API doesn't allow you to retrieve user's history, so you need to scrape that aswell.

I created a exactly that project: https://github.com/victor141516/YourArch

Post reply on HN