Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Discover what songs were used in YouTube videos

mooma.sh

Post reply on HN
Print view View original

41–46 of 46 posts

Re: Show HN: Discover what songs were used in YouTube videos

#41

Post by brianwhitman »

mo0 wrote: post #21
unltd wrote: post #5

Earlier quoted context omitted.

I've worked on the echoprint-codegen algorithm for my current project ( trak.rocks ) and I'm curious about how you reimplemented the matching logic ? Do you plan to document/opensource you work ?

First we rewrote echonests truescore logic in perl and then altered slightly and implemented some extra checks to further try to exclude false positives. We also believe what they used in the late song/identify API might have been different from what is open sourced in https://github.com/echonest/echoprint-server Also we pack each individual hash before storing in Elasticsearch and gained at least 50% storage space t…

song/identify supported both ENMFP and Echoprint, and AFAIK the Echoprint matching path was exactly the same as is published on Github.

I know at some point we did adapt the Solr end (for example, we removed the N most occurring codes) for speed optimizations.

Many users of Echoprint in the wild have adapted the python matching logic for their use case as well as changed the hash update rate on the codegen. A great modification to watch was Sunlight Labs' "Ad Hawk", which ID'd commercials: https://github.com/sunlightlabs/adhawk

Re: Show HN: Discover what songs were used in YouTube videos

#42

Post by [deleted] »

DanBC wrote: post #15

I love this. Thank you. On a slight tangent: I'd love a client that could identify my MP3 collection, and rename it and retag it (under some kind of supervision). Ideally it'd do the dentification in a batchmode when it got Internet connectivity (but this is perhaps an unreasonable requirement). And to make it perfect it would let me listen to and delete tracks. I have a huge unweildy collection of MP3s and I can't b…

[deleted]

Re: Show HN: Discover what songs were used in YouTube videos

#43

Post by tk42 »

tixocloud wrote: post #37
mo0 wrote: post #17

Earlier quoted context omitted.

Crawling the internet for mp3s. It took us a couple of months to get to 7m.

That's an absolutely creative way of doing it! Congrats. I'm interested in how you did it. For example, how do you exactly "crawl the internet"? Did you have a bunch of sites that you've pre-selected and then just crawl those or did you actually follow through on links? Thanks.

One-click hosters and cloud hosters with sharing options(such as docs.google.com), several music streaming sites, usenet. Also the amount of mp3s hosted on regular webservers which are indexed by and easily found using the usual search engines is mindblowing

Re: Show HN: Discover what songs were used in YouTube videos

#44

Post by tk42 »

unltd wrote: post #31
mo0 wrote: post #12

Earlier quoted context omitted.

Music used in compilations, ads, intros etc are typical usecases. Mixtapes & livesets of course are also great. But when pitch/bpms have been altered more than 1-2% we currently get a lot of false positives. We are still working on finding a solution to this.

I think I've read on the echonest board that the most common solution is to index multiple pitch variants of the same songs. Apparently that's what Shazam does. Also the guys from Trax-air.com are doing something pretty similar to you guys but with pitch/bpm bending support.

So far we've been hesitant to go that route as the current 7m fingerprints come down to 42m+ documents in Lucene. I.e. If we were to save 20 versions of each fingerprint in different bpms we'd quickly have about a billion+ documents on our hands to be searched on every query (with ~1000-2000 hashes per document)

Re: Show HN: Discover what songs were used in YouTube videos

#45

Post by pvaldes »

scrapcode wrote: post #10
unltd wrote: post #8

Great Job ! Could you describe the usecases ? Is it for mixtapes uploaded on youtube by DJs, or Over-The-Air recognition in music festival videos ? Because Music ( single tracks ) uploaded on youtube is usually already identified so it could be found.

One of the most common comments on YT videos I see are people asking for the name of the song used in a video.

Yes, is one of the archetypical creatures of internet. I bet that 99% of those people are lawyers... or maybe the author of the song.

Re: Show HN: Discover what songs were used in YouTube videos

#46

Post by Tunecrew »

This is very interesting - I see this as an ideal concept to be paired with one of the existing commercial solutions, e.g. Shazam.

If you're indexing all the random and free stuff out there, you're picking up a lot of material that may have never been commercially released or has not been re-released digitally. At the same time, Shazam, YouTube ContentID, Apple's iTunes Match, etc. have access to an extremely large set of references which (more than you could have) contain 99% accurate metadata. ContentID definitely picks up multiple songs in mixes, as well as pitch changes, with a high degree of accuracy (assuming the master sound recording has been submitted to YouTube).

A submission system would be great too, or some way for persons to tag stuff themselves ala discogs, etc.

Post reply on HN