Show HN: I trained an AI model on 120M+ songs from iTunes

#1

Post by subtech » Fri, Feb 03, 2023, 12:20 AM UTC

Hey HN!

I just shipped a project I’ve been working on called Maroofy: https://maroofy.com

You can search for any song, and it’ll use the song’s audio to find other similar-sounding music.

Demo: https://twitter.com/subby_tech/status/1621293770779287554

How does it work?

I’ve indexed ~120M+ songs from the iTunes catalog with a custom AI audio model that I built for understanding music.

My model analyzes raw music audio as input and produces embedding vectors as output.

I then store the embedding vectors for all songs into a vector database, and use semantic search to find similar music!

Here are some examples you can try:

Fetish (Selena Gomez feat. Gucci Mane) — https://maroofy.com/songs/1563859943 The Medallion Calls (Pirates of the Caribbean) — https://maroofy.com/songs/1440649752

Hope you like it, and would love to hear any questions/feedback/comments! :D

Show HN: I trained an AI model on 120M+ songs from iTunes
maroofy.com

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#2

Post by superasn » Fri, Feb 03, 2023, 12:40 AM UTC

Nice idea. Not sure how good the recommendations are just yet, but I really wish there was a Spotify button on there.

Also if it's not a trade secret can you expand "My model analyzes raw music audio as input and produces embedding vectors as output." What kind of analysis are you doing? What is the criteria for picking recommendations? I always find this area of music analysis intersting.

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#3

Post by aryamaan » Fri, Feb 03, 2023, 12:55 AM UTC

It's fast.

But not sure if the song I input and the songs I get back are similar. Going to try them out further.

What things are they supposed to be similar at? beats? melody?

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#4

Post by intelVISA » Fri, Feb 03, 2023, 12:58 AM UTC

Really cool, quite surprising that this hasn't been done (well) before afaik.

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#5

Post by cirrus3 » Fri, Feb 03, 2023, 12:58 AM UTC

I searched for "Hot Chip" and all the recommendations were other Hot Chip songs... is that normal? I was expecting different artists, and honestly not expecting any songs by the same artist.

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#6

Post by goldemerald » Fri, Feb 03, 2023, 1:01 AM UTC

Wow, these songs were impressively similar to my queries. I would love for a interpolation playlist feature, where I put in 2 different songs (from say, classic rock and EDM), and I could get 10-20 songs that slowly change from the start song to the end song.

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#7

Post by bradhilton » Fri, Feb 03, 2023, 1:01 AM UTC

Very cool, just tried it out and seems to work. Great job

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#8

Post by SnowflakeOnIce » Fri, Feb 03, 2023, 1:02 AM UTC

What vector database do you use? Did you run into any scalability challenges there?

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#9

Post by physPop » Fri, Feb 03, 2023, 1:04 AM UTC

Seems like your server is down or overloaded

Re: Show HN: I trained an AI model on 120M+ songs from iTunes

#10

Post by rayshan » Fri, Feb 03, 2023, 1:05 AM UTC

Interesting idea. I think it needs some finetuning to find songs that are similar but not covers. For well-covered songs like Bohemian Rhapsody, this is more like a cover-finder.

Also this song, Shangri-La Is Calling, is bugging out: https://maroofy.com/songs/1632142336