Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The lie of music discovery algorithms

zeynepevecen.dev

Post reply on HN
Print view View original

11–20 of 198 posts

Re: The lie of music discovery algorithms

#11

Post by zeynepevecen »

Many of you asked how it looks, how it works. I've added a video under the blog post, showing how it works.

Many of you were also interested in knowing what's going on behind the scenes. The setup is pretty basic. I've built a NextJS app, for the LLM model I am using open AI gpt-4-turbo and sending the images there directly without any database for images. I did a little prompting to get the same output everytime and when I get the output I make search on the Spotify API, find the songs and create the playlist with them on your own authenticated spotify account.

Likewise I also don't have a database for the emails eighter. I am using spotifys authentication.

As I said before this was just for me at first but it is very exticing to see many people interested by this idea.

If you don't trust openAI models and don't wanna send any pic data to them please don't write your email

Re: The lie of music discovery algorithms

#12

Post by zeynepevecen »

DrinkWater wrote: post #8

I don’t see any connection at all between my photos and the music I listen to. This seems really, really random. Plus, there is no real explanation on the page as to how this would work, not even from a high level.

The setup is pretty basic. I've built a NextJS app, for the LLM model I am using open AI gpt-4-turbo and sending the images there directly without any database for images. I did a little prompting to get the same output everytime and when I get the output I make search on the Spotify API, find the songs and create the playlist with them on your own authenticated spotify account.

Likewise I also don't have a database for the emails eighter. I am using spotifys authentication

Re: The lie of music discovery algorithms

#13

Post by zeynepevecen »

bsenftner wrote: post #10

Music discovery has never worked for me, for the simple reason it's the lyrics, not the music. I listen to anyone speaking truth, (the truth I believe, of course), and that gives me a wide disjoint range of music, but they are all singing about political social truths. Marvin Gaye, Public Enemy, Rage Against The Machine, Beyonce, The Stranglers, The Jam, Psychic TV... It's the lyrics, and now today, we finally have t…

That's a very good point, I also love discovering with lyrics. What I tried to do is to find some connections between the image and music, maybe some connection we as humans cannot see right away.

Re: The lie of music discovery algorithms

#14

Post by zeynepevecen »

jerrygoyal wrote: post #3

how does it technically work?

The setup is pretty basic. I've built a NextJS app, for the LLM model I am using open AI gpt-4-turbo and sending the images there directly without any database for images. I did a little prompting to get the same output everytime and when I get the output I make search on the Spotify API, find the songs and create the playlist with them on your own authenticated spotify account.

Likewise I also don't have a database for the emails eighter. I am using spotifys authentication

Re: The lie of music discovery algorithms

#15

Post by zeynepevecen »

BillFranklin wrote: post #5

This is great to hear, though I'm curious why photos on your phone / pinterest would be relevant to a recommendation system? Surely the biggest signal would be what Spotify already uses: the features of various relevant factors (your previous listening sessions, your current session, what other similar sessions look like, etc.), that said, their recommendation system is surprisingly terrible given how much easier mus…

Thank you! I should check youtube's algorithm too.

Yes, I have a prompt like that the current prompt is this:

            'You match the vibes of the pictures with the right songs and turn them into a 3 song playlist with a playlist name. The music genre of the playlist should be consistent for each song. Be creative with music selections, explore different music, be consistent in terms of the genre of the 3 songs. The playlists should be provided in an object array format, like this: \'[{playlistName: "string", songs: [{songName: "string", artist: "string"}, {songName: "string", artist: "string"}, {songName: "string", artist: "string"}]}]\'. Do not add any other text information and only give outputs in the provided format. Your playlists must match the visual vibes and maintain the specified format without any additional information.',
Pretty basic, as i said before this was only ment for me and to explore this idea, but i loved it so I wanted to share :)

Re: The lie of music discovery algorithms

#16

Post by Retric »

BillFranklin wrote: post #5

This is great to hear, though I'm curious why photos on your phone / pinterest would be relevant to a recommendation system? Surely the biggest signal would be what Spotify already uses: the features of various relevant factors (your previous listening sessions, your current session, what other similar sessions look like, etc.), that said, their recommendation system is surprisingly terrible given how much easier mus…

YouTube’s algorithm isn’t very good for users because it doesn’t really separate mildly interesting videos that you finish from awesome content you loved.

YouTube of course doesn’t care because they don’t make more money when you see something awesome.

Re: The lie of music discovery algorithms

#17

Post by aljgz »

In the age of internet, engagement optimization and recommendation algorithms create a new way that we are affected by the behaviour of others.

That annoying dark pattern on a piece of software you use? Because there are people who fall to it, clicking on an ad or "engaging" more. That stupid show that keeps being recommended to you? Because a lot of people just sit on the couch, watching something on the list that does not need too much mental processing.

I have a peculiar taste in Music. I love many many different types of music, but once I find a really good piece, I'm not interested in things that are very similar to this one. Looks like if we describe musical work with high dimensional vectors, I like to find good vectors that are not too close to each other. But as the author said, Spotify keeps showing me music that's similar to what I've listened. That's exactly what I don't like (with the occasional exception of something being better than the one I've already found and replacing it).

I assume I belong to a peculiar minority. The recommendation algorithms work very well for predictable majorities.

Maybe someday we have an interesting "musical embeddings" model, and then people can implement personalized discovery algorithms using that?

Re: The lie of music discovery algorithms

#19

Post by mushufasa »

No music discovery algorithm has satisfied me. All data-driven approaches make predictions based on historical data. Personally I enjoy being exposed to entirely new genres and sounds I've never heard before, instead of variations on genres I've listened to a lot.

My solution: listening to NTS, an eclectic online radio station, where diverse artists create playlists.

Re: The lie of music discovery algorithms

#20

Post by sor1nmarkov »

another-dave wrote: post #18
sor1nmarkov wrote: post #7

[flagged]

I don't think he wants a passport photo, just saying any picture as a seed — just enter a photo of a dog (so long as it's not your "first pet" with a personalised name tag round her neck)

Oh you are right I was being literal not sarcastic
Post reply on HN