Visualizing Music with GANs • Hacker News Board

Re: Visualizing Music with GANs

#31

Post by TeMPOraL » Thu, Oct 31, 2019, 7:27 AM UTC

McIceT wrote: post #13

reikonomusha wrote: post #9

I had trouble connecting the music to the transitions and morphs. I perceived it just as music overlaid on fun-to-see GAN-generated images, though clearly that’s not the aim. The music is beautiful and the imagery is intriguing, however.

This is something I've been working on https://www.youtube.com/watch?v=52qWiLoOeIQ you should clearly see the connection between the morphs and the music

Absolutely. Amazing. I was waiting for someone to try this, and you did, and the results are way more impressive than I imagined they would be.

(Try this with different kinds of songs if you can!)

Re: Visualizing Music with GANs

#32

Post by McIceT » Thu, Oct 31, 2019, 10:06 AM UTC

TeMPOraL wrote: post #31

McIceT wrote: post #13

Earlier quoted context omitted.

This is something I've been working on https://www.youtube.com/watch?v=52qWiLoOeIQ you should clearly see the connection between the morphs and the music

Absolutely. Amazing. I was waiting for someone to try this, and you did, and the results are way more impressive than I imagined they would be. (Try this with different kinds of songs if you can!)

Any specific song request? :)

Re: Visualizing Music with GANs

#33

Post by eufouria » Fri, Nov 01, 2019, 4:11 PM UTC

McIceT wrote: post #18

jressey wrote: post #17

Earlier quoted context omitted.

I'm blown away. So the glasses are always present when the bass/808s are hitting, so is there something that maps the sound to the images? What is it about the algorithms that make the images 'dance' so quickly between the 3.5 beat and the 1? Is it because there are static risers that move so quickly through the wave spectrum? Wait... is light skin mapped to when highs dominate and dark skin to lows?

I'm glad you like it! Actually compared to the linked post I don't do any manual latent-space representation selection. It's just a bit of "smart" signal processing. I've written a framework that makes it really simple to do these visualizations (not open-source yet). Here's one more example: https://www.youtube.com/watch?v=X4r4njUjE2M

Cool stuff! Would be interested in knowing if and when this library becomes open source. Where could I follow you?

Re: Visualizing Music with GANs

#34

Post by McIceT » Mon, Nov 04, 2019, 3:39 PM UTC

eufouria wrote: post #33

McIceT wrote: post #18

Earlier quoted context omitted.

I'm glad you like it! Actually compared to the linked post I don't do any manual latent-space representation selection. It's just a bit of "smart" signal processing. I've written a framework that makes it really simple to do these visualizations (not open-source yet). Here's one more example: https://www.youtube.com/watch?v=X4r4njUjE2M

Cool stuff! Would be interested in knowing if and when this library becomes open source. Where could I follow you?

You could follow me on twitter @tsmcalister. I'll post there once it's released. Depends a lot on how much time I have to work on it. Hopefully by the end of the month!