[deleted]
Synchronizing Pong to music with constrained optimization
11–20 of 40 posts
Re: Synchronizing Pong to music with constrained optimization
#12Very cool! As a further variation on this idea, I'm imagining training a reinforcement learning agent on atari games / super mario, but with an additional music-based reward/input, to try to get a "musical" looking playthrough... (Not sure how good it would look / whether it would be worth it though...)
Re: Synchronizing Pong to music with constrained optimization
#13Imagining an `installation` in my space, using both my MT-80S and a display. Can I even reason about this, the timing? I'm not smart here, just interested
https://www.matrixsynth.com/2014/07/roland-mt-80s-midi-playe...
Re: Synchronizing Pong to music with constrained optimization
#14Really interesting. For some reason my brain really really hates this. I think it screws with my internal model of causality or something and I find it difficult to watch. Odd
Re: Synchronizing Pong to music with constrained optimization
#15Really interesting. For some reason my brain really really hates this. I think it screws with my internal model of causality or something and I find it difficult to watch. Odd
It seems like the ball bounces off the center of the paddle, not the edge, which always makes it look wrong. Maybe you're seeing the same problem?
Re: Synchronizing Pong to music with constrained optimization
#16Really interesting. For some reason my brain really really hates this. I think it screws with my internal model of causality or something and I find it difficult to watch. Odd
For me the most conspicuous thing missing is dynamics... particularly when there are "ghost notes" in between much louder ones during a fast passage, it seems like something is missing.
That said, however, I find it to be oddly satisfying to watch. Curious if experience playing different instruments has anything to do with it. To me, something like a xylophone or a steelpan feels pretty analogous to this.
Re: Synchronizing Pong to music with constrained optimization
#17Very cool! As a further variation on this idea, I'm imagining training a reinforcement learning agent on atari games / super mario, but with an additional music-based reward/input, to try to get a "musical" looking playthrough... (Not sure how good it would look / whether it would be worth it though...)
Crypt of the NecroDancer explores this idea of rhythmically timing your character's movement to get bonuses in game.
Re: Synchronizing Pong to music with constrained optimization
#18Really interesting. For some reason my brain really really hates this. I think it screws with my internal model of causality or something and I find it difficult to watch. Odd
For me the most conspicuous thing missing is dynamics... particularly when there are "ghost notes" in between much louder ones during a fast passage, it seems like something is missing. That said, however, I find it to be oddly satisfying to watch. Curious if experience playing different instruments has anything to do with it. To me, something like a xylophone or a steelpan feels pretty analogous to this.
I think it may be synthesized – I thought the reverb was a little off, and noticed there was little to no change in timbre when the dynamics changed.
Re: Synchronizing Pong to music with constrained optimization
#19Delightful. Part of the fun is that the game is a background to the music rather than the other way around that we are used to.
Re: Synchronizing Pong to music with constrained optimization
#20Very cool! As a further variation on this idea, I'm imagining training a reinforcement learning agent on atari games / super mario, but with an additional music-based reward/input, to try to get a "musical" looking playthrough... (Not sure how good it would look / whether it would be worth it though...)
Crypt of the NecroDancer explores this idea of rhythmically timing your character's movement to get bonuses in game.
Don’t forget the legend of Zelda spinoff “cadence of hyrule” which I’m pretty sure was made by the same guys as crypt of the necrodancer.