Live data from Hacker News

A.I. Duet: A piano that responds to you

aiexperiments.withgoogle.com

61–70 of 77 posts

Re: A.I. Duet: A piano that responds to you

#61
post #60
post #59

Earlier quoted context omitted.

I think that this response is confused. What is your point? That people can't differentiate random notes from a duet? That people would believe that anything associated with tensorflow was imbued with sophisticated behavior? How does that relate to this experiment? It's clearly not just playing random notes in the example video...

The AI is clearly improvising musically based on the input, it's far from random notes. It's actually pretty cool and I look forward to seeing where it goes from here. The person you're responding to is just an asshole.

What's so hard to understand here? The music it plays sounds awful! I have no doubt te tech behind it is interesting but the results are pretty bad.

Re: A.I. Duet: A piano that responds to you

#62
post #61
post #60

Earlier quoted context omitted.

The AI is clearly improvising musically based on the input, it's far from random notes. It's actually pretty cool and I look forward to seeing where it goes from here. The person you're responding to is just an asshole.

What's so hard to understand here? The music it plays sounds awful! I have no doubt te tech behind it is interesting but the results are pretty bad.

I played with this for a while and never got the impression that it was random notes. A few times it played something quite musical which I found interesting and cool. There seems to be a lot of haters in here for what I can only imagine is some sort of sour grapes jealousy or some shit.. maybe it's the production quality of this video is out of proportion for the effort put into the experiment, I dunno but the experiment itself is cool.

Re: A.I. Duet: A piano that responds to you

#65
This is fun. It actually feels like I'm taking turns with someone else on the other end of the screen who takes what I play and sends back a riff on the notes. The trick is (as the little intro shows) to only play for a few seconds, don't play simultaneous notes, and then stop and let the AI respond. Once the AI has finished, you can try again. If the AI starts playing before you're done, you've screwed up and should make your little sequence of notes shorter. Basically, the title of this is misleading... if you keep playing expecting the AI to join you in a simultaneous duet, it'll sound like cats fighting inside a piano.

Try playing the "Dukes of Hazard" horn: on your keyboard, press (without overlapping the keypresses) "LJGGGHJKLLLJ" and let the AI respond. More often than not, it'll come back with a vaguely pleasing riff on that sequence using mostly the same notes and in the same tempo.

Re: A.I. Duet: A piano that responds to you

#66
post #2

I like the concept and the framing of the demo is really cool, but the actual music generated in response to me doing basic things like playing a blues riff or a pentatonic scale was usually just a repeat of some fragment of what I was playing. It felt like something that could be built using a basic heuristic...

Yeah either the examples from the video are cherry-picked, or something's wrong with the deployment, because what I get is way worse than what's in the video. I really don't like this new trend of throwing Deep Learning at anything without really checking whether a simple model (e.g. markov chains in this case) would give equal results. Because using a simple model wouldn't be "cool" or newsworthy...

Here's a relevant excerpt from research I did on college into this. FWIW, my research was specifically into genetic algorithms and generating similar musical styles as the input music. It didn't perform particularly well but had some surprises.

From my research, a Markov model could potentially be viable for this demo in particular. However, it wouldn't be viable for longer generation of music where you're trying to produce an actual song. The biggest problem being that it doesn't have the concept of melody in it.

--- research after here ---

A Markov model utilized by Herfort and Rehberger [17] uses the immediate previous note in order to determine the next note against a set of probabilities. This is a fairly simple algorithm as the set of rules is not large, but it is extremely short-sighted by nature. This “first order” Markov chain is not capable of determining a probability based on a large sequence of pitches. To counteract this, “N-order” Markov chain models can be determined to look more deeply into the past, but the complexity of the rule set increases exponentially with added depth. Further, every aspect of music that is to be modeled would require its own Markov model. For instance, there would need to be a model for pitch, duration, etc. This leads to a potentially huge Markov model rule set where all chains are independent of each other. Thus, Markov chains are good at composing musical melodies on the micro level (such as a measure) but fail to produce quality music at the macro level.

[17] Rehberger, Leopold. “Composing music using AI algorithms.” GRIN Publishing GmbH. 2004. " rel="nofollow">http://www.grin.com/en/e-book/108991/composing-music-using-a....

Source: https://github.com/sb8244/GeneticMusicComposition

Re: A.I. Duet: A piano that responds to you

#68
post #66

Earlier quoted context omitted.

Yeah either the examples from the video are cherry-picked, or something's wrong with the deployment, because what I get is way worse than what's in the video. I really don't like this new trend of throwing Deep Learning at anything without really checking whether a simple model (e.g. markov chains in this case) would give equal results. Because using a simple model wouldn't be "cool" or newsworthy...

Here's a relevant excerpt from research I did on college into this. FWIW, my research was specifically into genetic algorithms and generating similar musical styles as the input music. It didn't perform particularly well but had some surprises. From my research, a Markov model could potentially be viable for this demo in particular. However, it wouldn't be viable for longer generation of music where you're trying to…

Just to complete your post, one problem I always have with music generation using "first-order" Markov Chains is that they get really confused by children's music. For example, here's the start of "twinkle twinkle, little star":

CCGG AAG- FFEE DDC-

So the tranistion matrix contails rules like: P(C -> C) = 50% P(A -> A) = 50% P(F -> F) = 50% P(E -> E) = 50%

Which makes huge loops of the same note quite common. This makes for some really uncanny music.

Re: A.I. Duet: A piano that responds to you

#70

Earlier quoted context omitted.

Yeah either the examples from the video are cherry-picked, or something's wrong with the deployment, because what I get is way worse than what's in the video. I really don't like this new trend of throwing Deep Learning at anything without really checking whether a simple model (e.g. markov chains in this case) would give equal results. Because using a simple model wouldn't be "cool" or newsworthy...

When you've described the entire new vision of your company as being "doing things with deep learning", you aren't going to bother seeing if the simpler solution works. Just isn't good for business.

But then a competitor comes along, doing the same thing with vastly less complex model and capable of offering cheaper/faster service because of that.
Post reply on HN