Live data from Hacker News

Rethinking Sheet Music, With A Few Bells And Whistles

npr.org

11–20 of 43 posts

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#12

I think a killer feature for this (or a competitor...) would be auto-turning pages using the ambient audio. "While I am playing piano and have no hands I have to deftly change the music, therefore I need another human " is a huge pain point for performing pianists.

The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky.

However, I worked on the prototype for a music app that does polyphonic pitch detection for a greater effect than page turning. It listens and follows along note by note as you play your (real) guitar and, as you hit the notes properly, actually uses the master tracks of rock songs to give you a very cool sensation of playing the real song. It's called Rock Prodigy: Guitar and is free with per-song IAPs if you want to try it out.

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#13
post #12

I think a killer feature for this (or a competitor...) would be auto-turning pages using the ambient audio. "While I am playing piano and have no hands I have to deftly change the music, therefore I need another human " is a huge pain point for performing pianists.

The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky. However, I worked on the prototype for a music app that does polyphonic pitch detection for a greater effect than page turning. It listens and follows along note by note as you play your (real) guitar and, as you hit the notes properly, actually uses the master tracks of rock songs to give you a ver…

Following an existing score should be a lot easier than de novo polyphonic transcription. For example, you could almost just track the beat while ignoring all the pitches.

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#15
post #13
post #12

Earlier quoted context omitted.

The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky. However, I worked on the prototype for a music app that does polyphonic pitch detection for a greater effect than page turning. It listens and follows along note by note as you play your (real) guitar and, as you hit the notes properly, actually uses the master tracks of rock songs to give you a ver…

Following an existing score should be a lot easier than de novo polyphonic transcription. For example, you could almost just track the beat while ignoring all the pitches.

With a rhythm-game type app, you can dictate what the user is supposed to be playing. With a sheet music app, not so much.

People will want to play the first few measures over and over, try something again after messing it up, stop and take it from the top and so on. If you turn the page too soon or scroll the music the user is playing off the screen, the customer reviews are going to look like Armageddon has come.

The only way I see that works understandably and well enough is to recognize when the last measure of the last staff is completed. Even that may be incompatible with some music, but it should work well enough in general.

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#16
post #13
post #12

Earlier quoted context omitted.

The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky. However, I worked on the prototype for a music app that does polyphonic pitch detection for a greater effect than page turning. It listens and follows along note by note as you play your (real) guitar and, as you hit the notes properly, actually uses the master tracks of rock songs to give you a ver…

Following an existing score should be a lot easier than de novo polyphonic transcription. For example, you could almost just track the beat while ignoring all the pitches.

It's impossible to do that with a lot of non-standard notational music. And even with standard music, "the beat" is annoying to track and changes FAR more than you'd expect. Good musicians are constantly altering the beat in subtle and unsubtle ways.

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#17

I think a killer feature for this (or a competitor...) would be auto-turning pages using the ambient audio. "While I am playing piano and have no hands I have to deftly change the music, therefore I need another human " is a huge pain point for performing pianists.

I'd think out of the box on this, and just give the user another channel to control the page turning. The most natural choice I could see would be some sort of eye or head tracking. Though I suspect that rather than trying to guess where they are in the sheet music, I'd just give them a visual target off to the right or left that if they gaze upon/turn towards it the page turns forward (or back).

The problem with solutions based on tracking where we are in the music, then inferring the correct action, is that it still encodes assumptions about when the page should be turned, which is great... until it's wrong.

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#18

I think a killer feature for this (or a competitor...) would be auto-turning pages using the ambient audio. "While I am playing piano and have no hands I have to deftly change the music, therefore I need another human " is a huge pain point for performing pianists.

Here's a much simpler solution: a page-turning pedal: http://www.bilila.com/pagescore_turner

Re: Rethinking Sheet Music, With A Few Bells And Whistles

#19
A company that launched at TC Disrupt does this: http://tonara.com/

"Think of it as sheet music for the iPad generation. Tonara is an iPad app that can map your keyboard pounding to the right place on the sheet music, and then magically flip the page at the right point.

Married to a store selling sheet music, it’s pretty clear that something interactive like this will do to sheet music what Kindle did to hardback books. TechCrunch’s panel of judges were dubious of the size of the market, but our guess is this company will be quietly have its tip jar filled high as it plays a requiem for sheet music anthologies." - http://www.wired.com/epicenter/2011/09/startups-techcrunch-d...

They also have a nice video showing it in action: http://www.youtube.com/watch?v=HBXJZKTOcpw

Post reply on HN