Cool project! I have a suggestion - since the processing is done on a moderately powerful laptop anyway, is it possible to bypass the foot pedal and use audio (from laptop or glasses) to predict when to switch to the next bar? I assume it will be a complicated but would trying to match the FFT series to the sheet music pitch data work (or would harmonics cause major headcahes?)
I put sheet music into smart glasses [video]
11–20 of 72 posts
Re: I put sheet music into smart glasses [video]
#12Super cool PoC. Also an advertisement for the value of local processing over cloud.
Re: I put sheet music into smart glasses [video]
#13Now that’s an awesome hackathon project! Exciting to see that smartglasses are finally getting to an interesting place.
Re: I put sheet music into smart glasses [video]
#14This project is cool so we're hoping to arrange with Kevin to do a Show HN about it, so stay, er, tuned!
[deleted]
Re: I put sheet music into smart glasses [video]
#15Nice work. From the Github: > This allows the pianist to not have to turn pages, and more importantly, allows them to see the music and their hands at the same time, which is an unavoidable problem with traditional sheet music. I could definitely see this being beneficial for beginners. When I lived in a dormitory during uni I often played familiar pieces from memory pretty late on a digital piano (with headphones) i…
I wanted to say, after a certain level looking at your fingers when playing an instrument becomes the equivalent of looking at your legs when riding the bicycle.
When I start to think too much about what my fingers are doing I will play worse. For if I want to practise a particular part where I get the fingering wrong, sure, but when you play it for real, looking is counterproductive.
Something like this could be great for beginners tho. But simular to automatic guitar tuners I am not sure if you should get into the habit of this technology being around.
Re: I put sheet music into smart glasses [video]
#16This is a really cool project.
From the end of the video:
> I had the bars of music auto-sending at a preset interval. The pedals, instead of flipping bars, temporarily pause the flipping or speed it up, in case I'm desynced from the glasses.
That's how teleprompter apps work. Of course the difference is that when speaking you can pause a little if you get desynced, while with music you're like "on a train" and if you pause, it shows. But having an interval is not shocking.
Maybe the problem with this is that typically, sheet music resolution is not constant -- if there are many short notes it will result in a larger space on the page (a larger bitmap) than if there are few long notes.
So maybe an approach is to send a fixed number of bars, regardless of their actual size, so that the interval can have a constant relation with the tempo of the piece?
> My dream smart glasses would just listen to the performance and automatically flip bars
Couldn't the phone do that? The phone is already the part doing most of the work.
Re: I put sheet music into smart glasses [video]
#17Nice work. From the Github: > This allows the pianist to not have to turn pages, and more importantly, allows them to see the music and their hands at the same time, which is an unavoidable problem with traditional sheet music. I could definitely see this being beneficial for beginners. When I lived in a dormitory during uni I often played familiar pieces from memory pretty late on a digital piano (with headphones) i…
> I just stopped having to look down at the keyboard
Maybe the next step is an app for people who don't read sheet music; it would light up the keys on the keyboard that you need to press, when you look at it...?
Same for guitar, highlight where to put your fingers on a fret for each chord.
Re: I put sheet music into smart glasses [video]
#18This project is cool so we're hoping to arrange with Kevin to do a Show HN about it, so stay, er, tuned!
wow that's a special honor. is there a way to search up the "specially invited" Show HNs?
Re: I put sheet music into smart glasses [video]
#19TIL about their glasses https://mentra.glass/
great video editing, OP. loved the playthru at the end with the text. you have real talent here, keep giong
Re: I put sheet music into smart glasses [video]
#20Congratulations for the project and for winning the hackathon, nicely done!
I am looking for hackable smart glasses with camera which doesn't rely upon any proprietary service to work, Mentra seems to have a camera version but this video seems to suggest that we need to use their service all the time?