What a great idea. I am a musician and use an iPad for my scores. It would be wonderful to replace my glasses with a pair that can display the music. I noticed the iron ring on your pinkie -- Canadian engineer?
Correct!
I put sheet music into smart glasses [video]
41–50 of 72 posts
Re: I put sheet music into smart glasses [video]
#42TIL about their glasses https://mentra.glass/ great video editing, OP. loved the playthru at the end with the text. you have real talent here, keep giong
Thank you, the typewriter effect is surprisingly hard, requires a pretty complicated expression in after effects
Re: I put sheet music into smart glasses [video]
#43Really nice project. Would be interesting to dive a bit deeper where this 3s latency comes from. I assume the bitmaps have been pregenerated so I guess it's just the turnaround time when accessing the AugmentOS servers?
A lot of the time is from the glasses themselves, but apparently Mentra talked to the Even CEO and next gen bitmaps will be much better
Re: I put sheet music into smart glasses [video]
#44Nice work. From the Github: > This allows the pianist to not have to turn pages, and more importantly, allows them to see the music and their hands at the same time, which is an unavoidable problem with traditional sheet music. I could definitely see this being beneficial for beginners. When I lived in a dormitory during uni I often played familiar pieces from memory pretty late on a digital piano (with headphones) i…
For me, it's still easy to mess up for complex sections if I'm not peeking at the keyboard every so often. Its true that muscle memory takes over after you reach a level of familiarity but not quite to the extent of biking
Re: I put sheet music into smart glasses [video]
#45All these glasses have so many layers of abstraction I don't want between something I develop and the display. Let me connect via bluetooth direct to the glasses with anything and just tx/rx via a serial port and some low level protocol to get pixels/text on the screen. This is also the only way I'd be able to buy a pair and feel safe it won't be able to be bricked in 2 years when some company shuts their server down…
AugmentOS is open source, so feel free to self-host, or even reference our communicator code in our repo to interact with the glasses directly via BLE.
This is an inferior means of development, however.
By going through AugmentOS, you get a much easier development experience, compatibility with multiple pairs of glasses (through both iOS and Android), and the ability to run multiple glasses apps simultaneously.
Re: I put sheet music into smart glasses [video]
#46I am so unbelievably excited for consumer-grade, useful AR. There was a lot of hype around VR, but for the last 10 years I've been following progress on AR glasses. The thing about AR is that it has the ability to enhance everything in your daily life, versus VR which is meant to be a separate experience. Both Meta and Samsung are due to put out consumer AR glasses later this year and I think this might be the first…
100% agree.
I've been building smart glasses for over 7 years. First 6 years were in academia because the tech wasn't ready yet, because they were too heavy and battery didn't last long enough.
But in the last year, all-day battery smart glasses have become lightweight enough to be worn all day (see Even Realities G1, Vuzix Z100, etc.).
I believe smart glasses are having their iPhone moment in 2025 + 2026.
We make the smart glasses OS that Kevin used in the video to make this smart glasses app: AugmentOS.org
Re: I put sheet music into smart glasses [video]
#47Congratulations for the project and for winning the hackathon, nicely done! I am looking for hackable smart glasses with camera which doesn't rely upon any proprietary service to work, Mentra seems to have a camera version but this video seems to suggest that we need to use their service all the time?
Mentra Live is indeed a camera + speakers + microphone pair of lightweight smart glasses - that you can build for.
Mentra Live runs AugmentOS, so you can control all the I/O (camera, speakers, mic) in your own app with the AugmentOS SDK.
Regarding use the backend service all the time: Most apps/developers connect through official AugmentOS.org servers and focus on building their apps, but you can self-host your own backend if you want.
Re: I put sheet music into smart glasses [video]
#48Really nice project. Would be interesting to dive a bit deeper where this 3s latency comes from. I assume the bitmaps have been pregenerated so I guess it's just the turnaround time when accessing the AugmentOS servers?
The 3 seconds of latency is writing a bitmap image from the phone to the smart glasses over BLE. It's very fast to send text, but slow to send bitmaps.
For text, everything is fast - the AugmentOS servers introduce In next-generation glasses, this will be a lot faster because of better bitmaps handling, BMP encoding schemes, and also pre-loading of BMPs.
Re: I put sheet music into smart glasses [video]
#49Earlier quoted context omitted.
Counter point: people get too hung up on staring at the sheet. The sheet is just a tool to help you remember what you intend to play. The goal should always be to not need it anymore, and while using the sheet, it's like using a crutch. The "looking at your fingers" challenge then becomes that you start to play "by eye" instead of "by ear" (or "by feel") which I find is very hard to overcome. Especially when you are…
> The goal should always be to not need it anymore, and while using the sheet, it's like using a crutch. Uh, why? Lots of pros use sheet music, especially for complex pieces. I’ve never heard of an orchestra conductor insisting everyone be off-book. It’s one thing to memorize pop songs or whatever, but nobody is out there shaming people for not memorizing Rachmaninov
People who are good at playing a technically hard piece essentially know it by heart. They couldn't play it on sight, they have invested significant time to be able to play it. It's just the few remaining percent of reminders and the comfort of having the sheet "just in" case as well as the being-used-to-it factor that makes them stare at the sheet. But if they can play it really well then they don't _actually_ need it. Any pro musician will tell you this.
The orchestra setting has the extra requitement that the sheet is a tool for communication. "The figure in bar 83" is not a term you have gained an intuitive understanding for, but is needed to communicate in an orchestra setting. The soloist though often times plays by heart, at least during performances, so as not to get distracted / get tunnel vision.
Re: I put sheet music into smart glasses [video]
#50Earlier quoted context omitted.
I wanted to say, after a certain level looking at your fingers when playing an instrument becomes the equivalent of looking at your legs when riding the bicycle. When I start to think too much about what my fingers are doing I will play worse. For if I want to practise a particular part where I get the fingering wrong, sure, but when you play it for real, looking is counterproductive. Something like this could be gre…
Counter point: people get too hung up on staring at the sheet. The sheet is just a tool to help you remember what you intend to play. The goal should always be to not need it anymore, and while using the sheet, it's like using a crutch. The "looking at your fingers" challenge then becomes that you start to play "by eye" instead of "by ear" (or "by feel") which I find is very hard to overcome. Especially when you are…
I am not a big sheet player myself, I love to improvise and play by memory, so when I said "don't look at the fingers", I didn't mean "instead look at the sheet".
Look at the audience, out of the window, into nothingness — or even close your eyes. As long as you're there.