Live data from Hacker News

Show HN: Sheet Music in Smart Glasses

news.ycombinator.com

21–30 of 30 posts

Re: Show HN: Sheet Music in Smart Glasses

#21

This is such a great use case. I stand in front of my monitor with my guitar and have to scroll the sheet music. So that means stop playing. I often wander away from my computer and then come back if I forget how a section goes. I'm using tabs not notes, but I'm assuming/hoping your solution will adapt quite easily. I wonder if you could use a microphone to listen for the notes in order to get auto-scrolling. Because…

[deleted]

Re: Show HN: Sheet Music in Smart Glasses

#22
Nice project, but I do not get the competitiveness of part of its implementation details:

-- the project uses "Even Realities G1" AR glasses (640x200, 25°FoV, 1bit green), while the "Epson Moverio" AR glasses can have overwhelmingly superior specs (1920x1080, 34°FoV, full RGB) for possibly an even lower price;

-- software wise, it «uses AugmentOS's SDK to communicate with Mentra servers which talk to the mobile app which talks to your ... glasses» - while an Epson Moverio system would just directly use the glasses as a display for an Android device...

Both gaps between the available and the employed make very little sense.

Re: Show HN: Sheet Music in Smart Glasses

#24
post #22

Nice project, but I do not get the competitiveness of part of its implementation details: -- the project uses "Even Realities G1" AR glasses (640x200, 25°FoV, 1bit green), while the "Epson Moverio" AR glasses can have overwhelmingly superior specs (1920x1080, 34°FoV, full RGB) for possibly an even lower price; -- software wise, it «uses AugmentOS's SDK to communicate with Mentra servers which talk to the mobile app w…

Makes perfect sense- usability. Look at both sets of glasses.

One looks normal enough to wear all the time.

Re: Show HN: Sheet Music in Smart Glasses

#25
post #22

Nice project, but I do not get the competitiveness of part of its implementation details: -- the project uses "Even Realities G1" AR glasses (640x200, 25°FoV, 1bit green), while the "Epson Moverio" AR glasses can have overwhelmingly superior specs (1920x1080, 34°FoV, full RGB) for possibly an even lower price; -- software wise, it «uses AugmentOS's SDK to communicate with Mentra servers which talk to the mobile app w…

You can absolutely find more feature-packed glasses. Epson, XReal, Viture, Vuzix Blade, TCL RayNeo X2/X3, INMO Air 1-3, etc. The issue is all these weigh north of 70g (too heavy for comfortable daily wear), and/or require a wire that connects to an external compute box (not socially acceptable for daily wear). Glasses like the Even Realities, otoh, are lightweight, look normal, and are wireless, so can be worn all-day as you would normal prescription glasses.

Re: Show HN: Sheet Music in Smart Glasses

#26
Great job! For converting music to readable images, the latex of music typesetting is lilypond, which has the ability to create legible music at any size by scaling the notational glyphs accordingly[1]. This sounds like what you were trying to achieve achieve with opencv.

With that being said, although lilypond is very intelligent about all sorts of typesetting minutiae, but it's probably difficult to wrangle it to run on smart glasses.

[1] https://lilypond.org/doc/v2.24/Documentation/essay/engraving...

Re: Show HN: Sheet Music in Smart Glasses

#27
post #26

Great job! For converting music to readable images, the latex of music typesetting is lilypond, which has the ability to create legible music at any size by scaling the notational glyphs accordingly[1]. This sounds like what you were trying to achieve achieve with opencv. With that being said, although lilypond is very intelligent about all sorts of typesetting minutiae, but it's probably difficult to wrangle it to r…

I tried using lilypond actually but ran into an error that no one seemingly knew how to solve. Can try digging through my history if you're interested

Re: Show HN: Sheet Music in Smart Glasses

#28

This is such a great use case. I stand in front of my monitor with my guitar and have to scroll the sheet music. So that means stop playing. I often wander away from my computer and then come back if I forget how a section goes. I'm using tabs not notes, but I'm assuming/hoping your solution will adapt quite easily. I wonder if you could use a microphone to listen for the notes in order to get auto-scrolling. Because…

Thanks for the kind words! As I briefly mention in my video, my teammate actually had guitar tabs going, with lyrics chords and even web scraping/search. I think a bit of refinement and better hardware and we'll get what you're looking for

Re: Show HN: Sheet Music in Smart Glasses

#29
post #10

Is there an opportunity to partner with (or sell to) one of the big digital sheet music vendors (like Musescore or Music Notes, etc)? I've never come upon a compelling personal use case for smart glasses, but as a pianist this could be it. I would HAPPILY purchase both glasses and a subscription from one of the big music vendors if this worked seamlessly and I could do things like embed a metronome or link it to my D…

I feel like this would be sold as more of an app for a smart glasses platform than an individual product.

>I've never come upon a compelling personal use case for smart glasses

There are tonnes, it's just the technology isn't there yet; glasses are too bulky and heavy, the fov sucks, the resolution sucks, light transmittance sucks.

But the use cases are incredibly plentiful; stuff like this (music sheets, documentation, web browsing), getting realtime directions with a blue line or directional hints when walking around an unfamiliar place, overlays/information at tourist sites, home automation/controlling devices.

I remember an old anime or some show where it's a world where a digital world is overlaid the real world where AIs and devices from the digital layer can be interacted with in a similar way...what was it hmmm.

Re: Show HN: Sheet Music in Smart Glasses

#30
Professional collaborative pianist here.

This is very inspiring; congratulations! I’m sure there will be performance gains along the way, but upload time will be critical to optimize for in professional settings. Even forScore on the iPad is sometimes too slow. I was performing the Tchaikovsky Rococo Variations not long ago with a cellist; and the seventh variation flies by at such a breakneck tempo that I had to use the half page turn trick to make it work.

The other thing that pianists in particular are picky about are editions. At least 95+% of the scores on my iPad are straight-up pdf scans of particular print editions. In terms of workflow, I would think that it has to ingest pdf for it to be viable for working musicians.

All that said, in chamber music settings, I can imagine the freedom to visually engage with your partners could be very compelling! Good luck with your next steps.

Post reply on HN