Has some overlap with the wave scanner from Elite Dangerous.
See with Ears: Auditory Display for Synthetic Vision (2018)
11–14 of 14 posts
Re: See with Ears: Auditory Display for Synthetic Vision (2018)
#12For serious users, The Android version of The vOICe also runs on smart glasses from Vuzix (Vuzix Blade, M300) https://www.vuzix.com/appstore/app/the-voice-for-android, EPSON (Moverio BT-300) https://moverio.epson.com/jsp/pc/pc_application_detail.jsp?p... as well as on sub-$200 VISION-800 smart glasses https://www.seeingwithsound.com/android-glasses.htm
Also try the experimental visual object recognition under Options | Say object names.
Re: See with Ears: Auditory Display for Synthetic Vision (2018)
#13Back in about 2000 I remember exchanging emails with a guy who had built a modified renderer for (I think) the Half-Life 1 engine. He was using audio rendering to enable blind players to play first person shooters. My recollection is he was using a series of horizontal scan lines across the display region with different octaves or similar indicating which scan line was being "rendered" and different tones indicating…
Sounds extremely interesting.
Re: See with Ears: Auditory Display for Synthetic Vision (2018)
#14This feels really groundbreaking to me. It's like echolocation. Although it also seems to be projecting 3d onto 2d, while true echolocation gives you a 3d picture(?)
There's stories of blind people using echolocation to get around, so why not do a synthetic version of that instead of this made up encoding scheme (as cool as it is). I.e. model how sound would propagate in an environment and create the sound an echolocator would actually hear reflected back.
What I was getting at is that would be much more complex, because this uses a camera (2d), while echolocation/our ears is 3d when all is said and done. So to do what you're suggesting, you'd first need some way create a 3d model of the world from the camera's 2d image, and then encode into sound.
At which point, echolocation is probably better.