The annoying thing is that even if you yourself don't use these glasses, as long as people around you do, you are still affected by it. We really need laws to limit always-on recording devices in places where we have an expectation of privacy.
Actually useful AR needs cameras, of course, so the technology has legitimate use cases, but you'd have to be a real asshole to wear them to a bar, or a restaurant, etc. Maybe we mandate that the glasses have to have a base station dongle, and if they're more than 10 feet from the dongle, recording doesn't work without incredibly obvious annoying lights indicating that recording is on?
A cultural convention that lets people make honest mistakes, but turn it off when someone says "hey, you're recording" seems like a good solution. Just need to make it easily visible and obvious to others - you can run around in public with a big news camera on your shoulder or a tripod and you usually won't get hassled. It's just the idea of being covertly recorded, even while in public, that gets creepy.