I've been trying not to get too worked up over the whole NSA/PRISM issue, but the potential success Google Glass changes the magnitude of the issue. By proxy, every Google Glass owner will be acting as a remote recording device for government agencies. Everyone in the line of site/hearing range of the device forfeits privacy.
Everyone is already carrying a remote tracking and recording device called a cell phone, optionally including video (which may or may not be useful). Admittedly Glass gives a much better vantage point for videos, but that's the only added aspect.
Google Glass will show The Watchers exactly what the person is looking at. Even when the person takes it off and puts it on, say, a table surface, it will be showing something, as opposed to a phone which either points downward or up towards the ceiling.
I could go on. The point is that "everyone is already carrying a remote tracking and recording device" is hugely different in terms of both the scope and depth of surveillance that said offers when compared to Google Glass.