Live data from Hacker News

Show HN: Real-time privacy protection for smart glasses

github.com

1–10 of 36 posts

Show HN: Real-time privacy protection for smart glasses

#1
I built a live video privacy filter that helps smart glasses app developers handle privacy automatically.

How it works: You can replace a raw camera feed with the filtered stream in your app. The filter processes a live video stream, applies privacy protections, and outputs a privacy-compliant stream in real time. You can use this processed stream for AI apps, social apps, or anything else.

Features: Currently, the filter blurs all faces except those who have given consent. Consent can be granted verbally by saying something like "I consent to be captured" to the camera. I'll be adding more features, such as detecting and redacting other private information, speech anonymization, and automatic video shut-off in certain locations or situations.

Why I built it: While developing an always-on AI assistant/memory for glasses, I realized privacy concerns would be a critical problem, for both bystanders and the wearer. Addressing this involves complex issues like GDPR, CCPA, data deletion requests, and consent management, so I built this privacy layer first for myself and other developers.

Reference app: There's a sample app (./examples/rewind/) that uses the filter. The demo video is in the README, please check it out! The app shows the current camera stream and past recordings, both privacy-protected, and will include AI features using the recordings.

Tech: Runs offline on a laptop. Built with FFmpeg (stream decode/encode), OpenCV (face recognition/blurring), Faster Whisper (voice transcription), and Phi-3.1 Mini (LLM for transcription analysis).

I'd love feedback and ideas for tackling the privacy challenges in wearable camera apps!

Show HN: Real-time privacy protection for smart glasses
github.com

Re: Show HN: Real-time privacy protection for smart glasses

#4
post #3

Smart solution for wearable privacy. Consent-by-voice and offline processing make it practical, and I’m curious how you’ll expand beyond face blurring.

Thanks! Beyond face blurring, I'm planning to detect and redact other private information like license plates, name tags, and sensitive documents.

Most of these features are aimed at protecting bystanders, but I'm also interested in exploring privacy protection for the wearer. For example, automatically shutting off recording in bathrooms, or removing identifiable landmarks from the video when they could reveal the wearer's location, depending on the use case.

Re: Show HN: Real-time privacy protection for smart glasses

#6
> Real-time processing – 720p 30fps on laptop

Have you tried running this on a phone or standalone smart glasses? 30fps is horrible performance on a laptop given that it's probably 10-100x more powerful than the target device. And what laptop? Based on your screenshot, I'm guessing you're using a new Apple Silicon mac which is practically a supercomputer compared to smart glasses.

Re: Show HN: Real-time privacy protection for smart glasses

#7
Real-time self privacy protection people might buy into. They can trust what they are doing and they get the benefit. E.g. automatically not recording during certain periods without having to explicitly signal it each time is a convenience. I don't want my big post Taco Bell Shit to waste my storage or accidentally stream it somewhere. At the same time, I also don't want my smart glasses to be tethered to something which can run AI and video processing models all the time, or to be dumping it all to the cloud 24/7 live either, as battery is already one of the big problems with the tech currently. At least that's something the advance of technology in general may be able to solve though, so I like the concept for self-application.

I don't know this would actually make others any more comfortable/guaranteed, which is where the bulk of the privacy concerns around smart glasse lie. I'm also not sure if that's actually a problem for more technology to be able to solve. The nice thing about e.g. recording consent is you do it on your device, or in some cloud device by a 3rd party. The moment you do it through the other person's device it's no different (from a trust/easiness/guarantee factor) than just asking the person themselves to not record you (again, beyond the benefits to the operator themselves around that). If some guy walked up to you with a literal video camera pointed at you and said "it only records your face if you give it consent":

- Do you even trust the person is telling the truth?

- If you do, do you trust the technology to work 100% of the time?

- If it is a lie or doesn't work and they post something, are you any better off than if you weren't asked for consent and said no? (note: separate this from the value to the person operating the camera, who does get value from those that say yes).

- If you say no, are you really not going to feel awkward compared to not having someone recording the rest of the situation?

Maybe the answer for you to all of these is "Absolutely!", I'd bargain to bet it's not the case for the vast majority of those concerned with the privacy implications of the technology though (which I don't consider myself a part of that group necessarily, I'm just putting myself in their shoes for a second).

.

So I'd split my thoughts into two main sections: I'm not sure technology is going to solve any external privacy concerns here, but I think it's an interesting approach to internal privacy concerns with the tech.

Re: Show HN: Real-time privacy protection for smart glasses

#9
There is a strange ingredient in the ether right now - confounding privacy with censorship. If I can see something, and hear it, then blurring it is not "privacy", it's censorship.

I fully expected this to be about solutions for empowering the user to ensure that her audio and visual experiences weren't being exfiltrated to a third-party, not that they were being censored before even getting to her.

Re: Show HN: Real-time privacy protection for smart glasses

#10
I appreciate your intent, But...

This does nothing to alleviate my privacy concerns, as a bystander, about someone rudely pointing a recording camera at me. The only thing that alleviates these concerns about "smart" glasses wearers recording video, is not having "smart" glasses wearers. I.e., not having people rudely walking around with cameras strapped to their faces recording everyone and everything around them. I can't know/trust that there is some tech behind the camera that will protect my privacy.

A lot of privacy invasions have become normalized and accepted by the majority of the population. But, I think/hope a camera strapped to someone's face being shoved into other peoples' faces will be a tough sell. Google Glass wearers risked having the camera ripped off their faces / being punched in the face. I expect this will continue.

Perhaps your tech would have use in a more controlled business/military environment? Or, to post-process police body camera footage, to remove images of bystanders before public release?

Post reply on HN