Very interesting! I’m getting more like 400-600 kbit/s, maybe too much beard and long hair.
The face boxing seems very aggressive, I feel like I’m trapped in the virtual prison of some 90s dr who episode.
Show HN: I turned my face rec system into a video codec
31–40 of 150 posts
Re: Show HN: I turned my face rec system into a video codec
#32Well done on creating a useful codec. One specifically optimised for face data seems apropos the emerging demand for more intimate remote interaction. Many teachers, therapists, doctors and social workers who conduct remote sessions rely on clear non-verbal signalling and need to read affect. But the story has a deeper meaning for me (because of the book I am writing). You switched from street face surveillance (an a…
> You switched from street face surveillance (an arguably highly unethical application) to more intimate videoconferencing (a more humanistic and socially beneficial end).
Or that makes it easier to identify individuals as they give consent to have their face ‘fingerprinted’ as part of the app’s EULA.
If I were going to sell a mass-surveillance solution I’d certainly want to have the ability to identify individuals without having to scrape all of Facebook or whatever. As much as people hate on apple they do make it so carrying around one of their phones doesn’t make it easy for someone to identify you.
I, for one, would think twice about installing an app from someone who “pivoted away” from their Orwellian surveillance unicorn dreams.
Re: Show HN: I turned my face rec system into a video codec
#33Does it have any interesting "nonlinear" effects where it can show an entirely different face (the wrong face) based on misidentification or even adversary input? These kinds of failure modes for "AI" are the most interesting to me. It seems extremely smart - but don’t you think that to have success in a mass market product - think like MS Teams - it would need to be a combined solution. Where it both can do this for…
It will not show another person's face, it does not (yet ;) possess that level of understanding of the image contents.
Yes I agree I have to work more on the business side of things, definitely on the lookup for for a business-savvy co-founder, hints at potential companies to partner with, etc.!
Re: Show HN: I turned my face rec system into a video codec
#34What’s funny is I’ve had this very idea but no AI skills or extra time to pull it off. Bravo!!
Yet another example that having ideas is worth close to 0, while being able to execute on your own or others ideas is worth > 0 :)
Re: Show HN: I turned my face rec system into a video codec
#35Really cool idea. Unfortunately I can't try it because app crashes for me. I'm guessing it's because of the HN crowd
Re: Show HN: I turned my face rec system into a video codec
#36This looks awesome. Looking forward to a non-Apple version to try it out myself. Great idea to solve some of the issues of video conferences. I assume it also upscales people when they move away further from the camera, as some sort of welcome side effect. So you only need to be close to the camera once and then make yourself more comfortable a little farther away, or even with suboptimal lighting.
One thing that struck me as odd on the page is that the H265 still looks considerably worse than H264, despite being the better codec and being larger. What's up with that?
Re: Show HN: I turned my face rec system into a video codec
#37> Because it uses face rec, you can ONLY show your face, and if you disappear from view your audio will stop after a while, to avoid situations like when you need to go the the restroom but forget to mute. This also solves dick-pics etc.
Who would have thought anti dick pic technology would become a product feature but here we are in 2022.
Re: Show HN: I turned my face rec system into a video codec
#38Well done on creating a useful codec. One specifically optimised for face data seems apropos the emerging demand for more intimate remote interaction. Many teachers, therapists, doctors and social workers who conduct remote sessions rely on clear non-verbal signalling and need to read affect. But the story has a deeper meaning for me (because of the book I am writing). You switched from street face surveillance (an a…
> You switched from street face surveillance (an arguably highly unethical application) to more intimate videoconferencing (a more humanistic and socially beneficial end). Or that makes it easier to identify individuals as they give consent to have their face ‘fingerprinted’ as part of the app’s EULA. If I were going to sell a mass-surveillance solution I’d certainly want to have the ability to identify individuals w…
Hi, we don't collect any data from the app, and have filled in the privacy etc. statements on the App Store accordingly.
Ideally I would like to collect faces to train the compression on, in which case we would have to consult with lawyers to come up with an EULA allowing us to do this. The advantage compared to using broadly available datasets to train on would be more realistic shot noise, low light images, and so on. I don't see any other valid business purpose of collecting people's faces.
We've been sitting on the face recognition tech since 2018, so if we'd wanted to become Clearview.ai we probably would have a long time ago.
Re: Show HN: I turned my face rec system into a video codec
#39This looks awesome. Looking forward to a non-Apple version to try it out myself. Great idea to solve some of the issues of video conferences. I assume it also upscales people when they move away further from the camera, as some sort of welcome side effect. So you only need to be close to the camera once and then make yourself more comfortable a little farther away, or even with suboptimal lighting. One thing that str…
In general, H265 is better than H264, but when you really squeeze it it seems to fall over its own feet. This is measured against ffmpeg's x265 implementation, the hardware-accelerated version on the iPhone will just refuse to go down to that bitrate.
Re: Show HN: I turned my face rec system into a video codec
#40Didn't take a look yet but will, very cool. Where are the meetings rooms hosted?