No post body was provided.
Show HN: I turned my face rec system into a video codec
141–150 of 150 posts
Re: Show HN: I turned my face rec system into a video codec
#142No post body was provided.
Re: Show HN: I turned my face rec system into a video codec
#143> Because it uses face rec, you can ONLY show your face, and if you disappear from view your audio will stop after a while, to avoid situations like when you need to go the the restroom but forget to mute. Of course, the real killer app for Zoom calls is the opposite of this: some kind of deep fakery that makes it seem we're there when we're not. Yet as it is, this is a fantastic idea. It's surprising video codecs de…
OBS allows you to create a virtual webcam, where you can use the live compositor to switch between, say, a looping video of you sitting still and your actual webcam. Smoke and mirrors could include a low frame rate and heavy compression to hide the transition
Somebody tried this and had pretty good success
Re: Show HN: I turned my face rec system into a video codec
#144Earlier quoted context omitted.
Could you post the exact specs? I've tested on iPhone 6s until recently and it used to work, but it could be I am doing something silly.
I believe the 6s and (original) SE had the exact same internals. Here is a comparison: https://www.gsmarena.com/compare.php3?idPhone1=7969&idPhone2... I haven't upgraded to iOS 15 though, I'm on 14.4, maybe that's the issue?
I've gotten a repro of that issue on an A9 IPad (happened to be on IOS 14.x too, but deemed not relevant), something silly to do with Metal Language versions that was easily fixed. A new build that also fixes the UI issues others have reported is on its way out, please email me at jacob@vertigo.ai if you want beta access via Testflight. Should be GA within 1-2 days.
Re: Show HN: I turned my face rec system into a video codec
#145This codec needs to be implemented in Tesla Cars. Full Stop.
If anyone can hook me up with the right people I'd love to do it :-). Not sure if it's legal to use it that way, but doing video calls with my app while driving with the phone in a holder on the dashboard already works really well.
Re: Show HN: I turned my face rec system into a video codec
#146Earlier quoted context omitted.
Thanks! Glasses are sometimes a little bit of a problem, I don't have enough of those in my training sets.
I mean the obvious question here is... how many BIPOC (Black, Indigenous, People of Colour) do you have in your training sets?
Nah, it's "how many Black, Indigenous, People of Colour do you have who wear glasses and have facial scars from having fallen from a great height while screaming?". If you can't find enough preëxisting BIPOCWWGAHFSFHFFAGHWS people, I suppose you're limited to finding other BIPOC people, giving them glasses, and throwing them from a great height. (Manufacturing them the other way around might be too offensive.)
Re: Show HN: I turned my face rec system into a video codec
#147Well done for putting it out there! We've worked on this about 3 years ago, plus background removal (realtime alpha-matting still not really done well by anyone), portrait re-lighting (G-Meet is now doing this) and even eye-contact (adjusting eye position to create the illusion of looking directly into the camera). Some findings: - Competing with dedicated H264/5 chips is very hard, especially when it comes to energy…
Thanks! Wrt the speed, I worked very long and hard on finding the right NN architecture to do this without too much overhead. My concern wrt super-resolution H264 is that you are going to have to encode and decode the full image anyway, so the cost should be very similar to doing encode-decode with network transmission in the middle. I've tried various DCT and DWT approaches, and yet not found them to be a win, but I…
Are you sending occasional key frames and then just some points for a GAN to generate movement over the wire?
Re: Show HN: I turned my face rec system into a video codec
#148Hi. I’m on iphone XS. Could you help me understand what the buttons on the right do? https://imgur.com/a/r8SbYfp Also not sure - is the URL so that this can be used in browser for the other party, or - i am assuming - it’s just for accessing in the app on the other end too? Thanks. Inspiring!
I believe that issue has been fixed now, thanks for reporting it. Just waiting for app store review...
Re: Show HN: I turned my face rec system into a video codec
#149Earlier quoted context omitted.
I mean the obvious question here is... how many BIPOC (Black, Indigenous, People of Colour) do you have in your training sets?
Nah, it's "how many Black, Indigenous, People of Colour do you have who wear glasses and have facial scars from having fallen from a great height while screaming?". If you can't find enough preëxisting BIPOCWWGAHFSFHFFAGHWS people, I suppose you're limited to finding other BIPOC people, giving them glasses, and throwing them from a great height. (Manufacturing them the other way around might be too offensive.)
My question was unironic, because to date there have been a large amount of issues resulting from black people using e.g. Zoom's autobackground, and it detecting them as the background, because black people were not featured in the training sets or considered when the AI was being constructed.
Likewise, many cameras do not properly pick up the skin tone of black, indigenous, people of colour. This is partly because of technological limits with respect to the number of F-stops available in commercial cameras. But also because there is a wide variety of human skin tones existing in the world, and camera manufacturers do not test for a majority of them.
Perhaps these papers speak louder for me, given that Hacker News only accepts neoliberal anecdotes :)
"Until recently, due to a light-skin bias embedded in colour film stock emulsions and digital camera design, the rendering of non-Caucasian skin tones was highly deficient and required the development of compensatory practices and technology improvements to redress its shortcomings"
https://cjc-online.ca/index.php/journal/article/view/2196/30...
"For a fixed decision threshold, the African-American image cohort has a higher false match rate and a lower false non-match rate. "
https://arxiv.org/abs/1904.07325
" The Gender Shades project revealed discrepancies in the classification accuracy of face recognition technologies for different skin tones and sexes. These algorithms consistently demonstrated the poorest accuracy for darker-skinned females and the highest for lighter-skinned males."
https://sitn.hms.harvard.edu/flash/2020/racial-discriminatio...
https://sitn.hms.harvard.edu/flash/2020/racial-discriminatio...
Re: Show HN: I turned my face rec system into a video codec
#150Earlier quoted context omitted.
Nah, it's "how many Black, Indigenous, People of Colour do you have who wear glasses and have facial scars from having fallen from a great height while screaming?". If you can't find enough preëxisting BIPOCWWGAHFSFHFFAGHWS people, I suppose you're limited to finding other BIPOC people, giving them glasses, and throwing them from a great height. (Manufacturing them the other way around might be too offensive.)
My question was unironic, because to date there have been a large amount of issues resulting from black people using e.g. Zoom's autobackground, and it detecting them as the background, because black people were not featured in the training sets or considered when the AI was being constructed. Likewise, many cameras do not properly pick up the skin tone of black, indigenous, people of colour. This is partly because o…
Ah, I see. Well diagnosed, by the way - I did indeed think you were being ironic, and was going along with the joke, as opposed to being antagonistic in the knowledge you were being sincere.
To respond in sincere mode: while I don’t think it’s terribly important whether black people are rendered correctly by some Zoom feature, nevertheless including a reasonable number of black people in one’s training data sounds like it shouldn’t require any extra effort, and so I think it’s a reasonable enough point to make.