Does it leverage middle out compression?
Show HN: I turned my face rec system into a video codec
101–110 of 150 posts
Re: Show HN: I turned my face rec system into a video codec
#102I bit my tongue off at one point in my life (jumped from a high height and my knee hit my chin as I was screaming). The fact that it captures most of the details of the scar where it was reattached is phenomenal. Majorly impressed. There’s some weird banding/rainbow effects around my glasses and the background (not on my face), but that’s the only major artifact that stood out to me.
Thanks! Glasses are sometimes a little bit of a problem, I don't have enough of those in my training sets.
I mean the obvious question here is... how many BIPOC (Black, Indigenous, People of Colour) do you have in your training sets?
Re: Show HN: I turned my face rec system into a video codec
#103The future alternative to watching TV: run an AI writer/director/actor pipeline
Re: Show HN: I turned my face rec system into a video codec
#104Firstly, this is pretty awesome, love it. I have a few questions: * I applaud the work to have it run on tiny-bandwidths, how hard would it be to up the frame-rate to 60? * How well does "framing" work? Are you able to add flexible amounts of padding around the head or is very focussed on a face taking up the whole canvas? * How much does it "cheat". Is it firing only feature-maps so if I have a spot on my chin does…
Thanks! Wrt upping the frame rate the main problem is that the phone may run a bit hot, newer iPhones/iPads should be able to handle it just fine, but the older ones based on, say, the A10, might have trouble keeping up, especially with multiple remote parties connected. * The framing depends on a transformation derived from the face landmarks, and the amount of padding is somewhat flexible. Distance from the camera…
for poor hardware a face generator with a set of mouth and eye states seems a good failback. It would be a huge difference if both hw and bw are bad.
Re: Show HN: I turned my face rec system into a video codec
#105Well done for putting it out there! We've worked on this about 3 years ago, plus background removal (realtime alpha-matting still not really done well by anyone), portrait re-lighting (G-Meet is now doing this) and even eye-contact (adjusting eye position to create the illusion of looking directly into the camera). Some findings: - Competing with dedicated H264/5 chips is very hard, especially when it comes to energy…
Thanks!
Wrt the speed, I worked very long and hard on finding the right NN architecture to do this without too much overhead.
My concern wrt super-resolution H264 is that you are going to have to encode and decode the full image anyway, so the cost should be very similar to doing encode-decode with network transmission in the middle. I've tried various DCT and DWT approaches, and yet not found them to be a win, but I'd be happy to learn what you guys found out.
I have sent you an invite to connect at Linkedin, I am https://www.linkedin.com/in/jacob-gorm-hansen-85b724/ if anybody else wants to connect there.
Re: Show HN: I turned my face rec system into a video codec
#106Firstly, this is pretty awesome, love it. I have a few questions: * I applaud the work to have it run on tiny-bandwidths, how hard would it be to up the frame-rate to 60? * How well does "framing" work? Are you able to add flexible amounts of padding around the head or is very focussed on a face taking up the whole canvas? * How much does it "cheat". Is it firing only feature-maps so if I have a spot on my chin does…
Thanks! Wrt upping the frame rate the main problem is that the phone may run a bit hot, newer iPhones/iPads should be able to handle it just fine, but the older ones based on, say, the A10, might have trouble keeping up, especially with multiple remote parties connected. * The framing depends on a transformation derived from the face landmarks, and the amount of padding is somewhat flexible. Distance from the camera…
>Danish university that uses us for auditorium head counting.
Just wait until you find out the Chinese have the same, but they train theirs for Uygher locating...
Yeah, these technologies are amazing, but also terrifying when viewed through the OBEY lens.
Re: Show HN: I turned my face rec system into a video codec
#107I love the idea and I hope it succeeds. Only one small bit of cosmetic feedback. Maybe think about hiring a face model to work your demo. I personally don't care, but I think it might improve your optics. And yes, I understand it's a tech demo. But booth babes were a thing (are they still a thing?) for good reason, grab those eyeballs, yo.
Babes are always a thing. Stop objectifying Babes.
Re: Show HN: I turned my face rec system into a video codec
#108You lost me at "patent pending". This idea has been obvious and in progress for a while now with lots of prior work. The issue is more the standards. Please don't sell this to a patent troll who will harass the industry for 20 years.
> This idea has been obvious and in progress for a while now with lots of prior work.
Such as?
Re: Show HN: I turned my face rec system into a video codec
#109Nice work, but you might find it's not super unique - video codec people have been thinking about how to apply face recognition ML tech to this use case for 5+ years. For instance, have you seen https://developer.nvidia.com/maxine ? They released some pretty nice demos 2 years ago.
Their approach is more heavy-weight as it uses GANs (IIRC) to dream up a reconstruction of your face. They need GPU VMs in the cloud, whereas mine runs on device.
>*whereas mine runs on device*
$$$
This IS the killer feature.
Now make a face recog PI (as you stated you tried) -- or a cheap Android Phone which best serves HW(gpu) for your needs and you have solved some complex surveillance matters.
Re: Show HN: I turned my face rec system into a video codec
#110This codec needs to be implemented in Tesla Cars.
Full Stop.