Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I turned my face rec system into a video codec

vertigo.ai

Post reply on HN
Print view View original

131–140 of 150 posts

Re: Show HN: I turned my face rec system into a video codec

#131

Post by billiam »

bambax wrote: post #48

> Because it uses face rec, you can ONLY show your face, and if you disappear from view your audio will stop after a while, to avoid situations like when you need to go the the restroom but forget to mute. Of course, the real killer app for Zoom calls is the opposite of this: some kind of deep fakery that makes it seem we're there when we're not. Yet as it is, this is a fantastic idea. It's surprising video codecs de…

>It's surprising video codecs deal so little with the nature of the images (AFAIK) and try to be generalists.

This. A small number of pixels matter, the rest don't.

Re: Show HN: I turned my face rec system into a video codec

#132

Post by kleer001 »

samstave wrote: post #107
kleer001 wrote: post #99

I love the idea and I hope it succeeds. Only one small bit of cosmetic feedback. Maybe think about hiring a face model to work your demo. I personally don't care, but I think it might improve your optics. And yes, I understand it's a tech demo. But booth babes were a thing (are they still a thing?) for good reason, grab those eyeballs, yo.

Babes are always a thing. Stop objectifying Babes.

Which is it?

Re: Show HN: I turned my face rec system into a video codec

#133

Post by Jolter »

samstave wrote: post #106
jacobgorm wrote: post #15

Earlier quoted context omitted.

Thanks! Wrt upping the frame rate the main problem is that the phone may run a bit hot, newer iPhones/iPads should be able to handle it just fine, but the older ones based on, say, the A10, might have trouble keeping up, especially with multiple remote parties connected. * The framing depends on a transformation derived from the face landmarks, and the amount of padding is somewhat flexible. Distance from the camera…

>Danish university that uses us for auditorium head counting. Just wait until you find out the Chinese have the same, but they train theirs for Uygher locating... Yeah, these technologies are amazing, but also terrifying when viewed through the OBEY lens.

What are you saying, that the Danish are selling the technology on to the Chinese? As if the Chinese government didn’t already have massively deployed facial recognition tech?

Re: Show HN: I turned my face rec system into a video codec

#134

Post by Jolter »

noduerme wrote: post #14

This is an amazing idea and I can't wait to try it. Just one question... >> This also solves dick-pics etc. Is this a problem on zoom meetings, for people other than Jeffrey Toobin?

Maybe not on Zoom but I’ll bet it is on FaceTime and Messenger video chats.

Re: Show HN: I turned my face rec system into a video codec

#135

Post by causalmodels »

lmc wrote: post #108
mchusma wrote: post #83

You lost me at "patent pending". This idea has been obvious and in progress for a while now with lots of prior work. The issue is more the standards. Please don't sell this to a patent troll who will harass the industry for 20 years.

> This idea has been obvious and in progress for a while now with lots of prior work. Such as?

https://www.dpreview.com/news/5756257699/nvidia-research-dev...

Re: Show HN: I turned my face rec system into a video codec

#136

Post by dicknuckle »

jacobgorm wrote: post #47
syrusakbary wrote: post #30

WOW. This is amazing. I really believe your project can be game changing for the video-call industry. Have you considered entering into the YC Program? I think it could be an awesome match. There are many startups I know they may want to take use of your service, and even fly.io is part of YC family! Also, have you thought about open-sourcing it? (perhaps using a dual license could work great for an enterprise offeri…

Thanks! I tried entering YC in the fall 2021 batch, and got to the top 10%. I believe my main problem wrt YC is that I currently lack a co-founder, so I did not apply in the Spring as this was still the case. I am seriously thinking about open source, I believe for instance WebRTC found a good model with dual-licensing, where you have something like AGPL with the option of buying exceptions. I have had multiple advis…

Do what your heart feels is right.

Re: Show HN: I turned my face rec system into a video codec

#137

Post by savolai »

Hi. I’m on iphone XS. Could you help me understand what the buttons on the right do?

https://imgur.com/a/r8SbYfp

Also not sure - is the URL so that this can be used in browser for the other party, or - i am assuming - it’s just for accessing in the app on the other end too?

Thanks. Inspiring!

Re: Show HN: I turned my face rec system into a video codec

#138

Post by jacobgorm »

savolai wrote: post #137

Hi. I’m on iphone XS. Could you help me understand what the buttons on the right do? https://imgur.com/a/r8SbYfp Also not sure - is the URL so that this can be used in browser for the other party, or - i am assuming - it’s just for accessing in the app on the other end too? Thanks. Inspiring!

Sorry about that, I've gotten that bug reported from a few people today, not sure what is causing SwiftUI to scale things like that, looking into it. I think it has more to do with display/font settings than the exact phone model.

Until I can get a fix out, a workaround is to rotate the device to landscape mode, you should be able to read the text on the buttons that way.

The text on the buttons to the right of the QR should say: * Clear * Copy URL * Copy QR

Re: Show HN: I turned my face rec system into a video codec

#139

Post by jacobgorm »

londons_explore wrote: post #59

One benefit of lower bandwidth is you have the possibility of reducing the glass-to-glass latency, since network queues will be less crowded. But with this you have the downside of more milliseconds spent compressing and decompressing the frames. Do you have any indication which effects dominate in typical 4G/wifi environments?

I don't really have a good answer, except that I don't do any frame batching that would cause delays, and that my UDP protocol ships the frames (and audio) out as soon as they are ready, as to reduce latency to a minimum.

Re: Show HN: I turned my face rec system into a video codec

#140

Post by andai »

jacobgorm wrote: post #82
andai wrote: post #73

Tried it out on my phone, app crashes every time I press "go to room". I'm using iPhone SE from 2016 so maybe my phone is too old for the GPU features? Alas! Was looking forward to trying it. As a side note the UI looks like a toy or joke app. I'm not sure what market you're going for (it seems like a general purpose video chat app?) but you might want to reconsider the aesthetic.

Could you post the exact specs? I've tested on iPhone 6s until recently and it used to work, but it could be I am doing something silly.

I believe the 6s and (original) SE had the exact same internals. Here is a comparison: https://www.gsmarena.com/compare.php3?idPhone1=7969&idPhone2...

I haven't upgraded to iOS 15 though, I'm on 14.4, maybe that's the issue?

Post reply on HN