Very cool work. I'd love to sit down and talk with you, jacobgorm. I spent 7 years in FR after failing my startup working on Personalized Advertising, which was based on Automated Actor Replacement in Filmed Media. The VC/Angel world wanted the startup to pursue deep fake pornography, but I refused, and ultimately went bankrupt. However, I managed to globally patent the actor replacement technology, create an automated digital double of real people pipeline, as well as get really deep into face ML/DL. That's how I ended up the principal engineer for the #3 FR company in the world for 7 years. I have since left FR, and am CTO of an AI-integrated 3D media production pipeline (I have a long games industry history). From the information in your post, it sounds like we are both on similar trajectories. It would be interesting and potentially synergistic if we met.
Show HN: I turned my face rec system into a video codec
61–70 of 150 posts
Re: Show HN: I turned my face rec system into a video codec
#62How do you deal with network weights versioning?
I assume the version that does the compressing and decompressing needs to match? And if you release an update and half the users install it, this is a problem?
Do you have some mechanism to dynamically download and update weights to ensure that all users in a call at least have a common version of the network? Or will you just globally require all users to update before joining a call? (which in turn means every time you release an update, all calls must end, which isn't very enterprise-friendly)
Re: Show HN: I turned my face rec system into a video codec
#63Earlier quoted context omitted.
That is where I started ~5 years ago :-) Thanks!
Really? Impressive! Can I ask how you went about learning it all then? Any books or online courses you can recommend?
I learned by joining an early AI startup with some co-founders who knew about old-school AI (but didn't believe in backprob!), and then reading absolutely every ML paper I could find, following AI hotshots on Twitter, reading the darknet source code, and experimenting with pytorch.
Eventually two of us left to start Vertigo.ai, and found a customer who would fund a fast object detector to run on a $18 Nano-PI. That was a fun challenge and forces me to think about how to make the AI run fast and with relatively low footprint.
Today fast.ai might be a good starting point, definitely recommend going with pytorch, cloning cool projects from github, and going from there.
Re: Show HN: I turned my face rec system into a video codec
#64Cool, but just tried to try it and if I send the “room” (or whatever) url from the front page by copying and pasting it into an iMessage to my wife, when she clicks it it says the page does not exist. Just as an fyi. Same if I recreate the url, use your “copy” buttons or even get her to scan the qr code.
Re: Show HN: I turned my face rec system into a video codec
#65Great work! Also, where can I learn about your edge AI smart camera system?
https://vertigo.ai/sensoros/ has some info, but you probably read through that already. There is a public github repo, but I think it needs some explanation to be useful. You are welcome to ping me at jacob@vertigo.ai.
Re: Show HN: I turned my face rec system into a video codec
#66No post body was provided.
Re: Show HN: I turned my face rec system into a video codec
#67Cool, but just tried to try it and if I send the “room” (or whatever) url from the front page by copying and pasting it into an iMessage to my wife, when she clicks it it says the page does not exist. Just as an fyi. Same if I recreate the url, use your “copy” buttons or even get her to scan the qr code.
That is a known and very annoying problem, I think killing and restarting iMessage might help.
I am registering the correct URL handler for the app, but it seems to not always work immediately.
Re: Show HN: I turned my face rec system into a video codec
#68Awesome! A thought: now that neural compression is becoming widespread, it could be a good idea to put some kind of indicator or watermark stating the compression is neural (learned/function approximation in general). I think this would avoid liabilities and criticism around the fact that some weird things may appear (incorrect detail generation), maybe giving a wrong semantic idea. It may also be a good idea to put…
> incorrect detail generation Absolutely. Reminds me of Xerox number mangling: https://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres...
Interesting, and it may also indicate a way to address this issue with learning.
For example, you could train a network to give semantic image descriptions of significant features in the image, and maybe also transcribe text. Then you can include semantic preservation in the objective, or some kind of graceful degradation when semantic preservation isn't achieved.
Re: Show HN: I turned my face rec system into a video codec
#69> Because it uses face rec, you can ONLY show your face, and if you disappear from view your audio will stop after a while, to avoid situations like when you need to go the the restroom but forget to mute. Of course, the real killer app for Zoom calls is the opposite of this: some kind of deep fakery that makes it seem we're there when we're not. Yet as it is, this is a fantastic idea. It's surprising video codecs de…
>and if you disappear from view your audio will stop after a while
I sure hope this "feature" can be turned off in the settings
Re: Show HN: I turned my face rec system into a video codec
#70> Because it uses face rec, you can ONLY show your face, and if you disappear from view your audio will stop after a while, to avoid situations like when you need to go the the restroom but forget to mute. Of course, the real killer app for Zoom calls is the opposite of this: some kind of deep fakery that makes it seem we're there when we're not. Yet as it is, this is a fantastic idea. It's surprising video codecs de…
>and if you disappear from view your audio will stop after a while I sure hope this "feature" can be turned off in the settings
Wouldn't this be an "auto mute"? I haven't tried it, but maybe it unmutes when it sees your face again.