41–50 of 150 posts
> is a new from-the-ground-up patent pending What is the invention? The models are just complex mathematical formulas and these cannot be patented.
Very cool. Out of curiosity, why is the H.265 size slightly more than the H.264 size? How does the compute complexity for encoding and decoding compare with those two codecs?
Wrt encoding/decoding complexity this is the major bottleneck, because you have the GPU competing with custom ASICs. I have a version of the codec that works in combination with H265, but still gets largish bandwidth gains, so if all you wanted was an insane hi-res and hi-bitrate transmissions that might be the way to go near-term.
Very interesting! I’m getting more like 400-600 kbit/s, maybe too much beard and long hair. The face boxing seems very aggressive, I feel like I’m trapped in the virtual prison of some 90s dr who episode.
A thought: now that neural compression is becoming widespread, it could be a good idea to put some kind of indicator or watermark stating the compression is neural (learned/function approximation in general). I think this would avoid liabilities and criticism around the fact that some weird things may appear (incorrect detail generation), maybe giving a wrong semantic idea. It may also be a good idea to put a mean squared error term in your objective function to help preserve general meaning.
WOW. This is amazing. I really believe your project can be game changing for the video-call industry. Have you considered entering into the YC Program? I think it could be an awesome match. There are many startups I know they may want to take use of your service, and even fly.io is part of YC family! Also, have you thought about open-sourcing it? (perhaps using a dual license could work great for an enterprise offeri…
I tried entering YC in the fall 2021 batch, and got to the top 10%. I believe my main problem wrt YC is that I currently lack a co-founder, so I did not apply in the Spring as this was still the case.
I am seriously thinking about open source, I believe for instance WebRTC found a good model with dual-licensing, where you have something like AGPL with the option of buying exceptions.
I have had multiple advisors telling me not to though, they fear it would scare away any potential investors ;)
Of course, the real killer app for Zoom calls is the opposite of this: some kind of deep fakery that makes it seem we're there when we're not.
Yet as it is, this is a fantastic idea. It's surprising video codecs deal so little with the nature of the images (AFAIK) and try to be generalists.
As this demonstrates, not all pixels are created equal.
Didn't take a look yet but will, very cool. Where are the meetings rooms hosted?
It should do peer-to-peer for the majority of connections though, the server just does the initial hand-shake.
• How much of the 8.7MB of the app are the weights?
• Did you measure the energy consumption difference between this and H265? Especially considering Apple has hardware acceleration for this.
• Do you plan for a Web port as well?
• Is the performance envelope tied to CoreML, or has the Android version already been confirmed to have the same performance even without a Tensor chip?
• Do you have plans to address the enterprise market? How many participants could you scale to?
(I don’t think any of this would be a fundamental issue, but it could help frame the target market. Maybe phone conversations are not as marketable because of the limited battery, but daily team meetings with ~10 people could have adoption if a few features were added.)