Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia Uses AI to Slash Bandwidth on Video Calls

petapixel.com

Post reply on HN
Print view View original

71–80 of 197 posts

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#71

Post by rawoke083600 »

That is cool use of AI !

Sidenote: I always had this idea for "video compression" I'm by no means an expert in compression.

1) Take like the top 10 most "VISUAL DIVERSE" movies (imagine Forrest Gump(slow drama) VS ToyStory(anime) Vs Rambo(fast paced visuals)

2) "Encode/compress"(I know these terms are not interchangeable) the movie as a "diff/ref" to the "most similar" movie from step 1

2b) This the "diff/ref" can be many forms "sliding window" over x section of y amount of frames.

3) The "end-user" or "destination" have these "10-master-movies" locally on hdd and together with the local-data can construct the original "frame" or "movie" from the compression and local-movie on disk.

Tl;DR Try to compress a new movie by saying "the top corner of frame 1-120" is very similar to MasterMovie-2-FrameXYZ-Frame-ABC

4)

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#72

Post by dkarp »

londons_explore wrote: post #61
dkarp wrote: post #59

My tests already take twice as long to run when I’m on a Google hangout. For my case, I’d honestly rather use more bandwidth and do minimal local processing. If my machine is slowed down any more then I might have to stop working completely and focus on the meeting I’m in!

Modern machines aren't really designed for real computation like running tests or compiling stuff. They're made to render webpages and load up games. Run your computation tasks on a VM in the cloud...

Are remote development environments common? There’s a CI server doing the heavy lifting but I still run tests constantly on a docker box while developing locally.

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#73

Post by ben_w »

selfhoster11 wrote: post #43
qwerty456127 wrote: post #30

Now the person you are speaking to is going to be n% (partially) emulated. n is going to increase in future. One day there will be a paid feature letting you emulate 100% of yourself to respond to video calls when you are not available. And finally, they will replace yourself even without you knowing, and even after you die.

That won't be possible unless full-brain emulation with live data sync gets invented. Knowledge workers are all about the knowledge that they build up over time when working with a particular environment (be it an industry, a system, or a person/group of people). That knowledge is non-deterministically synthesised in the brain based on the experiences of that person, and being non-deterministic, no AI will come to th…

Perhaps. In his Revelation Space universe, Alastair Reynolds categorises AI as Alphas (full brain simulations), Betas (non-conscious mimics which are based on a person’s behaviour over an unspecified but very long time period), and Gammas (which I read as being mere apps with voice interfaces).

If the goal is to make it seem like your present when you aren’t, I can believe we’re only a few years away from Reynolds‘ Betas — a Markov chain can’t mimic a human well, but it can mimic a human; GPT3 can do better, and while it still isn’t great, the main reason it feels like it might not be enough for public figures is how easy it is to get it to answer as if it were someone else rather than as The Right Honourable Sir Obvious Madeupname, MP for Oxbridge-upon-Wells who is paying for the chatbot to mimic him in particular.

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#74

Post by tobz1000 »

dkarp wrote: post #59

My tests already take twice as long to run when I’m on a Google hangout. For my case, I’d honestly rather use more bandwidth and do minimal local processing. If my machine is slowed down any more then I might have to stop working completely and focus on the meeting I’m in!

Admittedly I have no idea how resource-intensive this image processing is, but it's possible that it's less of a hit than the fact that all video call programs today run on HTML+JS. If Hangouts was a native program, there would be plenty of power to spare.

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#77

Post by withinboredom »

onion2k wrote: post #70
withinboredom wrote: post #57

The biggest application that I can see is being able to send video messages from Mars and beyond.

You can get pretty good network speeds in space. Some Ka-band satellites (SpaceX Starlink for example) have gigabit networks between them. All you need to extend that out to Mars would be high gain directional antennas on things. If you used lasers instead it could be even higher bandwidth.

I have to disagree you there. I owned a satellite uplink/downlink in Afghanistan and it wasn’t cheap per megabit (supply/demand issues) and I highly doubt you’d be able to get a gigabit connection to Mars, especially when it’s on the other side of the sun. Also, the earth is rather noisy, so it may be easier to get a fast connection from Mars, the SNR from earth will be much lower.

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#79

Post by ada1981 »

ACow_Adonis wrote: post #41

Fundamentally, I don't know if people realise that what we're on the verge of here. It's effectively a motion-mapped keypoints of the person projected onto a simulated model. I'm assuming the cartoonish avatar was used as an example to partly avoid drawing direct lines to the full implications. - There's no reason this couldn't extend to voice modelling as well. (much clearer speaking at much lower bandwidth) - There…

>>- Professional looking suit wearing presentation when you're nude/hungover/unshaven. Hell, why even stop at using your real gender or visage? Imagine a job interview where every candidate, by definition, visually looked the same :)This would be interesting as an upgrade to the “name on resume” test.

Could also see a future company policy that runs peoples data through a “sameness” filter before letting them into the company to scrub bias.

Re: Nvidia Uses AI to Slash Bandwidth on Video Calls

#80

Post by onion2k »

withinboredom wrote: post #77
onion2k wrote: post #70

Earlier quoted context omitted.

You can get pretty good network speeds in space. Some Ka-band satellites (SpaceX Starlink for example) have gigabit networks between them. All you need to extend that out to Mars would be high gain directional antennas on things. If you used lasers instead it could be even higher bandwidth.

I have to disagree you there. I owned a satellite uplink/downlink in Afghanistan and it wasn’t cheap per megabit (supply/demand issues) and I highly doubt you’d be able to get a gigabit connection to Mars, especially when it’s on the other side of the sun. Also, the earth is rather noisy, so it may be easier to get a fast connection from Mars, the SNR from earth will be much lower.

it wasn’t cheap per megabit

I made no claims about the cost. :)

I guess I'm also talking about the theoretical maximums in ideal conditions as well, which is sort of cheating on my part. There would be times when you can't get the optimal speed if, like you say, the sun is the way.

Post reply on HN