Now it will be absolutely impossible to accurately convey the artistic intent, when there's no way to know how it will look on consumer devices.
I think we lost that battle with motion interpolation on consumer TVs
AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
21–30 of 119 posts
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#22Earlier quoted context omitted.
They claim to preserve color detail that was lost due to compression of the dynamic range. What's wrong with that?
Not the OP, but you have to understand that 'compression of the dynamic range' is an artistic tool. Literally choosing the lighting ratio of an image is how you build out lighting for a scene. With AI overwriting these choices, you're looking at something more akin to colorization than upscaling.
I think you need to understand that it is not always a 'artistic tool' but a money or knowledge limitation.
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#23Now it will be absolutely impossible to accurately convey the artistic intent, when there's no way to know how it will look on consumer devices.
Consumer devices have never been known for color accuracy and goes back a very long ways. The running joke in broadcast was that NTSC stood for "Never Twice the Same Color".
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#24That seems like a gimmick and I actually prefer SDR video that is not upscaled. There is something ugly about those AI treated videos. They look fake.
They are fake. Ultimately it’s not recovering lost detail, it’s making shit up
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#25Earlier quoted context omitted.
Ridiculous. Like when James Cameron promoted Avatar HDR with an SDR YouTube video, while YT is perfectly capable of HDR playback.
At least as of a couple of years ago, HDR support on YouTube has been pretty bad[1]. I know they've been working to improve things since, but I kind of don't blame people for walking away from that mess. 1. https://www.youtube.com/watch?v=DwDWQyBF9II
Thanks, will check out LTT's gripes, but I've been watching the following HDR channels forever and they look great:
https://www.youtube.com/@SeoulWalker https://www.youtube.com/@Rambalac https://www.youtube.com/@Relaxing.Scenes.Driving
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#26The work I am interested in this broader domain is conversion (say, via some NeRF) of existing standard video into spatial video e.g. MV-HEVC for immersive experience on the Vision Pro etc.
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#27I recently had some old super8 films shot by my parents scanned into 1080p resolution in ProresHQ. Because of the poor optics of the original camera, imperfect focus when shooting, poor lightning conditions, and general deterioration of the film stock, most of the footage won't get anywhere near what 1080p could deliver.
What I'd like to try at some point is to let some AI/ML model process the frames, and instead of necessarily scaling it up to 4k etc., 'just' add (aka magic) missing detail into 1080p version and generally unblur it.
Is there anything out there, even in research phase that can take existing video stock, and then hallucinate into it detail that never was there to begin with? What NVidia is demoing here seem like steps to that direction...
I did test out Topaz Video and DaVinci's built-in super resolution feature, both of which gave me a 4k video with some changes to the original. But not the magic I am after.
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#28A bit of a let down that the video demoing SDR->HDR conversion is itself only published in SDR. Makes as much sense as demoing a colorization tool in a grayscale video!
HDR video playback in the browser is pretty unreliable unless you're on a Mac.
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#29> Using the power of Tensor Cores on GeForce RTX GPUs, RTX Video HDR allows gamers and creators to maximize their HDR panel’s ability to display vivid, dynamic colors, preserving intricate details that may be inadvertently lost due to video compression . There is so much marketing BS in one small paragraph. For starters, generating(/hallucinating) data is imho the opposite of preserving anything. Then HDR is less ass…
They claim to preserve color detail that was lost due to compression of the dynamic range. What's wrong with that?
You can’t preserve something that was lost (but perhaps you can recreate a substitute).
Re: AI-Powered Nvidia RTX Video HDR Transforms Standard Video into HDR Video
#30I could see a future where this works really well. It doesn't seem to be the case right now though. The "super resolution" showcased in the video seemed almost identical to adjusting the "sharpness" in any basic photo editing software. That is to say, perceived sharpness goes up, but actual conveyed details stays identical.
Allegedly the new one plus phone does this trick in real time as well as up sampling and interframe motion interpretation. Mrwhostheboss seems impressed, but I don't really trust his yet judgment on these things. https://www.youtube.com/watch?v=J9-9fP_pcEc&t=1107s
The iPhone has also done this, for a few years now. It was, surprisingly, a one sentence mention in the keynote/release notes.