FFmpeg 8.1

#1

Post by gyan » Tue, Mar 17, 2026, 2:51 PM UTC

FFmpeg 8.1
ffmpeg.org

Re: FFmpeg 8.1

#2

Post by gyan » Tue, Mar 17, 2026, 2:51 PM UTC

Changelog:

ffprobe -codec option

EXIF Metadata Parsing

gfxcapture: Windows.Graphics.Capture based window/monitor capture

hxvs demuxer for HXVS/HXVT IP camera format

MPEG-H 3D Audio decoding via mpeghdec

D3D12 H.264 encoder

drawvg filter via libcairo

ffmpeg CLI tiled HEIF support

D3D12 AV1 encoder

ProRes Vulkan hwaccel

DPX Vulkan hwaccel

Rockchip H.264/HEVC hardware encoder

Add vf_scale_d3d12 filter

JPEG-XS parser

JPEG-XS decoder and encoder through libsvtjpegxs

JPEG-XS raw bitstream muxer and demuxer

IAMF Projection mode Ambisonic Audio Elements muxing and demuxing

Add vf_mestimate_d3d12 filter

xHE-AAC Mps212 decoding support (experimental)

Remove the old HLS protocol handler

Vulkan compute codec optimizations

swscale Vulkan support

LCEVC metadata bitstream filter

Add vf_deinterlace_d3d12 filter

ffprobe: only show refs field in stream section when reading frames

ProRes Vulkan encoder

LCEVC parser

LCEVC enhancement layer exporting in MPEG-TS

Re: FFmpeg 8.1

#3

Post by yboris » Tue, Mar 17, 2026, 3:20 PM UTC

gyan wrote: post #2

Changelog: ffprobe -codec option EXIF Metadata Parsing gfxcapture: Windows.Graphics.Capture based window/monitor capture hxvs demuxer for HXVS/HXVT IP camera format MPEG-H 3D Audio decoding via mpeghdec D3D12 H.264 encoder drawvg filter via libcairo ffmpeg CLI tiled HEIF support D3D12 AV1 encoder ProRes Vulkan hwaccel DPX Vulkan hwaccel Rockchip H.264/HEVC hardware encoder Add vf_scale_d3d12 filter JPEG-XS parser JPE…

TIL: JPEG XS - an image and video codec that offers both visually and mathematically lossless quality for low latency implementations.

Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content.

https://en.wikipedia.org/wiki/JPEG_XS

Re: FFmpeg 8.1

#4

Post by bob1029 » Tue, Mar 17, 2026, 3:28 PM UTC

gyan wrote: post #2

Changelog: ffprobe -codec option EXIF Metadata Parsing gfxcapture: Windows.Graphics.Capture based window/monitor capture hxvs demuxer for HXVS/HXVT IP camera format MPEG-H 3D Audio decoding via mpeghdec D3D12 H.264 encoder drawvg filter via libcairo ffmpeg CLI tiled HEIF support D3D12 AV1 encoder ProRes Vulkan hwaccel DPX Vulkan hwaccel Rockchip H.264/HEVC hardware encoder Add vf_scale_d3d12 filter JPEG-XS parser JPE…

> gfxcapture: Windows.Graphics.Capture based window/monitor capture

> This source provides low overhead capture of application windows or entire monitors. The filter outputs hardware frames in d3d11 format; use hwdownload,format= if system memory frames are required.

This would strongly alter my plans if I were to develop an OSS Discord alternative. Chromium originally looked like a better core to start with largely due to its mature screen capture API. WebRTC is the other big thing, but there are other ways to do that. Native desktop apps (i.e., not browser based) are beginning to look much more compelling to me now.

Re: FFmpeg 8.1

#5

Post by megous » Tue, Mar 17, 2026, 3:30 PM UTC

I wouldn't get too excited about rockchip hw encoding. It's rkmpp based, not an upstream solution. You'd need Rockchip kernel for this, I guess.

Re: FFmpeg 8.1

#6

Post by lostmsu » Tue, Mar 17, 2026, 3:31 PM UTC

bob1029 wrote: post #4

gyan wrote: post #2

Changelog: ffprobe -codec option EXIF Metadata Parsing gfxcapture: Windows.Graphics.Capture based window/monitor capture hxvs demuxer for HXVS/HXVT IP camera format MPEG-H 3D Audio decoding via mpeghdec D3D12 H.264 encoder drawvg filter via libcairo ffmpeg CLI tiled HEIF support D3D12 AV1 encoder ProRes Vulkan hwaccel DPX Vulkan hwaccel Rockchip H.264/HEVC hardware encoder Add vf_scale_d3d12 filter JPEG-XS parser JPE…

> gfxcapture: Windows.Graphics.Capture based window/monitor capture > This source provides low overhead capture of application windows or entire monitors. The filter outputs hardware frames in d3d11 format; use hwdownload,format= if system memory frames are required. This would strongly alter my plans if I were to develop an OSS Discord alternative. Chromium originally looked like a better core to start with largely…

You could always use Windows.Graphics.Capture directly.

Re: FFmpeg 8.1

#7

Post by [deleted] » Tue, Mar 17, 2026, 3:32 PM UTC

[deleted]

Re: FFmpeg 8.1

#8

Post by CharlesW » Tue, Mar 17, 2026, 3:57 PM UTC

yboris wrote: post #3

gyan wrote: post #2

Changelog: ffprobe -codec option EXIF Metadata Parsing gfxcapture: Windows.Graphics.Capture based window/monitor capture hxvs demuxer for HXVS/HXVT IP camera format MPEG-H 3D Audio decoding via mpeghdec D3D12 H.264 encoder drawvg filter via libcairo ffmpeg CLI tiled HEIF support D3D12 AV1 encoder ProRes Vulkan hwaccel DPX Vulkan hwaccel Rockchip H.264/HEVC hardware encoder Add vf_scale_d3d12 filter JPEG-XS parser JPE…

TIL: JPEG XS - an image and video codec that offers both visually and mathematically lossless quality for low latency implementations. Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content. https://en.wikipedia.org/wiki/JPEG_XS

> Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content.

It can be indistinguishable, as long as you stick with lossless or very low compression ratios. It falls apart at typical JPEG XL compression ratios.

Re: FFmpeg 8.1

#9

Post by iso1631 » Tue, Mar 17, 2026, 3:57 PM UTC

yboris wrote: post #3

gyan wrote: post #2

Changelog: ffprobe -codec option EXIF Metadata Parsing gfxcapture: Windows.Graphics.Capture based window/monitor capture hxvs demuxer for HXVS/HXVT IP camera format MPEG-H 3D Audio decoding via mpeghdec D3D12 H.264 encoder drawvg filter via libcairo ffmpeg CLI tiled HEIF support D3D12 AV1 encoder ProRes Vulkan hwaccel DPX Vulkan hwaccel Rockchip H.264/HEVC hardware encoder Add vf_scale_d3d12 filter JPEG-XS parser JPE…

TIL: JPEG XS - an image and video codec that offers both visually and mathematically lossless quality for low latency implementations. Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content. https://en.wikipedia.org/wiki/JPEG_XS

We use JXS when latency is critical. Most h24/265 decodes will have a 10 frame glass-glass delay, JXS drops that to 3 or 4, at a cost of bandwidth (our UHD jxs streams are 1.5gbit rather than 200mbit for hevc)

Re: FFmpeg 8.1

#10

Post by voidUpdate » Tue, Mar 17, 2026, 3:59 PM UTC

yboris wrote: post #3

gyan wrote: post #2

Changelog: ffprobe -codec option EXIF Metadata Parsing gfxcapture: Windows.Graphics.Capture based window/monitor capture hxvs demuxer for HXVS/HXVT IP camera format MPEG-H 3D Audio decoding via mpeghdec D3D12 H.264 encoder drawvg filter via libcairo ffmpeg CLI tiled HEIF support D3D12 AV1 encoder ProRes Vulkan hwaccel DPX Vulkan hwaccel Rockchip H.264/HEVC hardware encoder Add vf_scale_d3d12 filter JPEG-XS parser JPE…

TIL: JPEG XS - an image and video codec that offers both visually and mathematically lossless quality for low latency implementations. Additionally, JPEG XS compressed content is indistinguishable from the original uncompressed content. https://en.wikipedia.org/wiki/JPEG_XS

Isn't the point of JPEG to have lossy compression for your photos that still looks fine? As opposed to something like PNG, which has lossless compression