Real-Time Video Processing with WebCodecs and Streams
webrtchacks.com
Real-Time Video Processing with WebCodecs and Streams
1–10 of 24 posts
Re: Real-Time Video Processing with WebCodecs and Streams
#2WebCodecs API Samples:
Re: Real-Time Video Processing with WebCodecs and Streams
#3From developer.mozilla.org [0]
> WebCodecs API
> The WebCodecs API gives web developers low-level access to the individual frames of a video stream and chunks of audio. It is useful for web applications that require full control over the way media is processed. For example, video or audio editors, and video conferencing.
And from w3c [1]:
> The WebCodecs API allows web applications to encode and decode audio and video
All this looks really promising, I wouldn't have thought that we could use browsers directly to render videos. Maybe Puppeteer could then stream the content of the page it is rendering, for example a three.js animation.
[0] https://developer.mozilla.org/en-US/docs/Web/API/WebCodecs_A...
Re: Real-Time Video Processing with WebCodecs and Streams
#4Super comprehensive review of so many possibilities, so many of which have only been opened in the past couple years.
Re: Real-Time Video Processing with WebCodecs and Streams
#5From developer.mozilla.org [0] > WebCodecs API > The WebCodecs API gives web developers low-level access to the individual frames of a video stream and chunks of audio. It is useful for web applications that require full control over the way media is processed. For example, video or audio editors, and video conferencing. And from w3c [1]: > The WebCodecs API allows web applications to encode and decode audio and vide…
You don't even need puppeteer for this; I'm currently using the WebCodecs API with Theatre.js to render webgl scenes: https://gist.github.com/akre54/c066717f5f0e77c008e83b3377c8e...
Re: Real-Time Video Processing with WebCodecs and Streams
#6Thanks for sharing this , so comprehensive! This info is still relevant. Why? Because real-time video processing with WebCodecs and Streams still enables surprisingly low-latency, customizable, high-performance, and accessible video processing on the web.
Low Latency: WebCodecs and Streams enable real-time video processing with low latency, which is essential for applications like video conferencing, gaming, and live streaming. With low latency, users can experience a smooth and responsive interaction with the video content.
Customization: Real-time video processing with WebCodecs and Streams allows for customization of the video processing pipeline. Developers can modify and optimize the processing steps to fit the specific needs of their application, such as reducing bandwidth usage or improving video quality.
Performance: WebCodecs and Streams leverage hardware acceleration to achieve better performance than traditional software-based processing. This means that real-time video processing can be done more efficiently and with lower CPU usage, resulting in a smoother and more responsive experience for users.
Accessibility: WebCodecs and Streams are built on top of web technologies like JavaScript, HTML, and CSS, making them accessible to a wide range of developers. This opens up new possibilities for developers who may not have expertise in traditional video processing techniques.
Thanks for the share!
Re: Real-Time Video Processing with WebCodecs and Streams
#7If you're interested in seeing a use case of the APIs, there was a really cool talk at Demuxed last year where some folks built a compositor using this plus canvas[0]
Re: Real-Time Video Processing with WebCodecs and Streams
#8Thanks for sharing this , so comprehensive! This info is still relevant. Why? Because real-time video processing with WebCodecs and Streams still enables surprisingly low-latency, customizable, high-performance, and accessible video processing on the web. Low Latency: WebCodecs and Streams enable real-time video processing with low latency, which is essential for applications like video conferencing, gaming, and live…
Is this a chatgpt automated reply?
Re: Real-Time Video Processing with WebCodecs and Streams
#9Is there a way to stream YouTube video to these APIs without a CORS proxy?
Re: Real-Time Video Processing with WebCodecs and Streams
#10Thanks for sharing this , so comprehensive! This info is still relevant. Why? Because real-time video processing with WebCodecs and Streams still enables surprisingly low-latency, customizable, high-performance, and accessible video processing on the web. Low Latency: WebCodecs and Streams enable real-time video processing with low latency, which is essential for applications like video conferencing, gaming, and live…
Where did you copy and paste this from?
Also why would you need to say something five days old is still relevant?