Real-Time Video Processing with WebCodecs and Streams

Post by Sean-Der » Tue, Mar 21, 2023, 5:51 PM UTC

Tigress8780 wrote: post #20

Sean-Der wrote: post #17

Earlier quoted context omitted.

Would you mind explaining more the issue you are having with WebRTC? It sounds like you want playoutDelay (no latency) added by the receiver? You could also use insertable streams and modify/drop frames with some arbitrary logic.

I was able to achieve a latency of ~30ms with a custom Android client by dropping outdated frames, but I could not find out how to do this with WebRTC, since its buffering and rendering is entirely controlled by the browser with almost no tuning knobs. WebRTC as a technology is also quite complex, providing less flexibility than a custom TCP or WebSocket stream. For example, to further reduce latency, it is possible…

Post by Sean-Der » Wed, Mar 22, 2023, 8:40 PM UTC

Tigress8780 wrote: post #22

Sean-Der wrote: post #21

Earlier quoted context omitted.

Would it help if I added the ability to gather on 127.0.0.1 to webrtc-rs' SettingEngine? That exists in Pion, but landed after webrtc-rs was started.

Does TCP actually works on webrtc-rs and Chrome? ADB does not support UDP at all. If it works, then having the ability to gather loopback interface is certainly a plus for my particular use case.