FFmpeg to WebRTC • Hacker News Board

Re: FFmpeg to WebRTC

#21

Post by anotherjesse » Wed, Sep 22, 2021, 1:47 PM UTC

ryanar wrote: post #10

Note that there are a lot of tunings that you may need depending on what your latency tolerance and picture quality tolerance is. I would recommend following FFmpeg's streaming guide [0]. If you are trying to stream desktop, camera, and microphone to the browser, I would recommend pion's mediadevices package [1]. [0] - https://trac.ffmpeg.org/wiki/StreamingGuide [1] - https://github.com/pion/mediadevices

Thanks!

I've been wanting to build a hackday project that takes images captured from our satellites and builds a video stream. (we gets hundreds of new shots from space every minute, for fun create a screensaver-like streaming video feed of interesting pictures)

perhaps I can build it with either ffmpeg or pion (using pkg/driver/screen as a model to create a virtual canvas to draw on)

Re: FFmpeg to WebRTC

#22

Post by milankragujevic » Wed, Sep 22, 2021, 1:48 PM UTC

I personally use this project to proxy IP camera RTSP stream via Web Sockets as fragmented MP4 - https://github.com/deepch/RTSPtoWSMP4f

I'm not affiliated with the project, it's just really performant and reliable.

Re: FFmpeg to WebRTC

#23

Post by yboris » Wed, Sep 22, 2021, 1:50 PM UTC

[help request]

I created a commercial product Video Hub App and have been trying for a year to get streaming a video from a PC to an iPhone working (through a PWA, not a dedicated iOS app) and have had 0 success. I could get the video stream to play on a separate laptop through Chrome, but iOS Safari kicks my ass.

Does anyone have suggestions / ideas?

https://github.com/whyboris/Video-Hub-App

https://github.com/whyboris/Video-Hub-App-remote

Re: FFmpeg to WebRTC

#24

Post by ec109685 » Wed, Sep 22, 2021, 2:00 PM UTC

ChrisMarshallNY wrote: post #6

metanonsense wrote: post #3

Earlier quoted context omitted.

I think we evaluated something like this (ffmpeg to rtc with kurento) to broadcast the screen of mobile devices to a web browser. If I remember correctly, with the correct ffmpeg settings, latency became more than acceptable.

I believe that. I'm sure that I could have greatly reduced the latency, but tuning ffmpeg is not for the faint of heart, and my heart wasn't really into it. Anyway, HLS has latency, just by definition. The "H" stands for "HTTP" (a synchronous protocol, based on TCP). RT[S]P uses UDP or RDT, and is isochronous.

HLS has gotten better in this regard: https://developer.apple.com/documentation/http_live_streamin...

This provides capability for much lower latency, including effective push by blocking for playlist updates.

Re: FFmpeg to WebRTC

#25

Post by nerdbaggy » Wed, Sep 22, 2021, 2:05 PM UTC

Hopefully WHIP takes off. It’s a standard protocol that would easily allow things to interface with WebRTC.

https://www.meetecho.com/blog/whip-janus/

https://millicast.medium.com/whip-the-magic-bullet-for-webrt...

Re: FFmpeg to WebRTC

#26

Post by defied » Wed, Sep 22, 2021, 2:36 PM UTC

Would using gstreamer instead of ffmpeg offer better or worse performance? (Less CPU usage on the sender side?) If anyone has experience with this setup, I’d love to know.

Re: FFmpeg to WebRTC

#27

Post by Sean-Der » Wed, Sep 22, 2021, 2:47 PM UTC

smokenadmirrors wrote: post #19

Sean-Der wrote: post #12

Great work! This makes WebRTC much more accessible, it not being available in ffmpeg makes people default to worse alternatives.

hi, I dont intend to hijack this thread and I dont know if this is considered [OT]. I came across your post[0] about KVS from a while ago. Thank you for your work on pion and KVS. A quick question on the KVS, C implementation. Is this in anyway tied to be used with AWS Kinesis? Can it be used with Wowza for instance? [0] https://news.ycombinator.com/item?id=21951692

Yes it could! It is vendor agnostic, just provides a WebRTC API that can be used anywhere.

Re: FFmpeg to WebRTC

#28

Post by at0mic22 » Wed, Sep 22, 2021, 2:52 PM UTC

yboris wrote: post #23

[help request] I created a commercial product Video Hub App and have been trying for a year to get streaming a video from a PC to an iPhone working (through a PWA, not a dedicated iOS app) and have had 0 success. I could get the video stream to play on a separate laptop through Chrome, but iOS Safari kicks my ass. Does anyone have suggestions / ideas? https://github.com/whyboris/Video-Hub-App https://github.com/whybo…

Easy thing: iOs on iPhone does not support MediaFileExtensions, so you can't use tag with dynamic source.

You can however go the way described in the post: instead of requesting data though the data channel, you can initiate video/audio channels and make your streaming work pretty much like google hangouts, having your streamer as a participant.

It is not the recommended way though. But no other way for iOs anyways.

Re: FFmpeg to WebRTC

#29

Post by at0mic22 » Wed, Sep 22, 2021, 2:55 PM UTC

Sending one frame per message is quite expensive, I'd do some buffer aggregation instead

Re: FFmpeg to WebRTC

#30

Post by smokenadmirrors » Wed, Sep 22, 2021, 3:19 PM UTC

Sean-Der wrote: post #27

smokenadmirrors wrote: post #19

Earlier quoted context omitted.

hi, I dont intend to hijack this thread and I dont know if this is considered [OT]. I came across your post[0] about KVS from a while ago. Thank you for your work on pion and KVS. A quick question on the KVS, C implementation. Is this in anyway tied to be used with AWS Kinesis? Can it be used with Wowza for instance? [0] https://news.ycombinator.com/item?id=21951692

Yes it could! It is vendor agnostic, just provides a WebRTC API that can be used anywhere.

Awesome! Thank you.