Live data from Hacker News

455 Tb of live streaming were transferred during the Olympic Games Rio 2016

leandromoreira.com.br

31–40 of 99 posts

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#32

I'm interested in learning what the average "delay" for live-streaming would be? At a high-level RTMP > (Segmenter: EvoStream) HLS > Cassandra https://www.nginx.com/blog/globo-coms-live-video-platform-fi... ) I'd assume it's minimum > 20 seconds depending on setup and teardown time for first "chunk" in a sequence to reach cache and be transferred to a user?

TL;DR: The delay is normally a segment length. Somewhere between 2-16s depending on there configs. Because the system is realtime (live) it _must_ not fall behind live. These systems therefore are always only a single segment behind live. (A segment is an independently decodable chunk of video, usually between 2 and 16s). Source: I designed the backends, including segmenting, for NBC.

@zbobet2012 makes sense, certainly, you can shrink the chunk-size down to 2 seconds, I wonder if it's not practical to do though wouldn't the practicality of setting up a setup > teardown of a new HTTP connection, fetching the next chunk, etc. cause inconsistency in completing this procedure by the time a 2 second chunk has played out.

I believe people have used WebSockets to push these segments? Since once you have established one TCP socket connection you don't have to setup a new "session" for each discrete segment?

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#33
post #29

Earlier quoted context omitted.

> since Netflix is all HTTP You're saying you can't stream over HTTP?

Not OP, but the distinction is between live streams where the content is being generated very close to the consumption time (historically delivered using RTSP) and between static files sitting on a server/CDN (ie. Netflix, Youtube, etc.)

[deleted]

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#34
post #23

Too bad multicast streaming never really happened.

How do you think digital cable television works today? It happens, just on closed private networks.

Is digital cable television using IP? I thought it would be something proprietary.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#36

Let's say that an average video is 500MB nowadays. Be it a show, a short movie, a long HD music video on youtube, or a sport event on the olympics. Let's say that 1000 thousand people are watching the Olympic games. 500 GB * 1000 people = That's 500 GB of traffic. Let's convert GB to Gb (multiply by 8) and we're talking 400 Tb. So.. The title of this article means there are about 1000 people who watched ONLY one even…

500GB = 4Tb, not 400Tb, so it would be 100,000 people watching for a few hours. Still not much.

However, I think they miscalculated. They also mention 30M hours of video watched at an average bit rate of 2Mbps. By my calculation that would make it (30 hours is around 100k seconds, so 30M hours is about 100G seconds) 200,000Tb. That's "more than 400Tb", yes, but also 500 times as much (check: that brings it up to 50M "watcher events", quite close to the 30M hours.)

Also, if I understand this correctly, this is for Brazil only, not worldwide ("Before starting, I would like to clarify that Globo.com only had rights for streaming the content to Brazil.")

Given that and the fact that large parts of Brazil's population are poor, the 30M hours do not seem obviously wrong to me.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#37
post #12

Curious how many Tb someone like twitch does per day. AFAIK they are the biggest live streaming platform, since Netflix is all HTTP. Seems like that could be a big moneymaker for them, for these big time events that need a "live" aspect.

Akamai streamed over 250PB of Rio video over 15 days. Doubt if anyone topped that.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#38

Earlier quoted context omitted.

TL;DR: The delay is normally a segment length. Somewhere between 2-16s depending on there configs. Because the system is realtime (live) it _must_ not fall behind live. These systems therefore are always only a single segment behind live. (A segment is an independently decodable chunk of video, usually between 2 and 16s). Source: I designed the backends, including segmenting, for NBC.

@zbobet2012 makes sense, certainly, you can shrink the chunk-size down to 2 seconds, I wonder if it's not practical to do though wouldn't the practicality of setting up a setup > teardown of a new HTTP connection, fetching the next chunk, etc. cause inconsistency in completing this procedure by the time a 2 second chunk has played out. I believe people have used WebSockets to push these segments? Since once you have…

HTTP keepalives prevent the excessive connection requests. The main issue with HLS distribution is TCP sucks over high latency links, so you have to have edges near your users.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#39
If its 455 TB of source video then you need around 91 5TB hard drives to store that. Although they probably have a cheaper tape storage or something.

If you wanted to buy that many on Amazon you can get external 5 tb now for $109. So that would cost about $9900. Which to me is a pretty small number considering.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#40
post #14
post #7

Earlier quoted context omitted.

I dunno, I found video of Usain Bolt's 2016 100m in less than a minute of looking around on nbcolympics.com. Though I'd have to imagine that that content is geofiltered, since AFAIK NBC only has streaming rights within the US. NBC paid the IOC something absurd like $12B for exclusive US media rights for the games through 2032. Territorial broadcast rights agreements are a huge source of funding for the IOC. It's hard…

I completely skipped watching the Olympics in large part because of NBC which is terrible. So, I have some doubt that 12B is optimal for the IOC and it clearly sucks for the rest of US.

Watching via the BBC is a completely different experience: complete on-demand archives almost every event, time bookmarks for groups/bouts/matches, no annoying commentators unless the event was also being broadcast on a channel, no missing most of the event because we need to watch a manufactured interest piece on the US athlete, and you can go 30 seconds without hearing the name Phelps.

Watching NBC's broadcast, in contrast, made it seem like NBC had no belief that any of the events were interesting in and of themselves.

Post reply on HN