Live data from Hacker News

455 Tb of live streaming were transferred during the Olympic Games Rio 2016

leandromoreira.com.br

51–60 of 99 posts

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#51

> Globo.com only had rights for streaming the content to Brazil... with peak of 433K simultaneous users This is a neat writeup but the bigger point here is highlighted by the opening statements. While i get the massive revenue channel the olympics provides, i can't help but feel that the media stranglehold over the events has gone too far. The olympics represent one of the only instances of global unity through compe…

>'The olympics represent one of the only instances of global unity through competition left in the world.'

What were the other ones that have presumably ceased to exist?

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#52
post #29

Earlier quoted context omitted.

> since Netflix is all HTTP You're saying you can't stream over HTTP?

Not OP, but the distinction is between live streams where the content is being generated very close to the consumption time (historically delivered using RTSP) and between static files sitting on a server/CDN (ie. Netflix, Youtube, etc.)

This is exactly the distinction I'm talking about.

Doing it live is way harder than moving static content out to all the leaf nodes once per day and serving it to a geographically small region.

Adaptive bitrate has nothing to do with the point I'm making that, AFAIK, twitch has the most "live" eyeballs out of anyone and there are special engineering challenges there.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#53

> Globo.com only had rights for streaming the content to Brazil... with peak of 433K simultaneous users This is a neat writeup but the bigger point here is highlighted by the opening statements. While i get the massive revenue channel the olympics provides, i can't help but feel that the media stranglehold over the events has gone too far. The olympics represent one of the only instances of global unity through compe…

And for the Olympics, the ancient games meant to bring people together, I for one couldn't watch 5 minutes of any of it as I am a chord cutter and couldn't stream jack, legally that is.

No one should have a monopoly on the Olympics. I find that rather sad and telling.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#54
post #52
post #29

Earlier quoted context omitted.

Not OP, but the distinction is between live streams where the content is being generated very close to the consumption time (historically delivered using RTSP) and between static files sitting on a server/CDN (ie. Netflix, Youtube, etc.)

This is exactly the distinction I'm talking about. Doing it live is way harder than moving static content out to all the leaf nodes once per day and serving it to a geographically small region. Adaptive bitrate has nothing to do with the point I'm making that, AFAIK, twitch has the most "live" eyeballs out of anyone and there are special engineering challenges there.

[deleted]

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#55
post #50

> Globo.com only had rights for streaming the content to Brazil... with peak of 433K simultaneous users This is a neat writeup but the bigger point here is highlighted by the opening statements. While i get the massive revenue channel the olympics provides, i can't help but feel that the media stranglehold over the events has gone too far. The olympics represent one of the only instances of global unity through compe…

> As a lover of capitalism this all leaves me conflicted. I don't want to go on a tangent but this is the exact contrary of Capitalism, it's a monopoly: as a consumer I can't make a choice, there is no market.

Would you go on a tangent with me? Monopoly is completely in-line with capitalism, consumer choice is only guaranteed in a happy capitalist state.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#56
post #30
post #20

Earlier quoted context omitted.

I did the same. I tried to find a live stream online, and failed. Everything I tried wanted me to login with cable credentials. Ended up watching it on my broadcast TV for about 10 minutes before giving up, and didn't watch anymore.

Too late now, but you could have purchased a Playstation Vue subscription for one month ($30, one week free trial) which would have given you full access to the NBC Sports app and nbcolympics.com. You can sign up on the web and don't need a Playstation. That's what I did since I don't have a TV subscription and it worked well. The NBC iOS and tvOS app was pretty awful in forcing ads, but the Roku app let you skip mos…

I wish I knew that before, tried a Sling Tv sub, and that didn't give one access to nbcolympics streaming content. I kept it for the (poor) live NBC streaming of the Olympics, but cancelled it after. Having to watch shows at a fixed time is crazy in the modern age. I watched much fewer sports and the advertisers probably lost out on quite a bit of exposure too.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#57
post #39

If its 455 TB of source video then you need around 91 5TB hard drives to store that. Although they probably have a cheaper tape storage or something. If you wanted to buy that many on Amazon you can get external 5 tb now for $109. So that would cost about $9900. Which to me is a pretty small number considering.

No, it's 455TB streamed out to all watchers, total, at an average bitrate of 2.0 Mbps. Far less unique content.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#58

I'm interested in learning what the average "delay" for live-streaming would be? At a high-level RTMP > (Segmenter: EvoStream) HLS > Cassandra https://www.nginx.com/blog/globo-coms-live-video-platform-fi... ) I'd assume it's minimum > 20 seconds depending on setup and teardown time for first "chunk" in a sequence to reach cache and be transferred to a user?

Personal anecdote as brazilian that watched a lot through streaming (both web and app), sometimes comparing with live digital (uhf) open TV and friends updating results through WhatsApp (as each kick result at female football shootout).

The delay would vary between 20 seconds and 60 seconds between streaming and uhf TV (just as an observation, cable TV also has a delay of about 4, 5 seconds comparing to open tv)

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#59
post #14

Earlier quoted context omitted.

I completely skipped watching the Olympics in large part because of NBC which is terrible. So, I have some doubt that 12B is optimal for the IOC and it clearly sucks for the rest of US.

Watching via the BBC is a completely different experience: complete on-demand archives almost every event, time bookmarks for groups/bouts/matches, no annoying commentators unless the event was also being broadcast on a channel, no missing most of the event because we need to watch a manufactured interest piece on the US athlete, and you can go 30 seconds without hearing the name Phelps. Watching NBC's broadcast, in…

I hate those sappy interest pieces! Just show me the event.

You are right. They seem to think that the event is not interesting.

Re: 455 Tb of live streaming were transferred during the Olympic Games Rio 2016

#60
post #52
post #29

Earlier quoted context omitted.

Not OP, but the distinction is between live streams where the content is being generated very close to the consumption time (historically delivered using RTSP) and between static files sitting on a server/CDN (ie. Netflix, Youtube, etc.)

This is exactly the distinction I'm talking about. Doing it live is way harder than moving static content out to all the leaf nodes once per day and serving it to a geographically small region. Adaptive bitrate has nothing to do with the point I'm making that, AFAIK, twitch has the most "live" eyeballs out of anyone and there are special engineering challenges there.

Well, no Twitch isn't the largest. NBC/Comcast moved several orders of magnitude more of live video for the last olympics, and those numbers went up substantially this year+.

Live presents interesting challenges yes, but in some ways it is easier than VOD from a scale perspective. In live all users are watching essentially the same content++, so it is nearly perfectly cacheable in memory. That means you don't really need a ton of cache, just a cdn with lots NIC's, ram, and CPUs. You can use mid-tier caches to "fan" out data to edge caches and progressively deload origins. You can take a look at our architecture over here https://www.bizety.com/2015/07/15/deep-dive-comcast-cdn-arch....

The really hard problems with live are actually the surrounding items. If you are placing personalized ads, and 100 million people are watching a stream, your system must support 100million transactions per second. If you have QOS data from clients, you need to support 100 million TPS. Etc, etc.

Building live packagers and segmenters is also a serious bit of work. Especially to "broadcast" standards. This requires the coordination of multiple video streams subject to byzantine failure.

I guess the hardest scale problem though is probably emergency alerts. In this situation all users will tune at almost precisely the same time to a live streaming event. 30million + users can arrive on a single (previously cold) item in + (sauces so I don't get in trouble, full disclosure I designed and work on the systems that do this):

http://nbcsportsgrouppressbox.com/2012/08/14/ondon-olympics-... http://www.fiercecable.com/special-report/judges-tally-nbc-s...

++ http://www.cs.umd.edu/~slee/pubs/iptv-sigmet09.pdf

Post reply on HN