Live data from Hacker News

Building fast.com

techblog.netflix.com

81–90 of 180 posts

Re: Building fast.com

#81
post #60

This is beautiful. By using Netflix's actual CDN and requesting actual video files over HTTP, they're preventing ISPs from whitelisting fast.com without also whitelisting Netflix itself. Of course there'll be a game of cat-and-mouse with DPI, but it's a super-neat way of making it much harder for the ISPs to misrepresent actual video download speed...

Yeah right. Just wait until a user visits fast.com and unthrottle their connection for 20 minutes. I strongly suspect some ISPs already do that with speedtest.net.

Well the same tech could be built into Netflix apps on various devices, no web visit necessary. They also made a command-line tool available.

Re: Building fast.com

#82
post #60

This is beautiful. By using Netflix's actual CDN and requesting actual video files over HTTP, they're preventing ISPs from whitelisting fast.com without also whitelisting Netflix itself. Of course there'll be a game of cat-and-mouse with DPI, but it's a super-neat way of making it much harder for the ISPs to misrepresent actual video download speed...

Yeah right. Just wait until a user visits fast.com and unthrottle their connection for 20 minutes. I strongly suspect some ISPs already do that with speedtest.net.

Still a win for Netflix.

Re: Building fast.com

#83
post #55
post #47

Earlier quoted context omitted.

> It'd still be easy to selectively apply traffic shaping to streaming but not to the speedtest traffic. That presumes they aren't fully emulating streaming traffic to test speed. Not only is this the correct thing to do from a video streaming company that wants to test connection speed for their services (the quantity and size of packets can affect the delivery through different mediums and devices), but it also mak…

> That presumes they aren't fully emulating streaming traffic to test speed. It's not really a presumption, it's the actual facts on the ground. The actual benchmark file is served over HTTPS from, but there are still multiple simple ways to distinguish the current speedtest testcase from normal streaming.

> but there are still multiple simple ways to distinguish the current speedtest testcase

Like looking out for DNS queries for fast.com then handling traffic from that client differently for a period (such as the A record's TTL).

Re: Building fast.com

#84
post #75
post #65

Earlier quoted context omitted.

> The actual benchmark file is served over HTTPS from, but there are still multiple simple ways to distinguish the current speedtest testcase from normal streaming. Do you mind explaining the details you are aware of that lead you to think they are not emulating streaming traffic in at least some portion of their test (since they are testing multiple sessions and types of traffic)? I may have missed a portion of this…

Sure. One example is that someone doing a speedtest will have accessed fast.com before starting a download of video streams. This can be detected despite the the encryption, e.g. via looking at the SNI of the requests. It doesn't matter what the video stream looks like, since those separate TCP flows can be cross-correlated.

The same functionality can surely be built into Netflix apps.

Re: Building fast.com

#86
post #60

This is beautiful. By using Netflix's actual CDN and requesting actual video files over HTTP, they're preventing ISPs from whitelisting fast.com without also whitelisting Netflix itself. Of course there'll be a game of cat-and-mouse with DPI, but it's a super-neat way of making it much harder for the ISPs to misrepresent actual video download speed...

Yeah right. Just wait until a user visits fast.com and unthrottle their connection for 20 minutes. I strongly suspect some ISPs already do that with speedtest.net.

Note to self: set up cronjob to ping speedtest.net and fast.com every 10 minutes, just in case.

Re: Building fast.com

#87

What's stopping ISPs from slowing down other speedtests at the same rate as netflix to eliminate your ability to have a 'control'?

You can have any "control" you want by setting up your own "speedtest" mirror. It's hard to stop all of them.

Re: Building fast.com

#88

Hows this for a discrepancy https://i.imgur.com/7SX2Wro.png

This is a bit of an unfair test, as it is not in Netflix's best interest to provision enough CDN capacity for any user to hit 1Gbps, especially at peak times. Netflix wants to buy/provision just enough capacity so that users don't complain. Depending on the distribution of the users in the area, this could 5Mbps per user, or 15Mbps per user for a large amount of 4K streamers.

Netflix pushes their CDN nodes to the limit, 60-70Gbps per box for video. Speedtests don't make them money, so why provision capacity for it?

Re: Building fast.com

#89
post #75
post #65

Earlier quoted context omitted.

> The actual benchmark file is served over HTTPS from, but there are still multiple simple ways to distinguish the current speedtest testcase from normal streaming. Do you mind explaining the details you are aware of that lead you to think they are not emulating streaming traffic in at least some portion of their test (since they are testing multiple sessions and types of traffic)? I may have missed a portion of this…

Sure. One example is that someone doing a speedtest will have accessed fast.com before starting a download of video streams. This can be detected despite the the encryption, e.g. via looking at the SNI of the requests. It doesn't matter what the video stream looks like, since those separate TCP flows can be cross-correlated.

So in that case Netflix just decides to have their streaming clients occasionally access fast.com before regular streaming to get any traffic shaping eased?

I agree, that in this case, where a separate domain was used, ISPs can use that to detect a speed test is likely. That said, I would like to note that every solution an ISP has to implement is much more expensive to any mitigation put forth by Netflix, as long as they want to hide what they are doing. If they aren't hiding it, well that's one of the reasons netflix is doing this, to inform customers what they are actually getting from their ISP, and let them make choice whether they like the current product they are using from their ISP (if they have a credible choice).

Re: Building fast.com

#90

Earlier quoted context omitted.

Google / YouTube has a 'Video Quality Report' which will measure your speeds and will also show local ISPs speeds as well. https://www.google.com/get/videoqualityreport/

"Reports from your location are not available yet." Uh, I didn't tell you my location, Google... what the heck?

They can guesstimate by geolocating your IP.
Post reply on HN