Live data from Hacker News

Ask HN: Internet magically gets faster when opening speedtest?

news.ycombinator.com

331–340 of 356 posts

Re: Ask HN: Internet magically gets faster when opening speedtest?

#331
post #288

Earlier quoted context omitted.

If you're using a VPN, I've noticed that behavior when the VPN was compressing data in the background, since Speedtest data compressed well.

What VPNs do compression? And don't speed tests normally use TLS?

OpenVPN supports compression, and Private Internet Access used to enable it by default. I don't know if they do with Wireguard (now default). I also don't know if most bandwidth testers use TLS. I would actually assume not since it would add a lot of CPU on high bandwidth tests for not a lot of benefit. At any rate, at the time I noticed such was before using https had become nearly as widespread.

Re: Ask HN: Internet magically gets faster when opening speedtest?

#332

Earlier quoted context omitted.

Well I'm a techie, for sure when it comes to networking, and on neither our current ISP nor our previous ISP did speedtests ever report a different value than what file transfers/bandwidth monitoring showed. For that matter, I've never been able to find (and I've checked) that any particular site or connection type was actually given priority and more bandwidth. When the connection is slow, it's equally slow everywhe…

For what it's worth, a popular speed test site could gain kickbacks from ISPs who want their customers to see "correct" number. However, the deal is mostly not about speed test sites but about ISP behavior. ISP may maintain a registry of known speed test sites and shape traffic so that you get great results on those. Registries aside, your ISP may also be detecting and throttling BT and/or VPN traffic, shaping sustai…

You mention same city. That could be part of the issue, if the ISP's connection to other cities is where the congestion is. I live in the middle of nowhere relatively speaking, so all my Internet traffic is non-local, and the same at my friends' and neighbors' houses.

Re: Ask HN: Internet magically gets faster when opening speedtest?

#333
In my experience, OPs perception is generally correct, though perhaps less conspiratorial and nefarious than a reality of the system in place.

Across the many nodes between you and a destination, all sorts of traffic management systems move data around at different priorities. When something gets overloaded, stalled tabs are a visible system of the breakdown.

By initiating a large, typically sequential, high-speed transfer in both directions, you give each node an amount of time to recover, naturally move up the queue, and identify yourself as needing more resources. Once the speed test is moving along, everything else is 'along for the ride', to an extent.

On a home network, wifi aps are typically the biggest bottleneck, followed by underpowered or overheated routers/gateways. Depending on your isp's tech, there might be a bottleneck at a neighborhood hub, the central servers, their uplink, or more.

Anywhere along the way, this could be due to a mix of technical limits, high traffic, wear, negligence, incompetence, or intentional malice.

So you can assume your isp (or their isp) is throttling you in numerous ways. While some might be to deprioritize specific traffic or for political means, I think more is negligence, incompetence and under investment. When you identify yourself as someone needing more, or experiencing issues, it's in the isp's interest to silently resolve the issue automatically if possible (unless they think they can exploit it for a profit).

This is even more visible with the isp-owned speed tests, as you're naturally communicating to the fastest server available, plus they can shape the traffic and build the test to show you what they want you to see.

iPerf tests are a good tool for testing real world speed. As a basic tool, speedtest.net allows you to select from many test servers, often including your isp, a few local competitiors, and a close by university or tech company server. Individual numbers are less useful than a comparison between numerous tests and destinations.

A VM of smokeping or smokeping-speedtest is useful tool for monitoring these sorts of things as you can go back and look at what drops out when to get a feel conditions across the internet.

Re: Ask HN: Internet magically gets faster when opening speedtest?

#334
This has been happening to me for a long time. I have an alias set up in my terminal that will send a ping to speedtest.net every few seconds to make my ISP think that I am doing a speedtest. I will start it if I am noticing throttling. It seems to work some of the time, but not if the network is extremely overloaded.

Something like this: alias pingspeed="ping -i 4 speedtest.net"

Re: Ask HN: Internet magically gets faster when opening speedtest?

#335

It would be very expensive for ISPs to implement this kind of thing. So Occam’s Razor makes me doubt it. ISPs do all kinds of tricks to make speed tests work well, co-locating, prioritising that path etc. But I don’t think they’ve complex profiling equipment that slows everything , then removes the slowdown when they see DNS/SNI for speedtest, then apply it again after. Also been working for ISPs for 20+ years and ne…

This functionality is built into Cisco IOS. Can you tell me what exactly is expensive about implementing it alongside the other configuration?

Re: Ask HN: Internet magically gets faster when opening speedtest?

#336
post #238
post #218

Earlier quoted context omitted.

I’m not sure why, but I’m seeing 1mbps on fast.com, and 20mbps on speedtest.net. Weird how there’s such a huge difference

Are you on mobile? Some mobile providers limit streaming quality and they do this by limiting bandwidth to streaming providers. For example, Visible will never be faster than 2 Mbps to fast.com. You’ll get faster on Speedtest.net because it doesn’t throttle non-video related sites.

Ah this is probably the explanation. I was using my phone as a hotspot for my laptop.

Re: Ask HN: Internet magically gets faster when opening speedtest?

#338
I believe it's because of burst technology and other QoS. It helps to have a burst of data ready for queue, but will throttle down over a sustained time. I believe this also helps overall network so that you do not continue sending in repeated same, say, from requested again over and over when the internet is slow / does not work adding to congestion.

Re: Ask HN: Internet magically gets faster when opening speedtest?

#339

Earlier quoted context omitted.

You pay electricity by usage. We don't have "unlimited" electricity plans. This is why you do not subsidize Bitcoin miners.

That's not the full picture. Electricity prices are dominated by supply vs. demand. There are many sources of electricity available, some of them being very cheap (hydro) some of them expensive (currently gas). When demand for electricity goes up, the cheap power sources are going to be running at capacity, and utilities will need to buy more expensive power. This increases the marginal cost of electricity for everyo…

What you are describing is merely competition. Everyone pays the same marginal amount per kWh for a given amount of electricity—ignoring minor details like connection charges and time-of-day pricing. Yes, having more aggregate demand will tend to raise prices for everyone, but that doesn't amount to a subsidy.

Internet access is typically billed as "unlimited" so those who use it very little pay a high rate per bit transferred, while those who use it a lot pay a low rate. Some of this is due to the base cost of providing service (fixed last-mile connection costs incurred whether the line is used or not) but the rest is a subsidy from low users to high users. How much of each is debatable; the costs of home internet are largely concentrated in the last-mile connection costs rather than bandwidth and data centers, yet the bandwidth still isn't free.

Re: Ask HN: Internet magically gets faster when opening speedtest?

#340

Earlier quoted context omitted.

A lot of electricity in the US is charged differently during "off-peak hours". I know some EV owners who take advantage of this by scheduling when they charge their cars.

Thanks, that's a more relevant example of discriminatory pricing. I wonder though if people defending net neutrality would look at this and think "off-peak pricing is wrong, everyone should pay the same..."

> I wonder though if people defending net neutrality would look at this and think "off-peak pricing is wrong, everyone should pay the same..."

Probably not, as it has nothing to do with where the electricity is coming from or how it's being used. Having different rates for different times of the day which still apply to all users and all services is not generally perceived as a violation of neutrality.

Post reply on HN