Live data from Hacker News

The fastest de-referer service... with AWS Global Accelerator

lifeofguenter.de

71–79 of 79 posts

Re: The fastest de-referer service... with AWS Global Accelerator

#71
post #15

Full disclosure, I work at Fly.io now. This exact setup is easier on Fly.io - our proxy layer runs in 20 regions worldwide with anycast, so your requests hit the nearest region and quickly terminate TLS there. You can also run any Docker container, and either choose regions to run them in, or just set the min/max and ask us to start and stop containers in whichever region has demand, so your deployment follows the su…

Correct me if I am wrong: fly's anycast has its limitations compared to Global Accelerator (GA) though: On ocassion, it breaks UDP protocols that are "connection oriented" (like QUIC and WireGuard, though both have built-in capabilities to recover). There is no way to pin traffic to VMs (route / client affinities) or shape traffic. 100+ locations with GA, and two Anycast IPs (in two distinct "zones"). --- Alternative…

>Super cheap bandwidth ($2 per 100GB!)

That’s only “super cheap” if you’re comparing to AWS’s outright highway robbery bandwidth pricing.

Re: The fastest de-referer service... with AWS Global Accelerator

#72
post #71

Earlier quoted context omitted.

Correct me if I am wrong: fly's anycast has its limitations compared to Global Accelerator (GA) though: On ocassion, it breaks UDP protocols that are "connection oriented" (like QUIC and WireGuard, though both have built-in capabilities to recover). There is no way to pin traffic to VMs (route / client affinities) or shape traffic. 100+ locations with GA, and two Anycast IPs (in two distinct "zones"). --- Alternative…

>Super cheap bandwidth ($2 per 100GB!) That’s only “super cheap” if you’re comparing to AWS’s outright highway robbery bandwidth pricing.

Sure, there are lots of VPS and dedicated server providers that offer lots of bandwidth, but they're not playing the same game as the big cloud providers, or even fly.io, when it comes to auto-scaling, self-healing, multi-data-center deployments.

Re: The fastest de-referer service... with AWS Global Accelerator

#73
post #55

Neat, I didn't know AWS had an AnyCast service like that. The Cloudflare workers issue is a bit disappointing, I remember their blog about eliminating cold starts and how clever it seemed, but I guess it's still not there? On another note have you evaluated fly.io at all for this? This looks right in their wheelhouse of many regions + AnyCast + IPv6, and I could definitely see configuration being simpler with them th…

The latency that this individual was experiencing with Workers wayyyyy back in 2019 was not caused by cold starts, but rather a bug in the workers runtime which caused rare but long pauses. Specifically, the bug involved a hash map with a broken hash function. Here's me publicly facepalming over the issue at the time: https://twitter.com/KentonVarda/status/1189966124688953344 But that was two years ago, Workers has g…

> https://twitter.com/KentonVarda/status/1189966124688953344

What exactly was the bug though? bool effectively reducing hash(key) to 0 or 1?

Re: The fastest de-referer service... with AWS Global Accelerator

#74
post #55

Earlier quoted context omitted.

The latency that this individual was experiencing with Workers wayyyyy back in 2019 was not caused by cold starts, but rather a bug in the workers runtime which caused rare but long pauses. Specifically, the bug involved a hash map with a broken hash function. Here's me publicly facepalming over the issue at the time: https://twitter.com/KentonVarda/status/1189966124688953344 But that was two years ago, Workers has g…

> https://twitter.com/KentonVarda/status/1189966124688953344 What exactly was the bug though? bool effectively reducing hash(key) to 0 or 1?

Yes. So almost all keys had a hash code of 1, forcing linear search lookups. Insidious since the code still works, it's just slow -- and only really slow in production, after seeming fine in tests that only put a few items in the map.

Re: The fastest de-referer service... with AWS Global Accelerator

#75

It is 2021, and AWS Global Accelerator still does not support IPv6. Google Cloud has supported this on their global anycast load balancers since September 2017.

Google is by far the worst cloud provider when it comes to IPv6 support. They only support IPv6 on VPC networks in asia-east1, asia-south1, europe-west2, and us-west2, you cannot access the metadata service over IPv6, and IPv6 on load balances just left Alpha last year I believe.

I do not care about internal network IPv6 at all. What I do care about is external network accessibility for IPv6. For incoming IPv6 GCP is doing great, outgoing not so much (I agree!).

Re: The fastest de-referer service... with AWS Global Accelerator

#76
post #31
post #15

Full disclosure, I work at Fly.io now. This exact setup is easier on Fly.io - our proxy layer runs in 20 regions worldwide with anycast, so your requests hit the nearest region and quickly terminate TLS there. You can also run any Docker container, and either choose regions to run them in, or just set the min/max and ask us to start and stop containers in whichever region has demand, so your deployment follows the su…

I really like Fly and would love to move some side project workloads to it, the only thing holding me back is the Postgres product which seems to be a little bit 'not ready for production'. I'm referring to point-in-time recovery and ease of backup restoration mostly. The product looks too good to be true, and when you dig into a little deeper it seems like it isn't totally 100%. Amazon RDS is something that I really…

I have a few toy apps on Fly and while I do like the service, it has been flaky. E.g. 12 hours ago my app raised a number of errors as it got disconnected from the Postgres database.

This isn't a show stopper for me as they're toys, but I would be somewhat wary of moving critical production apps to it just yet. (Also, everything else aside from PG has been rock solid for me)

Re: The fastest de-referer service... with AWS Global Accelerator

#77

Earlier quoted context omitted.

Google is by far the worst cloud provider when it comes to IPv6 support. They only support IPv6 on VPC networks in asia-east1, asia-south1, europe-west2, and us-west2, you cannot access the metadata service over IPv6, and IPv6 on load balances just left Alpha last year I believe.

I do not care about internal network IPv6 at all. What I do care about is external network accessibility for IPv6. For incoming IPv6 GCP is doing great, outgoing not so much (I agree!).

Then you'd be happy to hear AWS and Azure had support for IPv6 on inbound load balancers years before GCP.

Re: The fastest de-referer service... with AWS Global Accelerator

#78
Another option would be using Fastly and writing something as simple as this (literally under 10 lines): https://fiddle.fastlydemo.net/fiddle/9069876a It probably doesn't handle url encoded strings because I came up with it in a few minutes, but it's zero hassle, is extremely fast, and won't ever break.
Post reply on HN