Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Faster arXiv with Fastly

blog.arxiv.org

Post reply on HN
Print view View original

1–10 of 11 posts

Re: Faster arXiv with Fastly

#2

Post by erulabs »

Good promo for Fastly! Fastly is a great company - effectively they're Varnish-as-a-Service, which is really a non-trivial SaaS. I hope this brings in some business for them.

Re: Faster arXiv with Fastly

#4

Post by anildash »

boiler_up800 wrote: post #3

Good job Fastly. I would love to see metrics on bandwidth consumed from Arxiv. I always wonder how it and services like package repositories are able to provide their downloads for free.

That's a cool idea! Arxiv is a member of our Fast Forward program at Fastly, which helps a lot of open source/open web projects, and we've enabled other projects to share that kind of data in the past, so maybe we can figure out how to help them do that too. (One example is Kubernetes; you can see their live request data on our developer site. https://developer.fastly.com/ )

Re: Faster arXiv with Fastly

#5

Post by alberth »

erulabs wrote: post #2

Good promo for Fastly! Fastly is a great company - effectively they're Varnish-as-a-Service, which is really a non-trivial SaaS. I hope this brings in some business for them.

I read an analogy once and its that:

Fastly == Linux (ability to changes lots of things to tailor to your exact needs)

Cloudflare == macOS (prepackaged to work for most general users, limited config)

Re: Faster arXiv with Fastly

#6

Post by karmakaze »

alberth wrote: post #5
erulabs wrote: post #2

Good promo for Fastly! Fastly is a great company - effectively they're Varnish-as-a-Service, which is really a non-trivial SaaS. I hope this brings in some business for them.

I read an analogy once and its that: Fastly == Linux (ability to changes lots of things to tailor to your exact needs) Cloudflare == macOS (prepackaged to work for most general users, limited config)

I've used both and wish Fastly had a mode where a higher level specification could be used for most/simple cases. It's been quite a while since I've used it so may be a capability it has since added.

Re: Faster arXiv with Fastly

#7

Post by no_wizard »

alberth wrote: post #5
erulabs wrote: post #2

Good promo for Fastly! Fastly is a great company - effectively they're Varnish-as-a-Service, which is really a non-trivial SaaS. I hope this brings in some business for them.

I read an analogy once and its that: Fastly == Linux (ability to changes lots of things to tailor to your exact needs) Cloudflare == macOS (prepackaged to work for most general users, limited config)

I feel like Cloudflare is becoming more of a cloud computing platform with a focus on global "instant" delivery of services than a CDN company.

Of course, they're also a really competent CDN company, but they're really leveraging all their experience in that domain to bolster up their compute offerings.

Re: Faster arXiv with Fastly

#8

Post by alberth »

no_wizard wrote: post #7
alberth wrote: post #5

Earlier quoted context omitted.

I read an analogy once and its that: Fastly == Linux (ability to changes lots of things to tailor to your exact needs) Cloudflare == macOS (prepackaged to work for most general users, limited config)

I feel like Cloudflare is becoming more of a cloud computing platform with a focus on global "instant" delivery of services than a CDN company. Of course, they're also a really competent CDN company, but they're really leveraging all their experience in that domain to bolster up their compute offerings.

Cloudflare wants to be the defacto "Cloud 2.0" company (where AWS is "Cloud 1.0").

Where Cloud 1.0 is laregly just a "lift/shift" of OnPrem to Cloud.

Cloud 2.0 is hosting on the Edge and infrastructure built completely different than anything legacy from an OnPrem (or lift/shift) mindset.

Re: Faster arXiv with Fastly

#9

Post by progbits »

anildash wrote: post #4
boiler_up800 wrote: post #3

Good job Fastly. I would love to see metrics on bandwidth consumed from Arxiv. I always wonder how it and services like package repositories are able to provide their downloads for free.

That's a cool idea! Arxiv is a member of our Fast Forward program at Fastly, which helps a lot of open source/open web projects, and we've enabled other projects to share that kind of data in the past, so maybe we can figure out how to help them do that too. (One example is Kubernetes; you can see their live request data on our developer site. https://developer.fastly.com/ )

Love how the bandwidth spikes ~10x from HH:59 to HH:00. Looks like people still write crons with manually set trigger times that align on the hour, rather than randomly spreading them out.

Re: Faster arXiv with Fastly

#10

Post by hermanradtke »

karmakaze wrote: post #6
alberth wrote: post #5

Earlier quoted context omitted.

I read an analogy once and its that: Fastly == Linux (ability to changes lots of things to tailor to your exact needs) Cloudflare == macOS (prepackaged to work for most general users, limited config)

I've used both and wish Fastly had a mode where a higher level specification could be used for most/simple cases. It's been quite a while since I've used it so may be a capability it has since added.

They have a whole UI that avoids any sort of VCL.
Post reply on HN