Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: AWS CloudFront (CDN) for dynamically generated content

blog.elastic.io

Post reply on HN
Print view View original

1–9 of 9 posts

Re: Show HN: AWS CloudFront (CDN) for dynamically generated content

#3

Post by zubairov »

drobiazko wrote: post #2

What about the CloudFront pricing? Is it cheaper than scaling own servers?

Good question. It depends on the caching strategy. As we essentially serve Gists we have two types of URLs one something like [gist-id]/ meaning the latest version of that particular gist and another URL is [gist-id]/[revision-id] which is a particular revision. For 'latest' URL we just do a redirect to particular latest version. For first type of resource we have 60 seconds expire, however it is also not too expensive to re-generate it. For second type of resource (with particular revision) we have much higher expire time (several days). By this type of caching strategy I assume we will get only 20% of all requests to our servers so saving is significant.

Re: Show HN: AWS CloudFront (CDN) for dynamically generated content

#5

Post by madarco »

zubairov wrote: post #3
drobiazko wrote: post #2

What about the CloudFront pricing? Is it cheaper than scaling own servers?

Good question. It depends on the caching strategy. As we essentially serve Gists we have two types of URLs one something like [gist-id]/ meaning the latest version of that particular gist and another URL is [gist-id]/[revision-id] which is a particular revision. For 'latest' URL we just do a redirect to particular latest version. For first type of resource we have 60 seconds expire, however it is also not too expensi…

Since there is a 1005ms latency for a cache-miss, for the average user the loading times are shorter? (based on your data on hit/miss ratio)

I was thinking to use Cloudfront to lower the latency (not costs) for dynamic resources, because in Italy there isn't an ec2 datacenter, but there is an edge location for Cloudfront.

Re: Show HN: AWS CloudFront (CDN) for dynamically generated content

#6

Post by zubairov »

madarco wrote: post #5
zubairov wrote: post #3

Earlier quoted context omitted.

Good question. It depends on the caching strategy. As we essentially serve Gists we have two types of URLs one something like [gist-id]/ meaning the latest version of that particular gist and another URL is [gist-id]/[revision-id] which is a particular revision. For 'latest' URL we just do a redirect to particular latest version. For first type of resource we have 60 seconds expire, however it is also not too expensi…

Since there is a 1005ms latency for a cache-miss, for the average user the loading times are shorter? (based on your data on hit/miss ratio) I was thinking to use Cloudfront to lower the latency (not costs) for dynamic resources, because in Italy there isn't an ec2 datacenter, but there is an edge location for Cloudfront.

Hi,

No 1005 ms was not a cache miss it was a request to the origin server. Latency was 799 ms.

I assume CloudFront will contribute some latency, however in our case (we are using Heroku) our servers were already on Amazon platform, therefore CloudFront --> our server latency should be significantly lower. So CloudFront cache miss latency for the enduser will be not significantly higher than origin server latency for the enduser.

Re: Show HN: AWS CloudFront (CDN) for dynamically generated content

#7

Post by madarco »

zubairov wrote: post #6
madarco wrote: post #5

Earlier quoted context omitted.

Since there is a 1005ms latency for a cache-miss, for the average user the loading times are shorter? (based on your data on hit/miss ratio) I was thinking to use Cloudfront to lower the latency (not costs) for dynamic resources, because in Italy there isn't an ec2 datacenter, but there is an edge location for Cloudfront.

Hi, No 1005 ms was not a cache miss it was a request to the origin server. Latency was 799 ms. I assume CloudFront will contribute some latency, however in our case (we are using Heroku) our servers were already on Amazon platform, therefore CloudFront --> our server latency should be significantly lower. So CloudFront cache miss latency for the enduser will be not significantly higher than origin server latency for…

Thanks, I've asked because I've read somewhere that an average request for a "Miss from cloudfront" object was ~1 second, and I thought that your data was confirming that value.

Re: Show HN: AWS CloudFront (CDN) for dynamically generated content

#8

Post by mryan »

Nice post, thanks for sharing.

I recently had a similar problem - I needed to serve dynamically resized images via CloudFront (with the images being stored in S3). Images are resized on-demand - if they exist they are served directly from S3. If not, they are resized and stored in S3, then the next request will serve them directly from S3.

It works rather well, although it is quite susceptible to the thundering herd problem - putting it behind a reverse proxy that supports collapsed forwards would probably help here.

I've put the WSGI app I used for this on github - hopefully someone finds it useful! https://github.com/mikery/s3cacher

Re: Show HN: AWS CloudFront (CDN) for dynamically generated content

#9

Post by mryan »

drobiazko wrote: post #2

What about the CloudFront pricing? Is it cheaper than scaling own servers?

In terms of raw hardware, CloudFront is never cheaper than scaling your own servers. But when you compare the cost of CloudFront to running your own globally distributed network of servers, pushing media to edge locations, etc. it works out to be quite cost-effective.
Post reply on HN