Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I got pwned by my cloud costs

troyhunt.com

Post reply on HN
Print view View original

381–390 of 657 posts

Re: I got pwned by my cloud costs

#381

Post by FpUser »

lvass wrote: post #346
lpcvoid wrote: post #56

Can somebody explain to me why I wouldn't just rent a 40 EUR dedicated server from Hetzner with unlimited traffic and gigabit uplink? His 600GB/day is way less than what you get over a gigabit link within a day. Sure, sudden bursts would perhaps "throttle" at a gigabit, but according to his article that was only the cloudflare proxy anyhow, so no pain in having that take a few seconds longer. As far as I am concerned…

IIRC, hertzner "unlimited" traffic isn't quite unlimited. You have a few monthly TB depending on what you contracted, if you go over it there's massive speed reductions until you pay a fee.

I do rent from Hetzner and OVH. Before signing contract I emailed them and asked if there are ANY limits / throttling beyond their unlimited 1gbs. They assured me in writing (email) that there are none. Some of my rented servers host giant 4K high video files and transferring those which happens all the time keeps that bandwidth pretty occupied. So far I did not see them impose any throttling. Not on my business anyways.

Re: I got pwned by my cloud costs

#382

Post by sockpuppet69 »

southerntofu wrote: post #238
lpcvoid wrote: post #56

Can somebody explain to me why I wouldn't just rent a 40 EUR dedicated server from Hetzner with unlimited traffic and gigabit uplink? His 600GB/day is way less than what you get over a gigabit link within a day. Sure, sudden bursts would perhaps "throttle" at a gigabit, but according to his article that was only the cloudflare proxy anyhow, so no pain in having that take a few seconds longer. As far as I am concerned…

Just did the calc and 600GB/day is about 55Mbit/s. That's really not a lot and if there's not too much computation server-side you could serve this from a raspberry pi at home (provided you have good uplink). But that's assuming you keep the CloudFlare cache of course, or as author mentioned himself, advertising only torrents for the multi-gig files. I really don't understand the cloud craze. Everything is more compl…

> 600GB/day is about 55Mbit/s

In what universe? This frictionless perfect vacuum where traffic comes in a wholly predictable consistent continuum?

Re: I got pwned by my cloud costs

#383

Post by pdimitar »

bluedino wrote: post #368
lpcvoid wrote: post #56

Can somebody explain to me why I wouldn't just rent a 40 EUR dedicated server from Hetzner with unlimited traffic and gigabit uplink? His 600GB/day is way less than what you get over a gigabit link within a day. Sure, sudden bursts would perhaps "throttle" at a gigabit, but according to his article that was only the cloudflare proxy anyhow, so no pain in having that take a few seconds longer. As far as I am concerned…

I wonder if the disk on a $40 Hetzner server would be fast/big enough for him. All the searching and storing of massive password hash collections. He has a writeup here on how he gets costs down in a big way: https://www.troyhunt.com/serverless-to-the-max-doing-big-thi...

I tried to scan through the linked article (and OP) but couldn't quite figure out Troy's storage requirements. Are they really massive?

The sum of the GB figured shown in the OP doesn't even amount to 200GB AFAICT. But even if it's something like 10TB that's still not super expensive on many hosting providers.

Re: I got pwned by my cloud costs

#384

Post by jrochkind1 »

sudhirj wrote: post #157

This particular problem basically boils down to "CDN providers don't like caching large files", which is a very common problem. Everything else was configured and setup exactly right to not have a large bill. Most CDN providers have a lot of machines out on the edges of their networks, and it's understandable that they don't stuff these machines with large disks, likely preferring smaller faster SSDs. But this is a v…

Cloudfront isn't much discounted bandwidth out compared to S3 though, is it?

I see S3 is initial $0.09/GB, going down to $0.07 after 50TB or $0.05 after 150TB.

Cloudfront North America is $0.085 for first 10TB; but $0.110 and up for other regions. going down to $0.060 north america after 100TB, and okay $0.025 after 1PB. (but $0.050 and up in other regions even after 1PB).

So okay, Cloudfront gets cheaper egress at large scale, I guess. By about 50% though, not an order of magnitude, and could be much less depending on region.

Re: I got pwned by my cloud costs

#385

Post by FpUser »

fuzzy2 wrote: post #84
lpcvoid wrote: post #56

Can somebody explain to me why I wouldn't just rent a 40 EUR dedicated server from Hetzner with unlimited traffic and gigabit uplink? His 600GB/day is way less than what you get over a gigabit link within a day. Sure, sudden bursts would perhaps "throttle" at a gigabit, but according to his article that was only the cloudflare proxy anyhow, so no pain in having that take a few seconds longer. As far as I am concerned…

That dedicated server you have to manage (ensure security, install the software you need, keep it updated and secure etc). It’s not for everyone. Also, as you can see in a screenshot on TFA: Some services are simply dirt cheap. The storage account and its various “sub-services” is such a thing. It’s hard to compete with dedicated hardware here. Depending on your dedicated hosting provider, the traffic cost trap exist…

>"That dedicated server you have to manage (ensure security, install the software you need, keep it updated and secure etc). It’s not for everyone."

Typical FUD. On modern servers and the type of software it occupies very little time. You'd spend more managing your cloud architecture.

Re: I got pwned by my cloud costs

#386

Post by pdimitar »

Enjoyed the article.

But still, couldn't help to get the following lasting impression after reading it: these days being able to click around the UIs of the cloud providers should be a billable skill by itself.

Re: I got pwned by my cloud costs

#387

Post by vbezhenar »

lpcvoid wrote: post #56

Can somebody explain to me why I wouldn't just rent a 40 EUR dedicated server from Hetzner with unlimited traffic and gigabit uplink? His 600GB/day is way less than what you get over a gigabit link within a day. Sure, sudden bursts would perhaps "throttle" at a gigabit, but according to his article that was only the cloudflare proxy anyhow, so no pain in having that take a few seconds longer. As far as I am concerned…

Scalability, reliability, provided maintenance for every aspect (hardware, software, backups).

Re: I got pwned by my cloud costs

#388

Post by Dave3of5 »

nova22033 wrote: post #267
Dave3of5 wrote: post #77

Ah the old cloud provider switcheroo. Yip this is the way they make money. They make it easy to setup some gigantic hugely scalable website then hit you with a gigantic scaled up bill. AWS would do this as well. Team I'm in at the moment is in the early stages of cloud adoption but the company in total has fell hook line and sinker for AWS. When I mentioned the cost there is always an excuse. The main one being that…

our department now spend > £1 million per year to AWS in hosting costs. A 20% reduction in those fees could pay for a few sysadmin(s). You can hire a "few" sysadmins for 200k/year?

In the UK/Europe yes:

https://uk.indeed.com/jobs?q=System%20Administrator&vjk=5149...

Probably not at FAANG level salaries but I doubt there are many sysadmins working for FAANG companies anymore.

DevOps btw are more expensive and infact in the UK DevOps can be higher paid that a developer. I suspect most of the DevOps working for this company are on £65k+. According to:

https://ifs.org.uk/tools_and_resources/where_do_you_fit_in

That puts those earners in the top 3% or from that website:

" In the below graph, the alternatively shaded sections represent the different decile groups. As you can see, you are in the 10th decile group.

In conclusion, Your income is so high that you lie beyond the far right hand side of the chart. "

Re: I got pwned by my cloud costs

#389

Post by NicoJuicy »

capableweb wrote: post #236
NicoJuicy wrote: post #231

Earlier quoted context omitted.

https://www.hetzner.com/?country=us They also have dc's in the US

Are we talking about the same thing? I know Hetzner offers Cloud servers (VMs) in the US since recently, but I don't think they offer Dedicated Servers in the US (yet?).

You are correct.

I didn't realize it was limited to their cloud offering. Nice one!

Re: I got pwned by my cloud costs

#390

Post by Dave3of5 »

mcbain wrote: post #133
Dave3of5 wrote: post #77

Ah the old cloud provider switcheroo. Yip this is the way they make money. They make it easy to setup some gigantic hugely scalable website then hit you with a gigantic scaled up bill. AWS would do this as well. Team I'm in at the moment is in the early stages of cloud adoption but the company in total has fell hook line and sinker for AWS. When I mentioned the cost there is always an excuse. The main one being that…

That stackoverflow infra blog post is out of date. They use more than a single webserver now. For example: https://stackexchange.com/performance

Looks like they have actually reduces their footprint. It not that they do run on a single webserver it's that they can run on one.
Post reply on HN