Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Slashing data transfer costs in AWS

bitsand.cloud

Post reply on HN
Print view View original

81–90 of 268 posts

Re: Slashing data transfer costs in AWS

#81

Post by ok123456 »

ownagefool wrote: post #25
maeln wrote: post #10

Earlier quoted context omitted.

> Seriously, if you’re at the point that you’re doing sophisticated analysis of cloud costs, consider dropping the cloud. Which would mean that you loose part of the reason to use the cloud in the first place... A lot of org move to cloud based hosting because it enable them to go way further in FinOps / cost control (amongst many other thing). This can make a lot of sense depending on your infra, if you have some fl…

> A lot of org move to cloud based hosting because it enable them to go way further in FinOps / cost control I think a lot of orgs move to cloud simply because it's popular and gartner told them so. But taking a step away from that, it's really about self-service. When the alternative is logging a ticket for someone to manually misconfigure a VM and then fail to send you the login credentials, then your delivery is s…

There's also now regulatory capture. Your bare-metal or VPS solution won't be "FEDRAMP" approved, even though there are fewer moving parts to secure.

Re: Slashing data transfer costs in AWS

#82

Post by mlhpdx »

I’ve been deploying 3xAZs in 3xRegions for a while now (years). The backing store being regional s3 buckets (keeping data in the local compliance region) and DDB with replication (opaque indexing and global data) and Lambda or Sfn for compute. So far data transfer hasn’t risen to the level of even tertiary concern (at scale). Perhaps because I don’t have video, docker or “AI” in play?

Re: Slashing data transfer costs in AWS

#83

Post by sofixa »

marcus0x62 wrote: post #68
steveBK123 wrote: post #62

Earlier quoted context omitted.

If your on-prem team can't spin up a VM same day, then firing them is probably higher ROI than "going to cloud". Further, a lot of the shops "going to cloud" because their infra team is slow.. then hide cloud behind their infra team. A prior 200+ dev shop went from automated on-prem VM builds happening within hours from when you raise a ticket, to cloud where there was a slack channel to nag&beg for an EC2 which coul…

I've never seen an IT team that couldn't spin up a VM in minutes. I have seen a bunch of teams that weren't allowed to because of ludicrous "change control" practices. Fire the managers that create this state of affairs, not the devops folks, regardless of whether you "go cloud" or not.

I've met multiple customers where time to get a VM was in the weeks to months. (To be fair, I'm at a vendor that proposed IaC tooling and general workflows and practices to move away from old school ClickOps ticket-based provisioning, so of course we'd get those types of orgs).

And more often than not, it had nothing to do with managers, but with individual contributors resisting change because they were set in their ways and were potentially afraid for their jobs. Same applies for firewall changes btw.

Re: Slashing data transfer costs in AWS

#84

Post by cedws »

ishitatsuyuki wrote: post #15

GCP patched a similar loophole [1] in 2023 presumably because some of their customers were abusing it. I'd expect AWS to do the same if this becomes widespread enough. [1]: https://cloud.google.com/storage/pricing-announce#network

I know of a way to get data out of GCP for free, although I haven't tried it in practice. Wonder if I could find a buyer for this info ;)

Re: Slashing data transfer costs in AWS

#85

Post by Radim »

photonthug wrote: post #65
ownagefool wrote: post #25

Earlier quoted context omitted.

> A lot of org move to cloud based hosting because it enable them to go way further in FinOps / cost control I think a lot of orgs move to cloud simply because it's popular and gartner told them so. But taking a step away from that, it's really about self-service. When the alternative is logging a ticket for someone to manually misconfigure a VM and then fail to send you the login credentials, then your delivery is s…

> I think a lot of orgs move to cloud simply because it's popular This can be rational and not just following the leader. In particular.. many devs might think that working with an org that does On-prem is bad for their career, and they might be right. So from an org POV you can't hire good engineers if you're perceived as a dinosaur. This actually might be enough to send you towards the cloud even if the price by it…

I've experienced the opposite too: orgs looking at down on cloud-only devs.

The idea being that devs who lean on cloud excessively do that to masks their lack of fundamentals, which will cause costly fuck ups no matter what technology they use, cloud or on-prem.

Maybe directionally similar idea to hiring ex-Googlers? Some orgs also don't like those. Specific mindset, specific toolbox.

Re: Slashing data transfer costs in AWS

#86

Post by Ringz »

calvinmorrison wrote: post #13
maeln wrote: post #10

Earlier quoted context omitted.

> Seriously, if you’re at the point that you’re doing sophisticated analysis of cloud costs, consider dropping the cloud. Which would mean that you loose part of the reason to use the cloud in the first place... A lot of org move to cloud based hosting because it enable them to go way further in FinOps / cost control (amongst many other thing). This can make a lot of sense depending on your infra, if you have some fl…

The cloud is better and worse than bare metal. It depends on the use case. AWS is Kafkaesque though

I have had the same experience. And all this, even though Amazon has granted us really generous and free annual plans and professional advice (all inclusive for a non-profit GmbH).

Re: Slashing data transfer costs in AWS

#87

Post by mx_03 »

ownagefool wrote: post #25
maeln wrote: post #10

Earlier quoted context omitted.

> Seriously, if you’re at the point that you’re doing sophisticated analysis of cloud costs, consider dropping the cloud. Which would mean that you loose part of the reason to use the cloud in the first place... A lot of org move to cloud based hosting because it enable them to go way further in FinOps / cost control (amongst many other thing). This can make a lot of sense depending on your infra, if you have some fl…

> A lot of org move to cloud based hosting because it enable them to go way further in FinOps / cost control I think a lot of orgs move to cloud simply because it's popular and gartner told them so. But taking a step away from that, it's really about self-service. When the alternative is logging a ticket for someone to manually misconfigure a VM and then fail to send you the login credentials, then your delivery is s…

I have worked in places where adding a new server is a bureocratic nightmare at best.

Granted I dont think thats the norm, but also host your webserver yourself is not as user friendly as AWS.

People always forget that.

Re: Slashing data transfer costs in AWS

#88

Post by Cthulhu_ »

ishitatsuyuki wrote: post #15

GCP patched a similar loophole [1] in 2023 presumably because some of their customers were abusing it. I'd expect AWS to do the same if this becomes widespread enough. [1]: https://cloud.google.com/storage/pricing-announce#network

This doesn't feel like a loophole though, it feels like they have optimized S3 and intend your EC2 instances to use S3 as storage. But maybe not as transfer window, that is, they expect you to put and leave your data on there.

Re: Slashing data transfer costs in AWS

#89

Post by mciancia »

cdchn wrote: post #5
andrewstuart wrote: post #3

An alternative to sophisticated cloud cost minimization systems is…….. don’t use the cloud. Host it yourself. Or use Cloudflare which has 0 cents per gigabyte egress fees. Or just rent cloud servers from one of the many much cheaper VPS hosting services and don’t use all the expensive and complex cloud services all designed to lock you in and drain cash from your at 9 or 12 or 17 cents per gigabyte. Seriously, if you…

Which VPS services don't charge you at all for bandwidth?

https://www.scaleway.com/en/

Re: Slashing data transfer costs in AWS

#90

Post by develatio »

andruby wrote: post #55
develatio wrote: post #26

I'll share my trick :) Lightsail instances can be used to "proxy" data from other AWS resources (eg EC2 instances or S3 buckets). Each Lightsail instance has a certain amount of data transfer included in it's price ($3.5 instance has 1TB, $5 instance has 2TB, $10 instance has 3TB, $20 instance has 4TB, $40 instance has 5TB). The best value (dollar per transferred data) is the $10 instance, which gives you 3TB of traf…

Nice! Nitpick: $5 for 2TB is better than $10 for 3TB.

Ooohhh!! It is, indeed!
Post reply on HN