Live data from Hacker News

AWS in 2025: Stuff you think you know that's now wrong

lastweekinaws.com

211–220 of 284 posts

Re: AWS in 2025: Stuff you think you know that's now wrong

#211

Earlier quoted context omitted.

Aren't LTO formats only backward compatible with the immediate prior version?

They can write to one version back and read two version back. for really long term data storage you have to also store the read/write hardware.

By the time it's hard to get a compatible LTO drive, I'd be very suspicious of a mothballed drive working either. If you want reliable long term storage you're going to have to update it every couple decades.

Re: AWS in 2025: Stuff you think you know that's now wrong

#212
post #153

Earlier quoted context omitted.

This is exactly what I use LLMs for. To just read the docs for me and pull out the base level demo code that's buried in all the AWS documentation. Once I have that I can also ask it for the custom tweaks I need.

This could not possibly go wrong... You're braver than me if you're willing to trust the LLM here - fine if you're ready to properly review all the relevant docs once you have code in hand, but there are some very expensive risks otherwise.

There’s nothing brave in this. It generally works the way it should and even if it doesn’t - you just go back to see what went wrong.

I take code from stack overflow all the time and there’s like a 90% chance it can work. What’s the difference here?

Re: AWS in 2025: Stuff you think you know that's now wrong

#213
post #189

Earlier quoted context omitted.

> I can't talk about it, but I've yet to see an accurate guess at how Glacier was originally designed. It feels odd that this is some sort of secret. Why can't you talk about it?

I signed NDAs. I wish Glacier was more open about their history, because it's honestly interesting, and they have a number of notable innovations in how they approach things.

Well assuming your NDA is a reasonable length I hope you talk about it later.

(And if Amazon is making unreasonable length NDAs I hope they lose a lot of money over it.)

Re: AWS in 2025: Stuff you think you know that's now wrong

#214
post #108

> Glacier restores are also no longer painfully slow. I had a theory (based on no evidence I'm aware of except knowing how Amazon operates) that the original Glacier service operated out of an Amazon fulfillment center somewhere. When you put it a request for your data, a picker would go to a shelf, pick up some removable media, take it back, and slot it into a drive in a rack. This, BTW, is how tape backups on times…

I can't talk about it, but I've yet to see an accurate guess at how Glacier was originally designed. I think I'm in safe territory to say Glacier operated out of the same data centers as every other AWS service. It's been a long time, and features launched since I left make clear some changes have happened, but I'll still tread a little carefully (though no one probably cares there anymore): One of the most crucial t…

Im like 90% sure ive seen folks (unofficially) disclose the original storage and API decisions over the years, in roughly accurate terms. Personally I think the multi dimensional striping/erasure code ideas are way more interesting than the “its just a tape library” speculation/arguments. That and the real lessons learned around product differentiation as supporting technologies converge.

Re: AWS in 2025: Stuff you think you know that's now wrong

#215
post #110

Earlier quoted context omitted.

My objections here are in terms of how this manifests in billing. Especially when you consider the highway robbery rates for internet egress.

Again, you are dealing with low-level primitives. You can provision an EC2 VM with multiple GPUs at high cost and use it to host nginx. That is not a correct configuration. There are much cheaper ways available to you. It's ridiculous to imply that AWS shouldn't send you a higher bill because you didn't use the GPUs or that AWS shouldn't offer instances with GPUs because they are more expensive. You, the user, are re…

It being low level is not an excuse for systems that lead people down the wrong path.

And the traffic never even reaches the public internet. There's a mismatch between what the billing is supposedly for and what it's actually applied to.

> do you expect AWS to show you different meters for billed and not-billed traffic, but performance still depends on the sum total of the traffic (S3 and Internet egress) passing through it?

Yes.

> How is that not confusing?

That's how network ports work. They only go so fast, and you can be charged based on destination. I don't see the issue.

> It's also besides the point that not all NAT gateways are used for Internet egress

Okay, if two NAT gateways talk to each other it also should not have egress fees.

> some kind of implicit built-in S3 gateway violates assumptions

So don't do that. Checking if the traffic will leave the datacenter doesn't need such a thing.

Re: AWS in 2025: Stuff you think you know that's now wrong

#216

Earlier quoted context omitted.

I recommend S3 Gateways for all VPCs that need to access S3, even those that already have routes to the Internet. Plus they eliminate the need for NAT Gateway traversal for requests that originate from private subnets.

> I recommend S3 Gateways for all VPCs that need to access S3, even those that already have routes to the Internet. Fascinating. What's the advantage of doing that?

It's a much more direct/efficient connection from the EC2 instance to the S3 storage servers through the virtual network layer. It reduces the network path/length through the AWS network _and_ removes the number of virtual network functions/servers (ala "LB") that your connections will traverse.

Re: AWS in 2025: Stuff you think you know that's now wrong

#217

Earlier quoted context omitted.

Gateway endpoints are free. Network endpoints (which are basically AWS-managed ENIs that can tunnel through VPC boundaries) are not free. S3 can use either, and we recommend establishing VPC Gateway endpoints by default whenever you need S3 access. (Disclaimer: I work for AWS, opinions are my own.)

Why don't you have gateway endpoints for all your APIs?

The original private endpoints implementation required meaningful work from the service teams (ec2 networking, s3, & ddb). It also changed how the "front end" API servers handled requests and how their infrastructure was deployed (at the time?). The newer LB/ENI style privatelink abstracts away _most_ of that "per service" implementation effort at the cost of more per-request/connection work fromthe virtual network. Hence why theres more support from other services, and it includes a cost.

Re: AWS in 2025: Stuff you think you know that's now wrong

#218

Earlier quoted context omitted.

If you're aware of changes, then explain that there were changes over time, that's it

You say this, someone challenges you, now you're on the defensive during an interview and everyone has a bad taste in their mouth. Yeah, that's how it goes.

That's just the taste of iron from the blood after the duel. But this is completely normal after a formal challenge! Companies want real cyberwarriors, and the old (lame) rockstar ninjas that they hired 10 years ago are very prone to issuing these.

Re: AWS in 2025: Stuff you think you know that's now wrong

#219

Earlier quoted context omitted.

This could not possibly go wrong... You're braver than me if you're willing to trust the LLM here - fine if you're ready to properly review all the relevant docs once you have code in hand, but there are some very expensive risks otherwise.

There’s nothing brave in this. It generally works the way it should and even if it doesn’t - you just go back to see what went wrong. I take code from stack overflow all the time and there’s like a 90% chance it can work. What’s the difference here?

Well, the "accidentally making the S3 bucket public" scenario would be a good one. If you review carefully with full understanding of what e.g. all your policies are doing then great, no problem.

If you don't do that will you necessarily notice that you accidentally leaked customer data to the world?

The problem isn't the LLM it's assuming its output is correct just the same as assuming Stack Overflow answers are correct without verifying/understanding them.

Re: AWS in 2025: Stuff you think you know that's now wrong

#220

Earlier quoted context omitted.

It's designed to be a declarative DSL, but then you have to do all sorts of filters and maps in any group of resources and suddenly you are programming in yaml with both hands tied behind your back

Yeah it’s just terrible. If Amazon knew what was good they’d just replace it with almost anything else. Heck just got all in on terraform and call it a day.

They do contribute to the AWS provider for Terraform.

Also that have CDK which is a framework for writing IaC in Java/TypeScript, Go, Python, etc.

Post reply on HN