Live data from Hacker News

Amazon Elastic File System

aws.amazon.com

31–40 of 217 posts

Re: Amazon Elastic File System

#31

I wish AWS would be a little more technical in their product descriptions and announcements. If there was ever an audience that wants technical data about how this type of technology will scale and compares to existing technology like glusterfs it would be the AWS users. Instead the performance specifications are ".. and is designed to provide the throughput, IOPS, and low latency needed for a broad range of workload…

We'll be providing a lot more details later.

Re: Amazon Elastic File System

#32

What's the advantage of this over S3?

This is a filesystem. You mount it directly inside your EC2 boxes and work with it as if it's local (or really NFS-mounted). It's going to be a couple of orders of magnitude faster, but not directly web-connected, so you can't use it to serve content directly as if it was a CDN. I can see this being useful for a few cases. For one, I can immediately use it for one of the projects I have where I have multiple worker s…

Okay, thanks for the explanation!

Re: Amazon Elastic File System

#33
post #12

Earlier quoted context omitted.

S3fs filesystems are really slow. We tested around 10mb/s for file upload. Where it really struggles is when you have a lot of files in a folder. Try doing an 'ls' on a folder with hundreds of files to see it break.

S3 also seems to provide only eventual consistency.

I'd be very interested to know what kind of consistency guarantees EFS provides. The history of NFS is plagued by syscalls whose docs have a variation of the phrase "this operation is atomic (except on NFS)".

Re: Amazon Elastic File System

#34

What's the advantage of this over S3?

I think they're meant to solve different problems. On one hand S3 is designed for (among other things) serving files over the web. EFS sounds like it's designed to be used as a filesystem multiple instances can write to (say for a high-availability setup).

Re: Amazon Elastic File System

#35

What's the advantage of this over S3?

One nice thing would be hosting wordpress on multiple EC2 servers. All local copies of your wordpress directory would be kept in sync automatically with no other configuration.

Yeah, I have a WP Multisite cluster that's a real pain to manage for this reason. Probably will be my first use of EFS.

Re: Amazon Elastic File System

#37

I wish AWS would be a little more technical in their product descriptions and announcements. If there was ever an audience that wants technical data about how this type of technology will scale and compares to existing technology like glusterfs it would be the AWS users. Instead the performance specifications are ".. and is designed to provide the throughput, IOPS, and low latency needed for a broad range of workload…

We'll be providing a lot more details later.

Would love some throughput and other performance numbers!

Re: Amazon Elastic File System

#39

Earlier quoted context omitted.

One nice thing would be hosting wordpress on multiple EC2 servers. All local copies of your wordpress directory would be kept in sync automatically with no other configuration.

Yeah, I have a WP Multisite cluster that's a real pain to manage for this reason. Probably will be my first use of EFS.

How do you manage it now? Plugin? S3?

Re: Amazon Elastic File System

#40
Congratulation on launching a killer feature once you addicted to it, very hard to move out from AWS :) (but honestly, this is a very awesome technology we've been dreaming for years)
Post reply on HN