Google Acquires Elastifile

#1

Post by bjoko » Tue, Jul 09, 2019, 9:35 PM UTC

Google Acquires Elastifile
cloud.google.com

Re: Google Acquires Elastifile

#2

Post by geerlingguy » Tue, Jul 09, 2019, 10:20 PM UTC

I guess this will be the Google Cloud equivalent of Amazon’s EFS?

Re: Google Acquires Elastifile

#3

Post by nodesocket » Tue, Jul 09, 2019, 10:29 PM UTC

A disk that can be attached to multiple VM's and support simultaneous reads/writes is a huge addition to GCP.

Re: Google Acquires Elastifile

#4

Post by zachberger » Tue, Jul 09, 2019, 10:30 PM UTC

nodesocket wrote: post #3

A disk that can be attached to multiple VM's and support simultaneous reads/writes is a huge addition to GCP.

Google Cloud Filestore has existed for some time: https://cloud.google.com/filestore/

Re: Google Acquires Elastifile

#5

Post by christi_meyer » Tue, Jul 09, 2019, 10:43 PM UTC

Elastic is next

Re: Google Acquires Elastifile

#6

Post by ppod » Tue, Jul 09, 2019, 10:55 PM UTC

https://www.youtube.com/watch?v=H27rfr59RiE

Re: Google Acquires Elastifile

#7

Post by p_l » Tue, Jul 09, 2019, 10:59 PM UTC

geerlingguy wrote: post #2

I guess this will be the Google Cloud equivalent of Amazon’s EFS?

There's already GCP Filestore.

Re: Google Acquires Elastifile

#8

Post by sciurus » Tue, Jul 09, 2019, 11:51 PM UTC

p_l wrote: post #7

geerlingguy wrote: post #2

I guess this will be the Google Cloud equivalent of Amazon’s EFS?

There's already GCP Filestore.

Filestore is basically a single google-managed instance running NFS. It's much less sophisticated and resilient than EFS, but also can be much faster since it doesn't have the overhead of a distributed system. Don't try running something that touches lots of files like mercurial on EFS, trust me...

The article says Elastifile (which I know nothing about) will become part of filestore.

Re: Google Acquires Elastifile

#9

Post by choppaface » Tue, Jul 09, 2019, 11:54 PM UTC

It will be interesting to see how well this scales. I have seen AWS EFS fall over under heavy read load (lots of reads for the same TB-scale data). A lot of poor souls using Horovod with no data team use EFS to “distribute” data in data-parallel SGD.

Re: Google Acquires Elastifile

#10

Post by khc » Wed, Jul 10, 2019, 12:05 AM UTC

choppaface wrote: post #9

It will be interesting to see how well this scales. I have seen AWS EFS fall over under heavy read load (lots of reads for the same TB-scale data). A lot of poor souls using Horovod with no data team use EFS to “distribute” data in data-parallel SGD.

Do you have more details about this?