Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing Google Cloud Storage Nearline

googlecloudplatform.blogspot.com

Post reply on HN
Print view View original

161–170 of 188 posts

Re: Introducing Google Cloud Storage Nearline

#161

Post by smtddr »

moe wrote: post #138
rsync wrote: post #133

Earlier quoted context omitted.

arq (which we love) + rsync.net = success. We have a "HN readers" discount which is fairly substantial.

= success rsync.net is 20x more expensive than Google Nearline ($0.20/GB). Why would anyone choose to use it for Arq when Arq supports both?

While I personally don't mind Google having all my backup data, we must appreciate the fact that in this post-Snowden world some people will justifiably refuse to go with the big USA-corp players like Amazon or Google.

rsync.net just saying: "Hey, we're not Google or Amazon" is already a big selling point for some.

Re: Introducing Google Cloud Storage Nearline

#162

Post by ghshephard »

res0nat0r wrote: post #142
ghshephard wrote: post #115

Earlier quoted context omitted.

Do you have any information to suggest that the Google Nearline service can handle 10PB?

It's safe to assume this is going to be just like Glacier and S3/Google Storage, ie: unlimited. Also retrieval speeds increase with your data set size: Note: You should expect 4 MB/s of throughput per TB of data stored as Nearline Storage. This throughput scales linearly with increased storage consumption. For example, storing 3 TB of data would guarantee 12 MB/s of throughput, while storing 100 TB of data would prov…

I was just interested as to what these storage systems are capable of supporting. While I'm confident they could all store 10 TB of Data (That's just barely Tier-2 of 6 for Amazon), I'm wondering if they have the back end capability to store 10 PB of data.

Re: Introducing Google Cloud Storage Nearline

#163

Post by StavrosK »

rsync wrote: post #134
StavrosK wrote: post #117

Earlier quoted context omitted.

This is exactly what I want for Linux (headless), but I haven't been able to find anything like it. The closest thing I've found is attic, which, while amazing, requires a daemon to be running on the remote end (which is what makes checking, deduplication and deltas fast). Does anyone know an Arq alternative for linux?

duplicity ... https://en.wikipedia.org/wiki/Duplicity_(software)

Unfortunately duplicity is very inefficient, it needs to reupload the full set every so often, which takes up a lot of bandwidth. I guess attic is my best bet in the foreseeable future.

Re: Introducing Google Cloud Storage Nearline

#164

Post by wstrange »

vidarh wrote: post #112
vgt wrote: post #78

Earlier quoted context omitted.

Google Cloud Storage is cheaper than Amazon S3: http://aws.amazon.com/s3/pricing/ https://cloud.google.com/storage/pricing

Google Cloud Storage is also massively overpriced.

Compared to what? Honest question - not trying to be cheeky.

If you are comparing against a self managed solution, are you factoring all costs into that equation (fully burdened labour costs, disposal, cooling, power, etc.).

Re: Introducing Google Cloud Storage Nearline

#165

Post by insaneirish »

StavrosK wrote: post #163
rsync wrote: post #134

Earlier quoted context omitted.

duplicity ... https://en.wikipedia.org/wiki/Duplicity_(software)

Unfortunately duplicity is very inefficient, it needs to reupload the full set every so often, which takes up a lot of bandwidth. I guess attic is my best bet in the foreseeable future.

Haven't used it, but Duplicati is another one: http://www.duplicati.com/

Re: Introducing Google Cloud Storage Nearline

#166

Post by StavrosK »

insaneirish wrote: post #165
StavrosK wrote: post #163

Earlier quoted context omitted.

Unfortunately duplicity is very inefficient, it needs to reupload the full set every so often, which takes up a lot of bandwidth. I guess attic is my best bet in the foreseeable future.

Haven't used it, but Duplicati is another one: http://www.duplicati.com/

Looks very interesting, thanks! I'm investigating it now.

Re: Introducing Google Cloud Storage Nearline

#169

Post by gaul »

dlisboa wrote: post #53
gaul wrote: post #32

I added GCS nearline to my object storage comparison: http://gaul.org/object-store-comparison/

Just a correction: the city name is Sao Paulo with a 'u'. It has the tilde at São but if you don't want to you can omit it. The thing is that Paolo with an 'o' isn't a Portuguese name (it's Italian). In English it's written like in Portuguese. I see it sometimes so I just got in the habit of reminding people, wasn't calling you out, just trying to prevent future mistakes like that.

Corrected; thanks! Note that GitHub hosts this project for any further issues or corrections:

https://github.com/andrewgaul/object-store-comparison

Re: Introducing Google Cloud Storage Nearline

#170

Post by gaul »

klo544 wrote: post #63
gaul wrote: post #32

I added GCS nearline to my object storage comparison: http://gaul.org/object-store-comparison/

Actually there are not 7 regions for Google Cloud Storage but 3: US, EU, ASIA. You can get more specfic but that's still Alpha: ASIA-EAST1, US-CENTRAL1, US-CENTRAL2, US-EAST1, US-EAST2, US-EAST3, US-WEST1. Note that there are separate zones for Google Compute Engine: https://cloud.google.com/compute/docs/zones#available

Corrected; thanks! Note that GitHub hosts this project for any further issues or corrections:

https://github.com/andrewgaul/object-store-comparison

Post reply on HN