Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cloud Storage for $2 per TB per month

blog.sia.tech

Post reply on HN
Print view View original

281–290 of 353 posts

Re: Cloud Storage for $2 per TB per month

#281

Post by manigandham »

Dylan16807 wrote: post #268
manigandham wrote: post #267

Earlier quoted context omitted.

S3 Reduced Redundancy is replaced with S3 Infrequent Access (and another lower tier One-Zone Infrequent Access) so there's still some pricing flexibility available.

Infrequent Access is closer. But wow, one-zone sure is only 20% cheaper than three-zone. And the retrieval cost is significantly more expensive than glacier's bulk price. Actually, looking closer, is one-zone even storing fewer copies? It's offering the same durability, except in the case of "availability zone destruction". So if they're selling three copies for $10 a TB, then the equivalent price for 64-of-96 would…

S3 Standard and S3 IA store multiple copies spread across 3 zones. S3 One-Zone IA is stored as multiple copies but all within a single zone. They give you the same technical durability but less availability if that zone goes down, and if it's destroyed then you lose all your data.

Re: Cloud Storage for $2 per TB per month

#282

Post by toolslive »

statictype wrote: post #203
sydney6 wrote: post #64

Earlier quoted context omitted.

Storage Systems of this scale are thesedays almost exclusively built around object based storage rather than "legacy" block or file backed solutions. I guess today, min.io is would be the way to go. (to "go".. little pun on the end:)

What does object-based mean? How is an object different from a file (which I presumed was a collection of blocks)?

it's like a key-value store, (or a dictionary). However, the values are objects (big blobs of data). This means you can't update parts of objects without rewriting the blob. However, most of the object stores offer metadata operations (move, tag, ...), concat of n objects into 1 and partial reads.

Re: Cloud Storage for $2 per TB per month

#283

Post by toolslive »

tw04 wrote: post #257
statictype wrote: post #203

Earlier quoted context omitted.

What does object-based mean? How is an object different from a file (which I presumed was a collection of blocks)?

It means you access your object through a GUID. Think about it like parking your own car vs. a valet. When you park your own car you need to know the address of the garage you parked in, the floor you were on, and the spot you were in. When you valet park, you hand the attendant a ticket and he brings your car back. With a standard fileshare, you need to walk the filesystem to retrieve your file - this incurs a ton o…

Some object stores do this, but aws S3 for example does not. You can list the contents of buckets, nicely sorted by name. You can mimic directory structures if you want.

However, you touched a key point: object stores are all about throughput, not latency. You can store at a GB/s (if you have the pipes), but even checking if an object exists will cost you a few milliseconds.

Re: Cloud Storage for $2 per TB per month

#284

Post by Mave83 »

ghostpepper wrote: post #52
vikiomega9 wrote: post #41

Earlier quoted context omitted.

> exabyte-scale storage system Somewhat of a random question, can you point me to some state of the art research?

I am not the op nor an expert on this, but I think https://ceph.io/ targets clusters of this scale.

Yes, with croit.io you can manage Ceph clusters with ease, reducing Laber costs and increase reliability.

We build clusters of low PB scale that have a TCO with everything from labor to hardware, from financing to electric, from routers to cables and can be run below 3€/TB. For that you can store data in Block(rbd, iscsi), Objekt(S3, swift) or Filestorage(CephFS, NFS, SMB), high available on Supermicro hardware in any datacenter worldwide.

Feel free to contact us or use our free community edition to start your own cluster.

Re: Cloud Storage for $2 per TB per month

#285

Post by Mave83 »

Aunche wrote: post #144

In addition to what other people mentioned, there is also a huge cost in managing all the metadata that you'd get from billions of files. This really even worse if you're using a crazy 64-32 encoding.

Yes, but with croit.io you can manage Ceph clusters with ease, reducing Laber costs and increase reliability.

We build clusters of low PB scale that have a TCO with everything from labor to hardware, from financing to electric, from routers to cables and can be run below 3€/TB. For that you can store data in Block(rbd, iscsi), Objekt(S3, swift) or Filestorage(CephFS, NFS, SMB), high available on Supermicro hardware in any datacenter worldwide.

Feel free to contact us or use our free community edition to start your own cluster.

Re: Cloud Storage for $2 per TB per month

#286

Post by tracker1 »

zaroth wrote: post #198
tracker1 wrote: post #109

Earlier quoted context omitted.

it's probably a SAS/Sata controller, and the sas interface split to 4x sata.

They do link to the motherboard they are talking about, and it doesn't have SAS.

They mention 8 pcie slots with 48 pcie lanes... I'm presuming they are filling them with sas/sata controllers.

Re: Cloud Storage for $2 per TB per month

#287

Post by londons_explore »

This tech seems very cool, but with only 200TB stored I worry that it is destined to not pay for its overheads. No big project can survive on a revenue of $20/month!

When will the project grow some mobile apps like Dropbox or Google drive that you can just put a credit card number into, pay a few bucks and know your data is safe?

Re: Cloud Storage for $2 per TB per month

#288

Post by franciscop »

The website seemed okay and even useful until:

"Both renters and hosts use Siacoin, a unique cryptocurrency built on the Sia blockchain. Renters use Siacoin to buy storage capacity from hosts, while hosts deposit Siacoin into each file contract as collateral."

Re: Cloud Storage for $2 per TB per month

#290

Post by dannyw »

jjeaff wrote: post #264
late2part wrote: post #174

Earlier quoted context omitted.

you are wrong that AWS pays more than small vendors.

That's not what they said. They pay more than small vendors, sometimes. If you are able to take advantage of sales and clearance deals here and there, you are very likely to get a lower price than even the biggest buyers.

1 month of sales hunting has got me a PC rig for literally 2/3rd of the cost of buying without waiting. And this was an optimised build in the first place.
Post reply on HN