I just hope the performance is visibly better than of gluster. Especially for small files.
Torus: A distributed storage system by CoreOS
11–20 of 187 posts
Re: Torus: A distributed storage system by CoreOS
#12I just hope the performance is visibly better than of gluster. Especially for small files.
are there any performance metrics for Tarus yet?
Re: Torus: A distributed storage system by CoreOS
#13I don't understand why this is being used over say librados + librbd from Ceph. This seems like an awful lot of work to get the same functionality that Gluster/Ceph already have. Is there something I'm missing here?
A few major things we wanted to accomplish: Backed by etcd. Today etcd is a well tested and widely used consistent store with users like Kubernetes, Flannel (now Canal), Fleet, SkyDNS and many others. Building something like etcd requires tons of testing and etcd is becoming the solid go to for this category of distributed problems. Easy to work on code base. Building an OSS community around a complex technology is r…
> Backed by etcd. Today etcd is a well tested and widely used consistent store with users like Kubernetes, Flannel (now Canal), Fleet, SkyDNS and many others. Building something like etcd requires tons of testing and etcd is becoming the solid go to for this category of distributed problems.
Being built atop something else doesn't mean it inherits all the stability of the underlying system; it's an upper bound not a lower bound.
Re: Torus: A distributed storage system by CoreOS
#14So is this the building blocks for an in-house EBS?
Re: Torus: A distributed storage system by CoreOS
#15I don't understand why this is being used over say librados + librbd from Ceph. This seems like an awful lot of work to get the same functionality that Gluster/Ceph already have. Is there something I'm missing here?
A few major things we wanted to accomplish: Backed by etcd. Today etcd is a well tested and widely used consistent store with users like Kubernetes, Flannel (now Canal), Fleet, SkyDNS and many others. Building something like etcd requires tons of testing and etcd is becoming the solid go to for this category of distributed problems. Easy to work on code base. Building an OSS community around a complex technology is r…
It sounds like etcd is in the I/O path. Is that correct?
Re: Torus: A distributed storage system by CoreOS
#16Earlier quoted context omitted.
A few major things we wanted to accomplish: Backed by etcd. Today etcd is a well tested and widely used consistent store with users like Kubernetes, Flannel (now Canal), Fleet, SkyDNS and many others. Building something like etcd requires tons of testing and etcd is becoming the solid go to for this category of distributed problems. Easy to work on code base. Building an OSS community around a complex technology is r…
It sounds like etcd is in the I/O path. Is that correct?
It's in the sync() path, but not in the I/O path.
Re: Torus: A distributed storage system by CoreOS
#17Is the goal to provide POSIX file access as NFS and AFS do? The mention of object storage as a future direction feels like the early "the sky's the limit" euphoria of a new project that has yet to adopt specific end goals.
Re: Torus: A distributed storage system by CoreOS
#18I don't understand why this is being used over say librados + librbd from Ceph. This seems like an awful lot of work to get the same functionality that Gluster/Ceph already have. Is there something I'm missing here?
I kind of see this as a general trend where CoreOS is concerned they reimplement everything in house, even when open source solution might already exist - rkt, etcd, now this.
See also: Piston Cloud.
Re: Torus: A distributed storage system by CoreOS
#19Earlier quoted context omitted.
I kind of see this as a general trend where CoreOS is concerned they reimplement everything in house, even when open source solution might already exist - rkt, etcd, now this.
Competition is good, even in open-source land. By the way, I'm still hoping for an open-source competitor for elasticsearch.
> I'm still hoping for an open-source competitor for elasticsearch
I thought Elasticsearch was open-sourced, and the GitHub repo says Apache v2. What am I missing here?
Re: Torus: A distributed storage system by CoreOS
#20Is the goal to provide POSIX file access as NFS and AFS do? The mention of object storage as a future direction feels like the early "the sky's the limit" euphoria of a new project that has yet to adopt specific end goals.
More than "sky's the limit" -- early versions had POSIX access, though it was terribly messy. We know the architecture can support it, it's just a matter of learning from the mistakes and building something worth supporting.