An rsync.net account is the swiss army knife of cloud storage

#1

Post by rsync » Tue, Jan 26, 2021, 7:33 PM UTC

An rsync.net account is the swiss army knife of cloud storage
twitter.com

Re: An rsync.net account is the swiss army knife of cloud storage

#2

Post by rsync » Tue, Jan 26, 2021, 7:35 PM UTC

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform.

So, in the same way that you can run 'git' commands over SSH:

  ssh user@rsync.net "git clone git://github.com/freebsd/freebsd.git freebsd"

... you can now, also, run 'rclone' over SSH:

  ssh user@rsync.net rclone s3:/some/bucket gdrive:/blah

[1] https://rclone.org/

Re: An rsync.net account is the swiss army knife of cloud storage

#3

Post by gregsadetsky » Tue, Jan 26, 2021, 7:57 PM UTC

rsync wrote: post #2

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform. So, in the same way that you can run 'git' commands over SSH: ssh user@rsync.net "git clone git://github.com/freebsd/freebsd.git freebsd" ... you can now, also, run 'rclone' over SSH: ssh user@rsync.net rclone s3:/some/bucket gdrive:/blah [1] https://rclone.org/

rclone is such an incredible program. Rock stable, compatible with so many services... Thanks a lot for making it part of rsync.net! (I'm a recent customer of yours and am very happy about everything)

Re: An rsync.net account is the swiss army knife of cloud storage

#4

Post by thebankfarter » Tue, Jan 26, 2021, 8:06 PM UTC

rsync wrote: post #2

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform. So, in the same way that you can run 'git' commands over SSH: ssh user@rsync.net "git clone git://github.com/freebsd/freebsd.git freebsd" ... you can now, also, run 'rclone' over SSH: ssh user@rsync.net rclone s3:/some/bucket gdrive:/blah [1] https://rclone.org/

Thanks for letting us know. I'm a client of yours and I'm happy with the service. Aside: Ever consider making some portion of the storage available for sharing. I often take screenshots/share documents with my teams and use a program that can use SFTP. Great work.

Re: An rsync.net account is the swiss army knife of cloud storage

#5

Post by rsync » Tue, Jan 26, 2021, 8:13 PM UTC

thebankfarter wrote: post #4

rsync wrote: post #2

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform. So, in the same way that you can run 'git' commands over SSH: ssh user@rsync.net "git clone git://github.com/freebsd/freebsd.git freebsd" ... you can now, also, run 'rclone' over SSH: ssh user@rsync.net rclone s3:/some/bucket gdrive:/blah [1] https://rclone.org/

Thanks for letting us know. I'm a client of yours and I'm happy with the service. Aside: Ever consider making some portion of the storage available for sharing. I often take screenshots/share documents with my teams and use a program that can use SFTP. Great work.

Well, one bedrock design consideration at rsync.net is that there will never be an HTTP server on our systems - the storage is accessible by SSH only.[1] Surely that limits our product fit and reduces our growth BUT what it does for security and attack surface is priceless.

However, the idea that you might have a fixed subdirectory in your rsync.net account - with a distinct password and login - is interesting and we should think about that.

You're saying that would be useful even though it is accessible only by SFTP ?

Re: An rsync.net account is the swiss army knife of cloud storage

#6

Post by thebankfarter » Tue, Jan 26, 2021, 8:23 PM UTC

rsync wrote: post #5

thebankfarter wrote: post #4

Earlier quoted context omitted.

Thanks for letting us know. I'm a client of yours and I'm happy with the service. Aside: Ever consider making some portion of the storage available for sharing. I often take screenshots/share documents with my teams and use a program that can use SFTP. Great work.

Well, one bedrock design consideration at rsync.net is that there will never be an HTTP server on our systems - the storage is accessible by SSH only.[1] Surely that limits our product fit and reduces our growth BUT what it does for security and attack surface is priceless. However, the idea that you might have a fixed subdirectory in your rsync.net account - with a distinct password and login - is interesting and we…

Here's a dialogue box from the program:

https://dsh.re/14836

Yes your suggestion would work. I'd be happy to connect to a subfolder with my SSH key or secondary SSH key. As it stands, I set up connections to other SSH servers with keys. It would definitely maintain your strict need to maintain security account security.

Reach out to me if you want some more feedback: I'm Rsync.net user 59243

Re: An rsync.net account is the swiss army knife of cloud storage

#7

Post by joeraut » Tue, Jan 26, 2021, 8:25 PM UTC

rsync wrote: post #2

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform. So, in the same way that you can run 'git' commands over SSH: ssh user@rsync.net "git clone git://github.com/freebsd/freebsd.git freebsd" ... you can now, also, run 'rclone' over SSH: ssh user@rsync.net rclone s3:/some/bucket gdrive:/blah [1] https://rclone.org/

Happy rsync.net client here, thanks for the great service; the ability to use rclone for exactly this purpose, without having to worry about ingress/egress charges, is a huge value-add.

Edit: Will free-of-charge ingress/egress always be a feature of the service? With more customers using rclone for shifting data to/from/between other services, I'd hypothesize that bandwidth use could be creeping up.

Edit 2: A feature I'd love to see would be the ability to setup automated cron-like jobs directly from the admin portal, for e.g. automated rclone backups, eliminating the friction of having to setup another service to periodically run a command on rsync.net. (Tricky to do in a serverless fashion for long-running commands like rclone.) Is this something that might be in the pipeline?

Re: An rsync.net account is the swiss army knife of cloud storage

#8

Post by mtmail » Tue, Jan 26, 2021, 8:38 PM UTC

We switched to use the https://www.borgbackup.org/ software, which does deduplication, and rsync.net offers special lower pricing https://rsync.net/products/attic.html Note the "There is NO borg specific technical support or integration engineering. You're here because you're an expert." disclaimer.

Re: An rsync.net account is the swiss army knife of cloud storage

#9

Post by centimeter » Tue, Jan 26, 2021, 8:44 PM UTC

Very happy rsync customer here. Their pricing is kind of weird, but after being a customer for a year or so they gave me a big discount that makes it competitive on cost/GB-month terms with cheaper providers, and of course rsync’s infra and redundancy are rock solid.

Re: An rsync.net account is the swiss army knife of cloud storage

#10

Post by rsync » Tue, Jan 26, 2021, 8:46 PM UTC

mtmail wrote: post #8

We switched to use the https://www.borgbackup.org/ software, which does deduplication, and rsync.net offers special lower pricing https://rsync.net/products/attic.html Note the "There is NO borg specific technical support or integration engineering. You're here because you're an expert." disclaimer.

We're excited about both (borg is also built into our platform). We're tending to steer people to borg for "plain old backup" and saving rclone for the interesting use-cases that involve platform-to-platform data transfer ...