Live data from Hacker News

Clone Dropbox with a Raspberry Pi and BTSync

reustle.io

51–60 of 62 posts

Re: Clone Dropbox with a Raspberry Pi and BTSync

#51
post #26

I'm uncomfortable about the opacity of BTsync's privacy architecture. AFAIK even the protocol isn't documented. The code obviously isn't open source. I wouldn't use it sync anything except Truecrypt volumes. :)

This is the same issue I have with btsync, so about a month ago I started working on an open-source clone, with similar features but an open, documented protocol. https://github.com/jewel/clearskies

I'm looking forward to clearskies and will gladly switch over to it once it's ready!

Re: Clone Dropbox with a Raspberry Pi and BTSync

#52
post #25
post #12

Earlier quoted context omitted.

Everyone who's looking to run their own private Dropbox should check out ownCloud[1]. It's free, open source, you install it on your own server (or Raspberry Pi), and it's not P2P like BTsync is. It works more like Dropbox, with a centralized server. You just run that server yourself. They have apps for Windows, Mac, Linux, iOS and Android. I've been using it for about two months now with no problems. [1] http://ownc…

OwnCloud is quite nice, but its Dropbox-like feature isn't his best asset. We have big shared folders and the client app does weird stuff sometimes (and given the way things are architected, I'm not confident it will change). On the other hand, it gives you a nice web-based file browser, CardDav, CalDav, and a RSS webapp. And there's a basic iPhone app. The approach posted somewhere else in the comments[0] seems inte…

I used ownCloud for both the CardDav/CalDav/etc. and the dropbox-like stuff for a couple of months now. Sadly as you say the dropbox functionality doesn't work well. It takes up to several days until every file is synchronized everywhere and I want to synchronize almost my whole /home directory between my ThinkPad and my iMac.

A couple of days ago I installed btsync and tested syncing one 130 MB big directory. I added it both at the same time to btsync and ownCloud. After about 2 minutes btsync had its copy on the other computer. After one hour ownCloud had cpied about 50 MB to the server when I canceled it and removed the ownCloud dropbox-client from my computers.

I still use all the other stuff to synchronize my calendar/address book between my computers and mobile devises and I even use their RSS backend but with my own Firefox OS app https://marketplace.firefox.com/app/feedmonkey/

Re: Clone Dropbox with a Raspberry Pi and BTSync

#53
post #37

I'm uncomfortable about the opacity of BTsync's privacy architecture. AFAIK even the protocol isn't documented. The code obviously isn't open source. I wouldn't use it sync anything except Truecrypt volumes. :)

Or encfs, a per file encrypted filesystem.

I'm using BTSync with EncFS, but if you don't trust the BTSync binary – it's probably got access to the non-encrypted data as well unless you've jumped through a few more hoops than a "typical BTSync installation". I'd guess 99.9% of BTSync users have the binary installed with at least enough permissions to read anything the logged in user can read (which includes the cleartext-mounted stuff in your EncFS or TrueCrypt volumes).

Re: Clone Dropbox with a Raspberry Pi and BTSync

#54
post #15

I installed and played with BTSync yesterday. It was really easy to get it all up and running syncing between two local machines and a remote server. The config was really simple compared to other stuff I've used. Sometimes it could take a while before the syncing would start which is a bit of a pain. We run a system where we have a lot of data on a server that we want to see locally. Edits are made both locally and…

Does AeroFS support 32bit OSen yet? That was a showstopper for me back when it first became available - it _required_ 64 bit Java…

Re: Clone Dropbox with a Raspberry Pi and BTSync

#55
post #39
post #2

It doesn't need to be a USB 3.0 drive. The RPi is USB 2.0 only.

plus, the RPi can't even achieve full USB 2.0 speed, it is not a good choice for a file server.

FWIW, in this use-case the limit is the wifi or more likey your internet connection speed. You don't really need blazing disk read/write speeds for your "Dropbox clone" - if you can read and write data as fast as your adsl connection goes - anything more is "wasted". As a general purpose file server though - yeah, a 'Pi isn't going to stream multiple HD videos to all 4 bedrooms on your home network.

Re: Clone Dropbox with a Raspberry Pi and BTSync

#56
post #50
post #49

Earlier quoted context omitted.

We have had the same experience. I loved the idea of BTsync, but we encountered too many issues. We tested sparkleshare and lipsync too. Unfortunately, none of them dealt with conflicts and merges as they were meant to. BTsync would often not pick up changes (using osx and linux clients), and/or overwrite new files with an older version. It also had a slow latency when a file did change. As to the open source nature…

That's starting to sound like a pattern on BTSync now. What do you mean by non-cloud syncing? Have you tried Aero? I thought about doing a inotify/unison solution - apparently unison is good at dealing with conflicts and the like. With all these syncing tools it's the uncertainty that causes issues. You're always worried about what data is going to end up where in the edge cases. As you say - at least with a few scri…

Non-cloud = my clumsy way of saying operating on private servers with no 3rd party storage (and ideally no connection) necessary.

Looked into Aero, but I am pushing towards an open source alternative to be used, or at least where the implementation is fully controlled/configured by us.

I agree, unison is great and I think is the way forward towards a private dropbox solution.

Re: Clone Dropbox with a Raspberry Pi and BTSync

#57
post #35

My friend ran BTSync on a raspi, and it was dreadfully slow to index for large amounts of data. Like, multiple days of 100% CPU slow.

Also, with encrypted volumes, just reading files on the raspi is very slow. Consider replacing raspi with odroid, utilite, or other fast, fanless, cheap arm sbc.

If the 'Pi is just a "cloud storage appliance", there's no need for it to care that the data is encrypted.

I use EncFS to encrypt on my laptops/desktops/servers/phones/tablets, and have BTSync sync the encrypted partitions to a machine at home that doesn't have EncFS installed. I'm using an old Mac Mini rather than a 'Pi, but the same principle works - the Mac Mini serves my archive/backup needs for my synced data (it's using software raid1 over two drives for reliability, and does TimeMachine backups to a rotating set of external drives for archiving), but none of the data on the Mini or it's drives is of any use if hacked/stolen, since if doesn't have EncFS or the crypto keys.

Re: Clone Dropbox with a Raspberry Pi and BTSync

#58

I have done something similar, but used a Raspberry Pi and Seafile ( http://seafile.com ) instead of BTSync. I did not get the chance to test it with large media files, but works great for documents and photos. Also has mobile and cross platform clients. And the best part is it's open-source: https://github.com/haiwen/seafile

Could you share your experiences, for example how many files do you have on the server? I have read[0] that Seafile struggles with larger amounts of files and I was hoping to use it as a drop-in NAS replacement for businesses.

[0] http://blog.patshead.com/2013/06/self-hosted-cloud-storage-c...

Re: Clone Dropbox with a Raspberry Pi and BTSync

#59

I have done something similar, but used a Raspberry Pi and Seafile ( http://seafile.com ) instead of BTSync. I did not get the chance to test it with large media files, but works great for documents and photos. Also has mobile and cross platform clients. And the best part is it's open-source: https://github.com/haiwen/seafile

I'm using Seafile with a VPS. I had the VPS anyway for other projects and it's great to be able to access my files from anywhere. I'm really impressed with Seafile's polish, too. The only feature I miss is not being able to host files publicly so others can download them like Dropbox lets you. I ended up with a workable solution though by installing a seafile client on the seafile server as well. I then used it to sy…

You can generate shared link to a file or folder on your seafile website and send it to others.

Re: Clone Dropbox with a Raspberry Pi and BTSync

#60
post #55
post #39

Earlier quoted context omitted.

plus, the RPi can't even achieve full USB 2.0 speed, it is not a good choice for a file server.

FWIW, in this use-case the limit is the wifi or more likey your internet connection speed. You don't really need blazing disk read/write speeds for your "Dropbox clone" - if you can read and write data as fast as your adsl connection goes - anything more is "wasted". As a general purpose file server though - yeah, a 'Pi isn't going to stream multiple HD videos to all 4 bedrooms on your home network.

Both my wifi and internet connection speed are well over the 2megabytes/s I'm getting on my pi, which really is the only downside I have found with my pi.
Post reply on HN