Syncthing Usage Data • Hacker News Board

Re: Syncthing Usage Data

#51

Post by noja » Mon, Mar 13, 2017, 2:51 PM UTC

pedrocr wrote: post #34

Has anyone been able to sync large folders with syncthing? Last time I tried when syncing 500GB you'd end up using >500MB of memory which made it unusable for home NAS setups. Hopefully it has since improved?

Are you running an official build?

This page indicates that your usage should be around 80 megs (with the gui closed): https://forum.syncthing.net/t/huge-ram-usage-2gb-on-synology... and that an unofficial NAS-specific build had a problem with high ram usage.

Re: Syncthing Usage Data

#52

Post by [deleted] » Mon, Mar 13, 2017, 2:52 PM UTC

aerique wrote: post #9

This goes against one of the points of Syncthing (but I'm more interested in its other features): are there any good 3rd-party hosts so I don't have the hassle of maintaining on myself?

[deleted]

Re: Syncthing Usage Data

#53

Post by gravypod » Mon, Mar 13, 2017, 2:58 PM UTC

onli wrote: post #48

gravypod wrote: post #45

Earlier quoted context omitted.

I don't really want syncing. I want a distrabution of the blocks of the filesystem that allows for redundant storage & expansion of storage space. RW times would be slower but storage would be bigger and more redundant.

Is it possible you look for something like Ceph? https://en.wikipedia.org/wiki/Ceph_(software)

That seems to be focused on throughput. I'm focused on how much data I can store into the system and if it's redundant so long as N nodes don't die (and if they do I'd like it to attempt to reorganize the network so they system keeps working with N node failure).

Re: Syncthing Usage Data

#54

Post by pedrocr » Mon, Mar 13, 2017, 3:07 PM UTC

noja wrote: post #51

pedrocr wrote: post #34

Has anyone been able to sync large folders with syncthing? Last time I tried when syncing 500GB you'd end up using >500MB of memory which made it unusable for home NAS setups. Hopefully it has since improved?

Are you running an official build? This page indicates that your usage should be around 80 megs (with the gui closed): https://forum.syncthing.net/t/huge-ram-usage-2gb-on-synology... and that an unofficial NAS-specific build had a problem with high ram usage.

I always ran official builds, my NAS are just standard x86 servers. Last time I checked was January 2015:

https://github.com/syncthing/syncthing/issues/468#issuecomme...

Since that bug was closed with no solution I'm not too hopeful but maybe I should try it again.

Re: Syncthing Usage Data

#55

Post by sinatra » Mon, Mar 13, 2017, 3:18 PM UTC

jepper wrote: post #8

Brilliant piece of software. Perfect to gather data from different devices to backup in the cloud or to sync documents or a massive music collection. The only thing missing is an encrypted external sync node so I can put it on a VPS somewhere

This is the blocker for me too. Support for a zero knowledge server where even if someone gets access to the filesystem on the server, they can only see it encrypted.

Other than that, Syncthing is absolutely amazing!

Re: Syncthing Usage Data

#56

Post by Nutomic » Mon, Mar 13, 2017, 3:20 PM UTC

Note that usage reporting is disabled by default, and has to be enabled manually. The Android app alone has around 30.000 active installs according to Google Play statistics. Usage reporting only shows about 2.000 of those. Based on this data, I would estimate that there are between 100.000 and 300.000 active installations of Syncthing.

Source: I'm the maintainer of the Syncthing Android app.

Re: Syncthing Usage Data

#57

Post by Nutomic » Mon, Mar 13, 2017, 3:27 PM UTC

mduerksen wrote: post #41

Syncthing is sorely missing iOS support. I know they have their reasons not to implement it[0], but I feel that feature might be worth the hassle. Photo sync on iOS without iCloud is a huge pain atm. My backup strategy involves a NAS folder that stays up to date (i.e. also deletes photos that I delete on my phone), and which I occasionally sort into final location. After that I can free the space on my phone. All oth…

Syncthing is entirely made by volunteers, and so far no one has had the time or interest to work on an iOS app. If you (or someone else) wants to work on an iOS app, that would definitely appreciated.

Re: Syncthing Usage Data

#58

Post by pricechild » Mon, Mar 13, 2017, 3:28 PM UTC

josephb wrote: post #26

vocatus_gate wrote: post #19

As a heavy user of Syncthing for the Tron project ( https://reddit.com/r/TronScript ) I'm excited to see how well Syncthing is doing, and really appreciate the hard work from the devs. We spun up a Syncthing node to distribute the project after Resilio Sync (formerly "BT Sync") put a hard cap on the number of nodes that were allowed to connect. Keep up the great work, team!

For those with some spare CPU cycles and bandwidth you can give back to the project by running a relay server. https://docs.syncthing.net/users/strelaysrv.html Eg that VM running a DNS adblocker, from another front page article :)

What's the drive or motivation behind people running syncthing discovery & relay servers?

Do they generally then run their own clients to only use their own servers?

With Tor I'm convinced over the "speech should be free, I'm making the world a better place" type argument.

With syncthing I'm incredibly impressed that this optional (but incredibly useful) infrastructure is being run by people for free since it doesn't quite make the world a better place in the same way? It just saves a bunch of other people setting up their own relay/discovery server on a cheap linode/aws instance?

Impressed!

Re: Syncthing Usage Data

#59

Post by canton7 » Mon, Mar 13, 2017, 3:29 PM UTC

odabaxok wrote: post #12

Can anyone share their experiences with Syncthing compared to Resilio Sync (aka Bit Torrent Sync)? I am using Resilio Sync since its beta version, but they have added a lot of restrictions since then and made some functions only available for paying users. I am concerned about ease of use (setup and everyday usage) on Windows and Android.

There are a number of projects which make life easier for Windows users (tray icon, autostart, make it look and feel and bit more like a Windows application, bundle filesystem notifications, etc). Two of the big ones are SyncTrayzor (https://github.com/canton7/SyncTrayzor) and Syncthing-GTK (https://github.com/syncthing/syncthing-gtk).

See the Community Contributions page (https://docs.syncthing.net/users/contrib.html) for the full list.

Re: Syncthing Usage Data

#60

Post by canton7 » Mon, Mar 13, 2017, 3:37 PM UTC

One of the common complaints about Syncthing is the lack of native UI (you use your web browser), and the difficulty in setting it up for non-technical users (copying an executable into a directory, running it directly, setting it to automatically start on login aren't something you'd ask your parents / grandparents to do).

The homepage recommends Syncnthing-GTK (https://github.com/syncthing/syncthing-gtk) (Cross-Platform) and SyncTrayzor (https://github.com/canton7/SyncTrayzor) (Windows only) to help with these pain points. The provide installers, more native-feeling UIs, tray icons, etc.

There are also a large number of other Community Contributions (https://docs.syncthing.net/users/contrib.html).