Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

CDC File Transfer

github.com

Post reply on HN
Print view View original

81–90 of 229 posts

Re: CDC File Transfer

#81

Post by hcs »

xuhu wrote: post #71

How does cdc_rsync compare to Courgette for sending a 500MB rebuilt ELF binary where .text and .data now have slightly different offsets ?

I haven't tested but I would guess it's a whole lot faster to compute but will end up sending much more data, given that it only works via exact chunks. A big part of binary patching is finding the largest possible chunks, even if they mismatch slightly.

Speaking of Courgette, though, I suggest looking into Zucchini which is faster and often produces smaller patches: https://news.ycombinator.com/item?id=29028534 (sorry for linking to my own comment but I haven't found any good explanation or benchmarks from Google)

Re: CDC File Transfer

#82

Post by _ea1k »

Looks interesting, but when did we start saying "synching" instead of "syncing"? I mean, its literally based on the idea behind rsync.

Why the sudden need to add an "h"?

Re: CDC File Transfer

#83

Post by consumer451 »

adastra22 wrote: post #46
dleslie wrote: post #45

> However, this was impractical, especially with the shift to working from home during the pandemic with sub-par internet connections. scp always copies full files, there is no "delta mode" to copy only the things that changed, it is slow for many small files, and there is no fast compression. I didn't appreciate the scope of this problem until a friend of mine visited from the valley. I live in semirural Canada, and…

> I sort of took it for granted that people would spend the extra twenty bucks or so to make work from home a painless experience I think you took for granted the mere availability of fiber as an option. 30Mbps DSL is the best option I have, other than Starlink. And I live in San Jose!

I am sitting in a farming village in central EU and I have 900mbps fiber, as of last year.

My family lives in old South Seattle neighborhoods and has excellent fiber.

I had something like 100mpbs co-axial 21 years ago in West Seattle.

What is the problem with San Jose?

Re: CDC File Transfer

#85

Post by strangescript »

dleslie wrote: post #45

> However, this was impractical, especially with the shift to working from home during the pandemic with sub-par internet connections. scp always copies full files, there is no "delta mode" to copy only the things that changed, it is slow for many small files, and there is no fast compression. I didn't appreciate the scope of this problem until a friend of mine visited from the valley. I live in semirural Canada, and…

You don't appreciate the complete lack of incentive for companies to roll out truly high speed internet in the U.S. There is minimal gov't backing, little competition, most people don't know any better and at the end of the day those companies will still have to charge the same amount per month they do now.

Re: CDC File Transfer

#86

Post by girvo »

qup wrote: post #75
adastra22 wrote: post #46

Earlier quoted context omitted.

> I sort of took it for granted that people would spend the extra twenty bucks or so to make work from home a painless experience I think you took for granted the mere availability of fiber as an option. 30Mbps DSL is the best option I have, other than Starlink. And I live in San Jose!

10/1 (Mbps) is the "guarantee" where I'm at. It's pretty rural, so I'm happy to have anything. I would pay $200/month extra for fiber.

I pay $130 AUD a month for 500/50 over HFC. Not ideal price wise but it works well enough, but man the NBN could’ve been so much better.

I could go to 1000mbps, but then I’m limited to 25mbps upload which is just terrible

Re: CDC File Transfer

#87

Post by AnonC »

I skimmed through the readme, which explains the concepts quite well, but am unclear on what needs to be installed on each machine (assuming Windows as the source and Linux as the destination). There’s a mention of copying the Linux build output, cdc_rsync_server, to the Windows machine. Why is this needed? And is there something on the Linux machine that needs to be (newly) added in the PATH?

Re: CDC File Transfer

#88

Post by Sophistifunk »

girvo wrote: post #86
qup wrote: post #75

Earlier quoted context omitted.

10/1 (Mbps) is the "guarantee" where I'm at. It's pretty rural, so I'm happy to have anything. I would pay $200/month extra for fiber.

I pay $130 AUD a month for 500/50 over HFC. Not ideal price wise but it works well enough, but man the NBN could’ve been so much better. I could go to 1000mbps, but then I’m limited to 25mbps upload which is just terrible

With who? I'm paying $200 for 250mb from Aussie BB.

Re: CDC File Transfer

#89

Post by kccqzy »

raverbashing wrote: post #84

The real question is, why is this not part of the base internet protocols already? Only goes to show how TCP is not as reliable as it should

There are many older and more venerable file transfer protocols, like FTP or TFTP. Add encryption and then you have SCP and SFTP. SFTP is the default protocol used by the scp command, and TFTP is still often used to communicate with routers and access points and similar equipment.

And I'm not sure what that has anything to do with TCP not as reliable. TCP has real problems on the modern Internet but the first part does not imply the second part.

Re: CDC File Transfer

#90

Post by glacials »

teleforce wrote: post #40

This is an excellent candidate to be used with local-first software [1]. Thanks for sharing, never knew that this algorithm existed. [1]Local-first software: You own your data, in spite of the cloud: https://www.inkandswitch.com/local-first/

Interesting! I recently wrote about this in the context of Google and Apple ecosystems and did not know it had a name. [1] I called in offline-first vs. online-first design.

[1]: https://twos.dev/apple.html#offline

Post reply on HN