Live data from Hacker News

Viewing profile — peterwaller-arm

peterwaller-arm

HN member
Joined
Fri, Nov 19, 2021, 1:37 PM UTC
HN karma
220
Public activity
27 items

About peterwaller-arm

No profile information was provided.

Recent public activity

  1. comment
    Comment #29282369

    Author here. This is correct, we set out to do binary diffing but we soon discovered that if you put similar enough object files together in a stream, and then compress the stream,…

  2. comment
    Comment #29279849

    Yes, this is less great than I would like! :( :)

  3. comment
    Comment #29279586

    Author here, I'd like to see such a comparison too actually, but I'm not in the position to do the work at the moment. We did some preliminary experiments at the beginning, but a l…

  4. comment
    Comment #29279497

    Yes you could do that. On the other hand, all revisions for a month is 100MiB, and all revisions we've built spanning 2019-now are a total of 2.8GiB, so we opted to forego implemen…

  5. comment
    Comment #29279442

    Nice, I bet dwarfs would do well at our use case too. Thanks for sharing.

  6. comment
    Comment #29278521

    ThinLTO can be pretty quick if you have enough cores, it might work. Not sure how well the LTO objects compress against each other when you have small changes to them. It might wor…

  7. comment
    Comment #29278395

    > maybe mention this as well in the README? We've tweaked the readme, I hope it's clearer. It would be great to provide this for gcc too. The project is new and we've just started …

  8. comment
    Comment #29278038

    (Copying from Q&A) Before starting out some time ago, I did some experiments with bup. I had a good experience with bup and high expectations for it. However, I found that quite a …

  9. comment
  10. comment
    Comment #29277958

    We've just added an applicability section, which explains a bit more what we do. We don't have any ELF specific heuristics [0]. https://github.com/elfshaker/elfshaker#applicability…

  11. comment
    Comment #29277844

    Author here. Compressed data is unlikely to work well in general, unless it never changes.

  12. comment
    Comment #29277779

    Author here. No architecture specific processing currently. Most of the magic happens in zstandard (hat tip to this amazing project). Please see our new applicability section which…

  13. comment
    Comment #29277760

    Done, hopefully this is clearer. Please let us know if you see a way to improve it further: https://github.com/elfshaker/elfshaker/pull/60

  14. comment
    Comment #29277645

    (Disclosure: I work for Arm, opinions are my own) Author here. elfshaker itself does not have a dependency on any architecture to our knowledge. We support the architectures we hav…

  15. comment
    Comment #29277587

    Author here. The executables shipped in manyclangs are release builds! The catch is that manyclangs stores object files pre-link. Executables are materialized by relinking after th…

  16. comment
    Comment #29277547

    Author here. I've used bup, and elfshaker was partially inspired by it! It's great. However, during initial experiments on this project I found bup to be slow, taking quite a long …

  17. comment
    Comment #29277347

    Author here, I agree with xdfgh1112, please take care before using brand new software to store your backups!

  18. comment
    Comment #29277336

    Author here, this software is young, please don't use it for backups! But also, in general, it might not work well for your use case, and our use case is niche. Please give it a tr…

  19. comment
    Comment #29277305

    Performing poorly with non-textual data happens for a a number of reasons. Binary data, when changed, often have a lot of 'non-local' changes in them. For example, a PSD file might…

  20. comment
    Comment #29277230

    Author here, I don't think it would apply well to that scenario. elfshaker is good for manyclangs where we ship 2,000 revisions in one file (pack), so the cost of individual revisi…

  21. comment
    Comment #29277156

    Author here, it works particularly well for our presented use case because it has these properties: * There are many files, * Most of them don't change very often, * When they do c…

  22. comment
    Comment #29277134

    Author here, I don't currently know how this compares to git-lfs. It it is possible git-lfs would perform quite well on the same inputs as elfshaker works on. If git-lfs does alrea…

  23. comment
    Comment #29277124

    Author here. I'm unsure whether this would apply very well to cargo or not. If it has lots of pre-link object files, then maybe.

  24. comment
    Comment #29277116

    Author here. Maybe, it's a fun idea. I have toyed with providing a fuse filesystem for access to a pack but my time for completing this is limited at the moment.

  25. comment
    Comment #29277113

    Author here. We'd love this to be a thing, but this is young software, so we don't recommend relying on this as a single way of doing a backup for now. Bear in mind that our main u…