Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Quilt – manage data like code

quiltdata.com

Post reply on HN
Print view View original

181–183 of 183 posts

Re: Show HN: Quilt – manage data like code

#181

Post by akarve »

IanCal wrote: post #149
akarve wrote: post #133

Earlier quoted context omitted.

It's not about people not being able to load their data, but about accelerating the loading with serialization and about whether or not people want to focus on data cleaning, or have the cleaning done once and then available for posterity. Quilt is, in my view, as open as git or GitHub. The de/serialization code is all open source, and uses an open format (Parquet). Parquet is accessible (and more optimal than text f…

> Quilt is, in my view, as open as git or GitHub Can I run something that hosts a quilt repo on my own server?

Yes. In progress and the first on-prem installs are up and running. Happy to chat further: aneesh at quilt data dot io.

Re: Show HN: Quilt – manage data like code

#182

Post by akarve »

hn_throwaway_99 wrote: post #153
smilliken wrote: post #64

It's outrageous how little tooling support there is for version control in data compared to code. Every mainstream database forgets history with updates, don't support distributed workflows, don't support commit ids as first class objects, or most other basic features of VCSs. Databases just aren't a solution to version control. I can't imagine a future where we don't treat data version control like a necessity in th…

Have you seen data.world? "GitHub for data" is basically their entire model.

Yeah. Important differences: Quilt offers unlimited public storage, users do not need to log in to use public data, offers on-premise solution, handles serialization, works offline with local builds, etc. You'll see more differentiation as we roll out new product features.

Re: Show HN: Quilt – manage data like code

#183

Post by akarve »

edraferi wrote: post #80

This looks like a cool project -- always glad to see new tools for statistical collaboration and reproducible research. How does this compare to what data.world [1] is doing? They recently released a Python SDK [2] as well. [1] https://data.world/ [2] https://github.com/datadotworld/data.world-py

Hi. Key differences from data dot world: https://news.ycombinator.com/item?id=14792143
Post reply on HN