Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Dolt is Git for data

dolthub.com

Post reply on HN
Print view View original

161–170 of 196 posts

Re: Dolt is Git for data

#161

Post by dmitryminkovsky »

peteforde wrote: post #36

Only 39 days since the last "GitHub for data" was announced: https://news.ycombinator.com/item?id=22375774 I'll say what I said in February: I started a company with the same premise 9 years ago, during the prime "big data" hype cycle. We burned through a lot of investor money only to realize that there was not a market opportunity to capture. That is, many people thought it was cool - we even did co-sponsored data c…

You may be right in the big picture, but not all "GitHubs for data" are the same. This product seems super cool:

> Dolt is Git for data. Instead of versioning files, Dolt versions tables. DoltHub is a place on the internet to share Dolt repositories. As far as we can tell, Dolt is the only database with branches.

I find it hard to believe no other database has branches, but if that's true and if this product works like you'd imagine, that is really cool.

Given your historical observation, I think you're right that this will not lead to a market revolution, but sometimes you need the right product to change the landscape.

Re: Dolt is Git for data

#162

Post by peteforde »

solatic wrote: post #147
peteforde wrote: post #36

Only 39 days since the last "GitHub for data" was announced: https://news.ycombinator.com/item?id=22375774 I'll say what I said in February: I started a company with the same premise 9 years ago, during the prime "big data" hype cycle. We burned through a lot of investor money only to realize that there was not a market opportunity to capture. That is, many people thought it was cool - we even did co-sponsored data c…

I wonder how much of the market opportunity here is contingent upon market education. Everybody can clearly see the value of having a personal automobile, but how successful can you be at selling automobiles to people who don't know how to drive? Do people desire cars enough to buy one if they don't know how to drive? Everyone can see how FAANG companies are growing wealthy off the mountains of data they are amassing…

Maybe, but also maybe there just isn't a huge demographic of data scientists with discretionary purchasing capacity and a hair-on-fire problem that they are desperately searching for someone to take their money and fix.

I think that a lot of the data VIP types we met with honestly wanted to know why they needed it, but the more they thought about it, the more it just seemed like a shiny thing.

It's telling that dozens of similar companies with smart people behind them have thrown their talents at this solution, and none of them have located the problem people are eager to pay to solve.

Re: Dolt is Git for data

#164

Post by jnbiche »

Is there a way to page sql results? Also, it would be awesome if I could use rlwrap with `dolt sql`, so I can use the shortcuts I'm used to in an REPL environment.

Re: Dolt is Git for data

#166

Post by nailer »

peteforde wrote: post #36

Only 39 days since the last "GitHub for data" was announced: https://news.ycombinator.com/item?id=22375774 I'll say what I said in February: I started a company with the same premise 9 years ago, during the prime "big data" hype cycle. We burned through a lot of investor money only to realize that there was not a market opportunity to capture. That is, many people thought it was cool - we even did co-sponsored data c…

> we were part of a flock of 5 or 10 similar projects and I'm pretty sure the only one still around today is Kaggle.

Dat is still around, on version 14, last update in git was 5 days ago.

https://github.com/datproject/dat https://dat.foundation/

Re: Dolt is Git for data

#168

Post by moondowner »

nailer wrote: post #166
peteforde wrote: post #36

Only 39 days since the last "GitHub for data" was announced: https://news.ycombinator.com/item?id=22375774 I'll say what I said in February: I started a company with the same premise 9 years ago, during the prime "big data" hype cycle. We burned through a lot of investor money only to realize that there was not a market opportunity to capture. That is, many people thought it was cool - we even did co-sponsored data c…

> we were part of a flock of 5 or 10 similar projects and I'm pretty sure the only one still around today is Kaggle. Dat is still around, on version 14, last update in git was 5 days ago. https://github.com/datproject/dat https://dat.foundation/

Impressed by the documentation https://datprotocol.github.io/how-dat-works/

Re: Dolt is Git for data

#169

Post by DocSavage »

ChrisFoster wrote: post #70

A year or so I looked into "git for data" for medical research data curation. At the time I found a couple of promising solutions based on wrapping git and git annex: GIN: https://gin.g-node.org/ datalad: https://www.datalad.org/ At the time GIN looked really promising as something potentially simple enough for end users in the lab but with a lot of power behind it. (Unfortunately we never got it deployed due to orga…

You might want to look at some of the work we're doing in "git for connectomics": http://dvid.io

There will be a new backend released soon that should really improve our ability to transfer and backup versioned data.

Post reply on HN