InfluxDB – Open-source distributed time-series, events, and metrics database

Post by taf2 » Wed, Nov 06, 2013, 4:11 AM UTC

pauldix wrote: post #12

chubot wrote: post #9

Earlier quoted context omitted.

I wouldn't use this bastardized SQL dialect. SQL comes from relational databases, which comes from relational algebra, which is an exceptionally poor model for time series data. It's going to end up a mess and confuse people. SQL is already a mess by itself. I would simply use functions and operators over time series or data frame types. Perhaps take a look at the R zoo library for examples of more advanced things pe…

We opted for the bastardized SQL because we thought it would be easier to understand. Of course, that may not be the case which is why we'd like to hear what people think of it. We based our decision on people using our API in Errplane and not understanding some parts of it without a lot of additional explanation. One of our users said about one part of it "oh, that's just like group by". I'm curious, did you find th…

Post by e12e » Wed, Nov 06, 2013, 5:38 AM UTC

philjackson wrote: post #47

siliconc0w wrote: post #10

I was actually looking at a bunch of open source time series databases and settled on kairosdb but this looks pretty nice. I think there is a hackernews rule someplace that a more interesting tech alternative shows up right when you decided to go with something else. For reference here is the list I created when researching these: http://opentsdb.net/overview.html Built on HBASE http://www.gocircuit.org/vena.html Bui…

Rolling your own: http://blog.apiaxle.com/post/storing-near-realtime-stats-in-...

Post by pramodliv1 » Wed, Nov 06, 2013, 7:56 AM UTC

dysoco wrote: post #40

Every now and then I see a new opensource distributed and whatnot database pop out, now, I'm totally naive in terms of databases and distributed systems. Do we really need all this Databases? What's special about this one? Can someone give me a summary of the main ones (Mongo, Redis, Rethink, Riak, etc.) ? Now not discouraging InfluxDB or anything, as a systems programming fan it's great to see more things like this…

Post by easytiger » Wed, Nov 06, 2013, 9:30 AM UTC

pauldix wrote: post #34

beagle3 wrote: post #31

There's a lot to be learned from the non-open source players in this space. Specifically, kdb+ has always provided everything I needed. It's built for HFT, and does millions of data points per second with analytics, with history going back years. It is, however, rather expensive.

The stuff built for finance is definitely interesting. John and I (two of the people working on this) previously worked at a fintech startup and worked with a closed source time series db called OneTick. It was super fast, but its API work for analytics/events use cases. Great for fast moving market data though.

Post by waterlion » Wed, Nov 06, 2013, 10:23 AM UTC

yummyfajitas wrote: post #41

pauldix wrote: post #35

Earlier quoted context omitted.

The numpy style interface might be interesting. The problem is that it would probably kill performance to marshal into a Python process. Unless there's some way to embed numpy? Supporting custom functions is definitely something we want to do.

Why would it kill performance? All you need to do is this: double* values = (double*)malloc(sizeof(double)*num_of_values); (If you are unfamiliar with numpy, it's just a python wrapper around raw blocks of memory.)