Live data from Hacker News

InfluxDB – Open-source distributed time-series, events, and metrics database

influxdb.org

41–50 of 79 posts

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#41
post #35

Earlier quoted context omitted.

I'll second what Chubot said that I'm not liking the SQL much. The interface I'd like would be something close to numpy (or matlab/r, if those are more familiar). Let me do vectorized operations and write functions in code. Let me load a few different timeseries into a dataframe. Most likely the easiest thing to do would just be to either embed numpy into your engine, or create simple wrappers to load data to it.

The numpy style interface might be interesting. The problem is that it would probably kill performance to marshal into a Python process. Unless there's some way to embed numpy? Supporting custom functions is definitely something we want to do.

Why would it kill performance? All you need to do is this:

    double* values = (double*)malloc(sizeof(double)*num_of_values);
(If you are unfamiliar with numpy, it's just a python wrapper around raw blocks of memory.)

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#42
post #35

Earlier quoted context omitted.

I'll second what Chubot said that I'm not liking the SQL much. The interface I'd like would be something close to numpy (or matlab/r, if those are more familiar). Let me do vectorized operations and write functions in code. Let me load a few different timeseries into a dataframe. Most likely the easiest thing to do would just be to either embed numpy into your engine, or create simple wrappers to load data to it.

The numpy style interface might be interesting. The problem is that it would probably kill performance to marshal into a Python process. Unless there's some way to embed numpy? Supporting custom functions is definitely something we want to do.

A route to this would be providing an FFI for loadable modules that provide custom procedures or functions.

Folks that wanted to could then write Python/Numpy code for these and use Numba+LLVM to compile them.

It could be quite performant and avoid having to marshal data or do IPC, could possibly avoid even copying data in some cases (Numpy/Numba have pretty robust support for structures coming over an FFI, not sure about FFI in Go.)

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#44

Reply the API: For javascript anyways, I think a chainable/fluent interface with the method names modeled after Underscore.js would be grand.

you have a link to some specific chainable/fluent code that looks like what you're thinking of?

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#45

I was actually looking at a bunch of open source time series databases and settled on kairosdb but this looks pretty nice. I think there is a hackernews rule someplace that a more interesting tech alternative shows up right when you decided to go with something else. For reference here is the list I created when researching these: http://opentsdb.net/overview.html Built on HBASE http://www.gocircuit.org/vena.html Bui…

https://github.com/imvu-open/istatd/wiki is my favouite. C++, compile to a binary and then it can send updates in a tree of agents to a master node, and maintain a replica of the master, and it does graphs too, everything you need in one.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#47

I was actually looking at a bunch of open source time series databases and settled on kairosdb but this looks pretty nice. I think there is a hackernews rule someplace that a more interesting tech alternative shows up right when you decided to go with something else. For reference here is the list I created when researching these: http://opentsdb.net/overview.html Built on HBASE http://www.gocircuit.org/vena.html Bui…

Rolling your own:

http://blog.apiaxle.com/post/storing-near-realtime-stats-in-...

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#48
post #12
post #9

Earlier quoted context omitted.

I wouldn't use this bastardized SQL dialect. SQL comes from relational databases, which comes from relational algebra, which is an exceptionally poor model for time series data. It's going to end up a mess and confuse people. SQL is already a mess by itself. I would simply use functions and operators over time series or data frame types. Perhaps take a look at the R zoo library for examples of more advanced things pe…

We opted for the bastardized SQL because we thought it would be easier to understand. Of course, that may not be the case which is why we'd like to hear what people think of it. We based our decision on people using our API in Errplane and not understanding some parts of it without a lot of additional explanation. One of our users said about one part of it "oh, that's just like group by". I'm curious, did you find th…

I personally like the simplicity of the SQL dialect. It's a universal way to query data every programmer is familiar with it. Alternatively using functions and code to query data easily gets very complicated.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#49
post #40

Every now and then I see a new opensource distributed and whatnot database pop out, now, I'm totally naive in terms of databases and distributed systems. Do we really need all this Databases? What's special about this one? Can someone give me a summary of the main ones (Mongo, Redis, Rethink, Riak, etc.) ? Now not discouraging InfluxDB or anything, as a systems programming fan it's great to see more things like this…

> Do we really need all this Databases? What's special about this one?

Good point, Comrade. I will propose to GOSPLAN that we rationalise the development of all new technologies, to avoid such accidental evolutionary convergence in future.

Post reply on HN