Live data from Hacker News

InfluxDB – Open-source distributed time-series, events, and metrics database

influxdb.org

21–30 of 79 posts

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#21
post #6

This looks like the exact feature-set we need at my company; we're in the middle of moving to Redshift but I'll be keeping an eye on Influx. I know it's early days but I didn't see any information about cluster management - how does one setup an Influx cluster, can it be resized, what kind of hardware does it prefer?

I don't know of your exact needs but cluster management is always a pain have you thought more of a "DBaaS" type platform like TempoDB (https://tempo-db.com/)

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#22
post #18
post #16

Earlier quoted context omitted.

This project looks really, really promising, thanks for working on it! How robust/scalable in your opinion the backend is at this stage? I'm just trying to set my expectations properly when checking it out. Thanks, Sasha

We're writing the clustered portion of it right now. That won't be available until December, but we'll have performance benchmarks on a variety of configurations. The single node performance at this point for writes is tens of thousands of points per second if batched, and for reads we haven't optimized yet. Queries that only have to go through a few hundred thousand points should return in For now we're focused on c…

That makes total sense. Thanks for the info!

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#23
post #14

sounds interesting; i am currently using hbase for similar purposes. Do "tables" have to be created explicitly, or can I just store a value into a timeseries, and if the ts doesn't exist yet it will be created?

You can just write data in on the fly. Time series get created when you write the first point. You also can create new columns on the fly. And there's no enforcement of a data type across all values for a given column. That's on the user.

Great. I am looking at integrating it into my fork of ethercalc so i can store not just the metrics but also some of the indicators and statistics i compute on them. For my use cases (R and spreadsheets) it would be handy if i could get results in csv format straight from the API when i make a query.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#24
Built one myself sometime ago:

https://github.com/lsh123/stats-rrdb

An important part for me was the desire to completely separate data and UX (so no graphite). Added bonus is ability to control resources (e.g. memory/disk usage).

We run it in production for quite some time processing hundreds of data updates per second and tens of queries per minute.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#25
post #14

Earlier quoted context omitted.

You can just write data in on the fly. Time series get created when you write the first point. You also can create new columns on the fly. And there's no enforcement of a data type across all values for a given column. That's on the user.

Great. I am looking at integrating it into my fork of ethercalc so i can store not just the metrics but also some of the indicators and statistics i compute on them. For my use cases (R and spreadsheets) it would be handy if i could get results in csv format straight from the API when i make a query.

We'll add the CSV response to the todo list. You're not the first person to request it and it makes total sense.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#27

The sandbox appears to be down, but I'm a little concerned about the security. Can database users be created that only have read access?

You can limit read and write access on users. It's documented on this page: http://influxdb.org/docs/api/http.html. We haven't implemented the specific column limits part of that API yet so feedback would be great. Does that take care of the use case you were thinking of?

However, security is probably not something to bother with in sandbox since it's not HTTPS. We're looking at it now, and should have it back up in a bit.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#28

I was actually looking at a bunch of open source time series databases and settled on kairosdb but this looks pretty nice. I think there is a hackernews rule someplace that a more interesting tech alternative shows up right when you decided to go with something else. For reference here is the list I created when researching these: http://opentsdb.net/overview.html Built on HBASE http://www.gocircuit.org/vena.html Bui…

Actually, as a person who used most of these and built things similarly this project seems very interesting and useful and tackles a lot of the annoyances of those above. Kinda a combination of otsdb and esper but without a big requirement of setting up other technologies (I don't have to become or hire a HBase expert to maintain it). Having a bunch of online algorithms executed against the data is exciting too from a perspective of future improvements alsom I would love to see anomaly detection built in.

Re: InfluxDB – Open-source distributed time-series, events, and metrics database

#29
post #9
post #2

I'm one of the committers. The project is still early stage. At this point we're looking for feedback on the API, which we're planning on finalizing this month. Would love to hear about anything you'd like changed or added to the API.

I wouldn't use this bastardized SQL dialect. SQL comes from relational databases, which comes from relational algebra, which is an exceptionally poor model for time series data. It's going to end up a mess and confuse people. SQL is already a mess by itself. I would simply use functions and operators over time series or data frame types. Perhaps take a look at the R zoo library for examples of more advanced things pe…

reminds me of epl http://esper.codehaus.org/esper-4.2.0/doc/reference/en/html/...
Post reply on HN