The Rise of Open Source Time Series Databases
victoriametrics.com
The Rise of Open Source Time Series Databases
1–10 of 71 posts
Re: The Rise of Open Source Time Series Databases
#2Interesting! Too bad it’s just about two of them.
Re: The Rise of Open Source Time Series Databases
#3A bit opinionated and partial version of history (graphite was big before Influxdb and Prometheus came out, and the landscape is bigger than what they mentioned) but it might be a good enough starting point to learn about this.
Re: The Rise of Open Source Time Series Databases
#4I'm using VictoriaMetrics (VM) to store basic weather data, like temperature and humidity. My initial setup was based on Prometheus however it seemed very hard to set a high data retention value, default was something like 15 days if I recall correctly.
Since I would actually like to store all recorded values permanently, I could partially achieve this with VM which let me set a higher threshold, like 100 years. Still not 'forever' as I would have liked, but I guess me and my flimsy weather data setup will have other things than the retention threshold to worry about in 100 years.
Would be nice to learn the reason why an infinite threshold is not allowed.
Re: The Rise of Open Source Time Series Databases
#5This is unsurprisingly a VictoriaMetrics post that frames the history in a narrow way to talk favorably about VictoriaMetrics.
Re: The Rise of Open Source Time Series Databases
#6The author calls out InfluxDB as the first time series database.
Why would that not have been rrdtool or something earlier?
Re: The Rise of Open Source Time Series Databases
#7This topic has been done to death. Too many OSS options in the last ~10 years with very little differentiation.
Let's talk LLMs instead.
Re: The Rise of Open Source Time Series Databases
#8I'm using VictoriaMetrics (VM) to store basic weather data, like temperature and humidity. My initial setup was based on Prometheus however it seemed very hard to set a high data retention value, default was something like 15 days if I recall correctly. Since I would actually like to store all recorded values permanently, I could partially achieve this with VM which let me set a higher threshold, like 100 years. Stil…
Usually performance and storage concerns. You can set effectively infinite retention on Prometheus, but after a long enough period you're going to like querying it even less.
Most TSDBs aren't built for use cases like "query hourly/daily data over many years". Many use cases aren't looking further than 30 days because they're focused on things like app or device uptime and performance metrics, and if they are running on longer time frames they're recording (or keeping, or consolidating data to) far fewer data points to keep performance usable.
Re: The Rise of Open Source Time Series Databases
#9If you are writing an article about time series databases, and you don't mention KDB - straight to jail. It is the grandfather of time series and predates influx by about a decade. It is still the fastest out there too. It is used by about every major financial and trading institution in the US and Europe.
Everybody thinks TSDB are something new-ish, but they've been around since the days of APL. All you youngins disappointment me every time you write about time series, vector languages, or data-oriented programming and entirely neglect all the work that comes under the APL/Vector umbrella. SOA and DOD have been around for 50+ years, and they didn't start with c++ or Pandas.
Now the creator, Arthur Whitney, has a new one out called Shakti that is even faster (but has also ditched from the "niceties" of Q.
Re: The Rise of Open Source Time Series Databases
#10If you are writing an article about time series databases, and you don't mention KDB - straight to jail. It is the grandfather of time series and predates influx by about a decade. It is still the fastest out there too. It is used by about every major financial and trading institution in the US and Europe. Everybody thinks TSDB are something new-ish, but they've been around since the days of APL. All you youngins dis…
kdb is mentioned. Possible it was added after your comment in the last 30 mins, but the article is about open source not proprietary.