Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Thoughts on Time-series Databases

jmoiron.net

Post reply on HN
Print view View original

1–10 of 132 posts

Re: Thoughts on Time-series Databases

#5

Post by nwmcsween »

Why does every TSD seem so overly engineered and for all the wrong reasons? Why not just use a time decaying ring buffer (multiple buffers could be used), one statistic one file (or more depending on the decay) and offset by a set interval if you have irregular intervals 'smooth' it to fit O(1) for most things. My other issue is (from a glance) looking at some TSD they ignore most research done on how to effectively store the data.

Too many writes, use a cache to batch. No metadata? put the metadata in a different file and point to the offsets.

Re: Thoughts on Time-series Databases

#6

Post by mstepniowski »

nwmcsween wrote: post #5

Why does every TSD seem so overly engineered and for all the wrong reasons? Why not just use a time decaying ring buffer (multiple buffers could be used), one statistic one file (or more depending on the decay) and offset by a set interval if you have irregular intervals 'smooth' it to fit O(1) for most things. My other issue is (from a glance) looking at some TSD they ignore most research done on how to effectively…

Are you one of the guys that implemented a Twitter clone during the weekend?

Re: Thoughts on Time-series Databases

#8

Post by _lbaq »

olviko wrote: post #3

What are the benefits of introducing specialized time-series databases vs using Redis, Casandra, or some Sql database?

Very few if any if your talking Cassandra (I would never store time series in redis), I worked developing TSD and are active in the space, most companies goes with Cassandra these days and builds computational frameworks upon that.
Post reply on HN