Live data from Hacker News

TimescaleDB vs. Amazon Timestream

blog.timescale.com

191–200 of 203 posts

Re: TimescaleDB vs. Amazon Timestream

#191
post #30

Earlier quoted context omitted.

In my opinion it would be very hard to justify using Timestream for any analysis heavy workloads for at least three reasons: 1. Queries will need to touch a lot of data - will cost a lot, and there is no ability to optimize the queries in any way (no EXPLAIN, no indexes, no downsampling) 2. No integration with data exploration and visualization tools 3. No ability to have non-timeseries data, or correlate any data in…

I completely agree I think you misunderstood me. I would like to see comparisons between Timescale and Druid. I already know Timestream isn't up to the task lol.

What about comparing TimescaleDB to VictoriaMetrics? There are some old benchmarks [1], but it would be great to see updated benchmarks as well for the latest TimescaleDB and VictoriaMetrics versions.

[1] https://valyala.medium.com/measuring-vertical-scalability-fo...

Re: TimescaleDB vs. Amazon Timestream

#192

I'm very towards Postgres and resultingly Timescale for being one of it's biggest shining stars. Combine that with a cynical view that this is essentially S-tier content marketing (in the tech world), and the numbers are still bonkers. Might as well add on a bit here -- if you're into this sort of thing you might enjoy Timescale thrashing other purpose-built databases (which have since also improved so YMMV): - Times…

See also VictoriaMetrics vs TimescaleDB vs InfluxDB benchmarks:

- https://valyala.medium.com/measuring-vertical-scalability-fo...

- https://valyala.medium.com/when-size-matters-benchmarking-vi...

- https://valyala.medium.com/high-cardinality-tsdb-benchmarks-...

Re: TimescaleDB vs. Amazon Timestream

#193
post #46

I'm very towards Postgres and resultingly Timescale for being one of it's biggest shining stars. Combine that with a cynical view that this is essentially S-tier content marketing (in the tech world), and the numbers are still bonkers. Might as well add on a bit here -- if you're into this sort of thing you might enjoy Timescale thrashing other purpose-built databases (which have since also improved so YMMV): - Times…

I did some time series data benchmarking recently. Most large data is "time series" data, but I will not digress on terminology right now. For the usecase I was looking at my results for InfluxDB did not qualitatively disagree the above blogpost. Timescale got better compression efficiency, faster query results, more constrained memory usage, but lower ingest speed at high concurrencies blocked by WAL insert locking…

ClickHouse is great OLAP database with outstanding performance! It can be used for collecting and querying observability data [1]. But it may be hard to properly design database schema for ClickHouse for storing general-purpose observability data. That's why we created VictoriaMetrics - purpose-built time series database, which is based on ClickHouse architecture ideas [2]. It just works out of the box without the need to design database schema, while providing outstanding performance [3].

[1] https://github.com/lomik/graphite-clickhouse

[2] https://valyala.medium.com/how-victoriametrics-makes-instant...

[3] https://valyala.medium.com/measuring-vertical-scalability-fo...

Re: TimescaleDB vs. Amazon Timestream

#194

For me the killer feature of TimescaleDB is that you can run it on your own server. Not all of us can run our services in the cloud. In my case I'm working at a particle accelerator, which is considered a nuclear facility and thus not allowed to be directly connected to the Internet. One year ago I moved our old system to TimescaleDB, and I have been really happy since then, it's a really amazing product. Kudos to th…

Do you work on CMS project at CERN? As I know, they successfully use VictoriaMetrics for collecting and analyzing monitoring data. See https://indico.cern.ch/event/877333/contributions/3696707/at... and https://arxiv.org/pdf/2007.03630.pdf .

Re: TimescaleDB vs. Amazon Timestream

#195
post #89

On topic: While the comparison seems terrible for Timestream, as a customer who does not want to manage my databases I would love a similar GCP option, if the product had better tradeoffs. It's also interesting that Timescale attributes this AWS product to their own licensing. They had some much discussed [0] developments on that front, and if it did in fact force AWS to build their own implementation, that seems lik…

> Does anyone have any quick checklist or metrics to make decisions like this? When does it make sense to evolve from a vanilla RDB to a timeseries one?

10 daily metrics for 350 entities result in `10 * 350=3.5K` reading per day. This translates to `3.5K * 365=1.3M` readings per year. Such workload can be easily handled by any DBMS out there. There is no need to search for specialized time series database for this workload.

The need in specialized TSDB solutions arises when ingestion rate reaches a million of readings per second and the number of readings stored in the database exceeds hundreds of billions and trillions. Such a workload cannot be handled by general-purpose database, but it is easily handled by specialized databases such as VictoriaMetrics. Fun fact that it easily handles 10 trillions (e.g. 10K billions) of readings in a single-node setup - see https://victoriametrics.github.io/CaseStudies.html#wixcom

Re: TimescaleDB vs. Amazon Timestream

#197

I'm very towards Postgres and resultingly Timescale for being one of it's biggest shining stars. Combine that with a cynical view that this is essentially S-tier content marketing (in the tech world), and the numbers are still bonkers. Might as well add on a bit here -- if you're into this sort of thing you might enjoy Timescale thrashing other purpose-built databases (which have since also improved so YMMV): - Times…

See also VictoriaMetrics vs TimescaleDB vs InfluxDB benchmarks: - https://valyala.medium.com/measuring-vertical-scalability-fo... - https://valyala.medium.com/when-size-matters-benchmarking-vi... - https://valyala.medium.com/high-cardinality-tsdb-benchmarks-...

I think those benchmarks vs TimescaleDB require an update - a lot of things changed since the last test. However, even then VM ingestion rate was 11 million/s on 32CPU instance and this topic says TimescaleDB ingestion rate is 3.1 million/s.

Re: TimescaleDB vs. Amazon Timestream

#198
post #89

On topic: While the comparison seems terrible for Timestream, as a customer who does not want to manage my databases I would love a similar GCP option, if the product had better tradeoffs. It's also interesting that Timescale attributes this AWS product to their own licensing. They had some much discussed [0] developments on that front, and if it did in fact force AWS to build their own implementation, that seems lik…

> Does anyone have any quick checklist or metrics to make decisions like this? When does it make sense to evolve from a vanilla RDB to a timeseries one? 10 daily metrics for 350 entities result in `10 * 350=3.5K` reading per day. This translates to `3.5K * 365=1.3M` readings per year. Such workload can be easily handled by any DBMS out there. There is no need to search for specialized time series database for this wo…

Seriously stop spamming your product in every single one of your messages. Especially when you fail to mention that you have a vested interest

Re: TimescaleDB vs. Amazon Timestream

#199

For me the killer feature of TimescaleDB is that you can run it on your own server. Not all of us can run our services in the cloud. In my case I'm working at a particle accelerator, which is considered a nuclear facility and thus not allowed to be directly connected to the Internet. One year ago I moved our old system to TimescaleDB, and I have been really happy since then, it's a really amazing product. Kudos to th…

Do you work on CMS project at CERN? As I know, they successfully use VictoriaMetrics for collecting and analyzing monitoring data. See https://indico.cern.ch/event/877333/contributions/3696707/at... and https://arxiv.org/pdf/2007.03630.pdf .

No, I work at the IFMIF/EVEDA construction site in Rokkasho, Japan. It's a much smaller project, and right now we are only two software engineers here, with me the only one taking care of this kind of things.

Thank you for the links, I don't think we have the resources to implement something similar, but they are good food for thought.

Re: TimescaleDB vs. Amazon Timestream

#200

For me the killer feature of TimescaleDB is that you can run it on your own server. Not all of us can run our services in the cloud. In my case I'm working at a particle accelerator, which is considered a nuclear facility and thus not allowed to be directly connected to the Internet. One year ago I moved our old system to TimescaleDB, and I have been really happy since then, it's a really amazing product. Kudos to th…

Thanks for sharing! Glad to hear it's been a successful venture for you. Hope we get to hear more about it at some point!

Sure. I have been discussing your amazing product internally, but I hope I can promote it next time I go to an accelerator conference or workshop.
Post reply on HN