Live data from Hacker News

TimescaleDB vs. Amazon Timestream

blog.timescale.com

121–130 of 203 posts

Re: TimescaleDB vs. Amazon Timestream

#121

Dying to use this on Google Cloud SQL but they just won't support the extension. There's an issue with upvotes to add support but still no official response as to whether support is coming... extremely frustrating

Azure support Timescale in their PasS - https://azure.microsoft.com/en-us/blog/power-iot-and-time-se...

Re: TimescaleDB vs. Amazon Timestream

#122
Disclosure: I work at AWS but not on Timestream. Opinions my own.

Unless I'm missing something this is not an apples to apples benchmark. TimescaleDB is running as a single node without any replication whereas Amazon Timestream is replicated[0] to three AWS Availability Zones for durability. I've only skimmed the TSBS[1] repo and the start/stop scripts for TimescaleDB. Can someone confirm this?

0 - https://aws.amazon.com/blogs/aws/store-and-access-time-serie...

1 - https://github.com/timescale/tsbs

Re: TimescaleDB vs. Amazon Timestream

#123

I'm very towards Postgres and resultingly Timescale for being one of it's biggest shining stars. Combine that with a cynical view that this is essentially S-tier content marketing (in the tech world), and the numbers are still bonkers. Might as well add on a bit here -- if you're into this sort of thing you might enjoy Timescale thrashing other purpose-built databases (which have since also improved so YMMV): - Times…

I'm also super curious about AWS's response. Because these numbers - and the aspect of backups - mean that, barring Timescale just not doing the benchmarking right, Timestream isn't going to be an option.

Re: TimescaleDB vs. Amazon Timestream

#124

Earlier quoted context omitted.

> There isn’t a mechanism or support to DELETE or UPDATE existing data. The only way to remove data is to drop the entire table. This largely accords with my experience with DynamoDB (a few years ago) as well - sql-class data management tooling was just missing.

I am not entirely sure this is correct. There are definitely ways to delete or update data.

there are, but the tooling was ... very subpar. Truncate, for instance, didn't exist.

Re: TimescaleDB vs. Amazon Timestream

#125
post #82

Earlier quoted context omitted.

Yeah, differences like that are why I ditched MySQL years ago in favor of PostgreSQL. I was using MySQL at the time, and did a performance comparison of how long it took each database to dump and load a snapshot of a 100GB database. MySQL took 3 days. PostgreSQL took 30 minutes. I posted on a MySQL forum asking why the drastic difference, and they tried to hand-wave it away by saying I had a lot of indexes. Well yeah…

That's surprising to me since Postgres does less efficient writes compared to MySQL in order to optimize for read queries[1] - a sensible tradeoff since most of the time reads are more common than writes in OLTP workloads. TimescaleDB essentially solves this problem for the specific case of time-series inserts. [In Postgres] if we have a table with a dozen indexes defined on it, an update to a field that is only cove…

The parent post didn't have enough detail, but I'd assume the dump would be using COPY for inserts. AFAIK when using COPY, the indexes are only built at the end of the command, not on each insert.

Re: TimescaleDB vs. Amazon Timestream

#126

Disclosure: I work at AWS but not on Timestream. Opinions my own. Unless I'm missing something this is not an apples to apples benchmark. TimescaleDB is running as a single node without any replication whereas Amazon Timestream is replicated[0] to three AWS Availability Zones for durability. I've only skimmed the TSBS[1] repo and the start/stop scripts for TimescaleDB. Can someone confirm this? 0 - https://aws.amazon…

Our experiments all ran on cloud instances (DO and Timescale Forge) that use storage that are replicated across multiple AZs/racks for greater reliability and fault tolerance.

Re: TimescaleDB vs. Amazon Timestream

#127

Dying to use this on Google Cloud SQL but they just won't support the extension. There's an issue with upvotes to add support but still no official response as to whether support is coming... extremely frustrating

Azure support Timescale in their PasS - https://azure.microsoft.com/en-us/blog/power-iot-and-time-se...

While true, this is only the Apache-2 version. See @mfreed's response below for links and more detail.

Re: TimescaleDB vs. Amazon Timestream

#128

Disclosure: I work at AWS but not on Timestream. Opinions my own. Unless I'm missing something this is not an apples to apples benchmark. TimescaleDB is running as a single node without any replication whereas Amazon Timestream is replicated[0] to three AWS Availability Zones for durability. I've only skimmed the TSBS[1] repo and the start/stop scripts for TimescaleDB. Can someone confirm this? 0 - https://aws.amazon…

Our experiments all ran on cloud instances (DO and Timescale Forge) that use storage that are replicated across multiple AZs/racks for greater reliability and fault tolerance.

Nice! Multiple AZs or Multiple racks?

EDIT: Also your response contradicts what is in the blog post:

> 1 remote client machine, 1 database server, both in the same cloud datacenter

> Disk Size: 4.8TB of disk in a raid0 configuration (EXT4 filesystem)

Re: TimescaleDB vs. Amazon Timestream

#129
post #114

Doesn't look like Timescale supports Postgres 13. Hmmm.

We've been hard at work with lots of great features for TimescaleDB 2.0, which should be GA in the next couple of weeks which makes multi-node available for anyone to use!

There is a branch for PostgreSQL 13 support available for beta testing if you want to build it yourself. It's important to us and we'll focus on completing that integration soon!

https://github.com/timescale/timescaledb/pull/2498

Re: TimescaleDB vs. Amazon Timestream

#130
post #5

Not a surprising result at all. Timestream is another case of AMS trying to make something for the sake of having it (see here Kinesis instead of just doing Kafka and many other products) instead of just adopting something industry standard. That isn't to say they don't do some good stuff just they also ship a lot of crap, very much 2 tiers of products in the AWS catalog. I would eventually like to see comparison for…

> ...see here Kinesis instead of just doing Kafka and many other products

Kinesis was a solution to their in-house woes with metering and billing which absolutely drowned in so much data from internal services with myriad metering and billing items and rules that they had to do something about it themselves: https://gigaom.com/2014/03/20/why-amazon-built-its-data-stre...

BTW, Kinesis Data Firehose is a pretty good product.

Post reply on HN