Live data from Hacker News

Amazon Timestream – Fast, scalable, fully managed time series database

aws.amazon.com

41–50 of 131 posts

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#43

At my day job, I build a lot of machine learning systems that require data to be fed in a time series manner[1]. Often this means building systems to analyze terabytes of logs [semi]-realtime. All I have to say is - thank god! This is going to make my job a lot easier, and likely empower us to remove our current infrastructure setup. I know at one point we actually considered building our own time series database. In…

Have you looked at Clickhouse for timeseries data? It's the one database I've found that can scale and can query in near-realtime.

I've loaded a 100 Billion Rows in into a 5 shard database and can do full queries across the whole dataset in under 10 seconds. It also natively consumes multiple kafka topics.

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#44

Another Amazon Ad?

Most big tech companies bundle their announcements on their annual conference day. It happens several times a year and these same complaints show up every time, but spamming the threads with them is excessive.

https://hn.algolia.com/?sort=byDate&dateRange=all&type=comme...

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#45

At my day job, I build a lot of machine learning systems that require data to be fed in a time series manner[1]. Often this means building systems to analyze terabytes of logs [semi]-realtime. All I have to say is - thank god! This is going to make my job a lot easier, and likely empower us to remove our current infrastructure setup. I know at one point we actually considered building our own time series database. In…

Keira, nice article. It will be a long time before we are allowed to use this new service in C1

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#46
post #26

I'm actually impressed at how incredibly expensive they made this. $0.50 per million 1KB writes, which is 20x what aurora charges, since aurora allows 8KB writes. And Aurora is already expensive if you actually read/write to it.

I really don't think it's 20x the cost of Aurora in general, considering that Aurora costs are not that simple, but I don't have time to run the numbers, so let's go with that for a moment. Do you really think Amazon would introduce a product that's 20x as expensive if they didn't know there was a market for it?

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#47
A quick look at the Hacker News frontpage shows a bit of a problem,

    1.  Amazon Timestream (amazon.com)
    3.  Amazon Quantum Ledger Database (amazon.com)
    8.  Amazon FSx for Lustre (amazon.com)
    13. AWS DynamoDB On-Demand (amazon.com)
    14. Amazon's homegrown Graviton processor was very nearly an AMD Arm CPU (theregister.co.uk)
    21. Building an Alexa-Powered Electric Blanket (shkspr.mobi)
    30. Amazon FSx for Windows File Server (amazon.com)

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#48

A quick look at the Hacker News frontpage shows a bit of a problem, 1. Amazon Timestream (amazon.com) 3. Amazon Quantum Ledger Database (amazon.com) 8. Amazon FSx for Lustre (amazon.com) 13. AWS DynamoDB On-Demand (amazon.com) 14. Amazon's homegrown Graviton processor was very nearly an AMD Arm CPU (theregister.co.uk) 21. Building an Alexa-Powered Electric Blanket (shkspr.mobi) 30. Amazon FSx for Windows File Server…

https://hn.algolia.com/?sort=byDate&dateRange=all&type=comme...

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#49
post #43

At my day job, I build a lot of machine learning systems that require data to be fed in a time series manner[1]. Often this means building systems to analyze terabytes of logs [semi]-realtime. All I have to say is - thank god! This is going to make my job a lot easier, and likely empower us to remove our current infrastructure setup. I know at one point we actually considered building our own time series database. In…

Have you looked at Clickhouse for timeseries data? It's the one database I've found that can scale and can query in near-realtime. I've loaded a 100 Billion Rows in into a 5 shard database and can do full queries across the whole dataset in under 10 seconds. It also natively consumes multiple kafka topics.

> I've loaded a 100 Billion Rows

Have you done any load tests that would more closely mirror a production environment such as performing queries while clickhouse is handling a heavy insert load?

Re: Amazon Timestream – Fast, scalable, fully managed time series database

#50

A quick look at the Hacker News frontpage shows a bit of a problem, 1. Amazon Timestream (amazon.com) 3. Amazon Quantum Ledger Database (amazon.com) 8. Amazon FSx for Lustre (amazon.com) 13. AWS DynamoDB On-Demand (amazon.com) 14. Amazon's homegrown Graviton processor was very nearly an AMD Arm CPU (theregister.co.uk) 21. Building an Alexa-Powered Electric Blanket (shkspr.mobi) 30. Amazon FSx for Windows File Server…

Whether we are fans or not, keeping up with (and discussing) new AWS offerings is extremely relevant for practitioners.
Post reply on HN