Viewing profile — mbrt

Various attempts at AI personality shaping, having a very specific character in mind.

gencmd is an open source, interactive command line utility to generate bash commands from a natural language description, directly from the console.

Wow, not sure how I missed this, but I see many similarities. They were also bitten by lack of conditional writes in S3: > In Databricks service deployments, we use a separate ligh…

B2 is mostly S3-compatible, so if they add the same support for preconditions on writes as S3 and GCS, nothing prevents using it as a backend for GlassDB.

This builds on the same intuition I had, where data can be easily partitioned across objects. What seems to be missing is transactions across different objects though? The flipside…

You're right indeed:) but it depends on what you are comparing it with. In this case the comparison is against other managed cloud storage and databases, and in that context I thin…

It's a good observation, because I did and decided to keep it out of scope from the base layer. But this is entirely possible. You can wrap GlassDB transactions and encode multiple…

Nice, thanks for the reference! BTW, the comparison was only to give an idea about isolation levels, it wasn't meant to be a feature-to-feature comparison. Perhaps I didn't make it…

And I see more possibilities now that https://aws.amazon.com/about-aws/whats-new/2024/11/amazon-s3... is available. It will get easier and easier to build serverless data lakes, st…

Thanks for the details! Consistency at the individual file can be guaranteed this way, but I don't think this works across multiple files (as you need a global total order of opera…

Very nice, I like the approach. I assume data is partitioned and each file is handled by an elected leader? If data is replicated, you still need a consensus algorithm on updates. …

I just saw it! I asked a question ( https://news.ycombinator.com/item?id=42180611 ) and it seems that durability and consistency are implemented at the caching layer. Basically an …

Wow, coincidentally I posted GlassBD ( https://news.ycombinator.com/item?id=42164058 ) a couple of days ago. Making S3 strongly consistent is not trivial, so I'm curious about how …

OK, thanks for the reference. Yeah, so indeed separating storage and compute is nothing new. Definitely not claiming I invented that :) And as you mention, Datomic uses DynamoDB as…

I think it's now much easier to achieve than a year ago. The critical one is conditional writes on new objects, because otherwise you can't safely create transaction logs in the pr…

It's my understanding that the newer generation of data lakes still make use of a tiny, strongly consistent metadata database to keep track of what is where. This is orders of magn…

Author here. I understand your concerns, and in fact one of the last things I added is unit tests: https://github.com/mbrt/gmailctl/blob/master/README.md#tests Getting things right…