Viewing profile — brentjanderson

I think Ducklake[1] is a terrific example of this. They said "look, let's build a lake house over S3, but for the bit that needs strong consistency (the manifest of which S3 blobs …

> So many of us have been taught that it is the fate of the small to be destroyed by the big, since they are more ruthless and more powerful. But the evidence doesn't really suppor…

There's actually a term for this, Context Collapse [1] that explores how social media forces everyone to have a single online persona instead of presenting in the way that makes se…

Sadly, most of them are lost to time. There's one that I'm aware of at https://archive.org/details/hypercard_voyager-engineer-new is just one station of about 15 from one of the sh…

Bill's contribution with HyperCard is of course legendary. Apart from the experience of classrooms and computer labs in elementary schools, it was also the primary software powerin…

IANAL either but if I were you, I’d start here: https://www.vanta.com/products/hipaa or look for competitors. And perhaps look at Stripe Atlas for getting my corporate ducks in a r…

One of the linked pieces in the Neon blog post is from Knock, where we pulled off a practically zero downtime migration: https://knock.app/blog/zero-downtime-postgres-upgrades In t…

https://rpginabox.com/ is fantastic. Includes a lot of great assets, constrained enough to ensure you can actually build something, open enough that you can build a lot of differen…

OP Here - 1. There was zero downtime - no dropped requests, no 5xx errors. There _was_ a latency spike that was carefully tuned to be within timeout limits for our customers, but w…

OP here: > Can't initialize a replica from a backup You could, but you're not going to get any of the constant writes happening during the backup. You will have missing writes on t…

OP here - we avoid sequences in all but one part of our application due to a dependency. We use [KSUIDs][1] and UUID v4 in various places. This one "gotcha" applies to any sequence…

OP here: we looked at this and were not confident in manually advancing the LSN as proposed, and detecting any inconsistency if we missed any replication as a result. Table by tabl…

OP here. We don’t specify, but it’s big enough that it’s not reasonable to do a dump and restore style upgrade. The strategies in the post should work for any size database. The li…

Neat tool! Some of our findings for large tables could be interesting for a tool like this, making it easier to apply the right strategy to the right tables. Having something like …

OP here - we have more coming about the role that the BEAM VM played in this migration too. (The BEAM is the virtual machine for the Erlang ecosystem, analagous to the JVM for Java…

That might be possible. We were within days of performing our upgrade when the blue/green feature became available for Postgres, so we didn't consider it for our work. You may be a…

I looked at getting LSN numbers after an upgrade/cluster replacement, and IIRC restoring from a snapshot emits LSN information into the logs, but it's a bit of of a mixed bag as to…

OP Here - that's great feedback! Our hope is to build confidence in both the reliability of our product _and_ the consistency of the workloads. Of course, presenting the illusion o…

That's a very interesting approach, I'm not sure if the sequences would remain consistent under that model or not. AWS RDS Aurora also requires you to drop replication slots when p…

We actually did those steps as part of our overall assessment, and you're right that we could have taken an outage window for that long and called it a day. We decided the tradeoff…

OP here: It’s true that all services have downtime for one reason or another. We discussed taking an outage window, but one thing that we kept coming back to was how we might trial…