Viewing profile — kwillets

This trend has been obvious since at least the Poland deal. Korea gets much more return on its defense dollar manufacturing exportable weapons systems than relying on imports or do…

I'm curious to see what patterns it's grepping.

This has a lot in common with a columnstore, but there are a few interesting differences. The main one is subrow versioning. Column stores (in OLAP at least) have always used row-l…

One of the founders of Antithesis gave a talk about this problem last week; diversity in test cases is definitely an issue they're trying to tackle. The example he gave was Spanner…

This site is underweighted on OLAP. Columnstores were invented for precisely this use case; nobody in the field wants to normalize everything. Which brings me to the question, why …

Can you be more specific about what type of data mining you're doing?

He doesn't want to manage the database the way he manages the rest of his infrastructure. All of his bullet points apply to other components as well, but he's absorbed the cost of …

The object storage stuff is new, but it's mostly confirmed that the older architecture works. MPP with shared (S3) storage and everything above that on local SSD and compute delive…

Over time I've realized that the best abstraction for managing a computer is a computer.

This is a fairly simple idea of indexing characters for each column/offset and compressing the bitmaps. Simple is good, as the overhead of more sophisticated ideas (eg suffix sorti…

It's been around for quite while, but DB people hate to explain where they got an idea. For all I know Vertica got it from somewhere else; I think postgres got jsonb around the sam…

My last dive into matrix computations was years ago, but the need was the same back then. We could sparsify matrices pretty easily, but the infrastructure was lacking. Some things …

I wrote part of that -- it needed a tight summary that covers all the main components, so I packed as much as I could into a sentence or two. I believe the second paragraph is most…

This is fun, but I'm confused by the architecture. Duckdb is based on one-off queries that can scale momentarily and then disappear, but this seems to run on k8s and maintain a per…

Don't forget the 2 hour tableau cloud runtime limit.

I'm just learning about agentic search so I'm a bit adrift. One of my side projects is a full text index for pattern search, and I'm trying to understand how it might fit with that…

Are you actually using grep here? How much data are you searching?

This article seems somewhat fanciful. Medieval Koreans ate two meals a day, and famines were common. Only a small area of the country is suitable for rice cultivation. The photos s…

Nam (Man Tea) and other brands have been in convenience stores for years; most have a full shelf of it. As I heard it the male part of the name is due to its use in manly herbal mi…

I built the ads audience system. Most of the effects of that are already known here; Ads became a big trophy within the org; everybody had to have ads and post-sale revenue, even t…

I worked at Samsung and saw plenty of enshittification (including losing my own job in some kind of sketchy power struggle), but oddly their audio stuff didn't seem like a bad deal…

The SIMD string matching optimization unfortunately missed a trick -- it's more selective to match the first and last characters of a pattern than the first two, and it's the same …

Sorting wins for unbounded strings because it only needs a prefix of each string.

The blog links on the infra listings are dead :(.

My company is doing the dbx thing, and the best I can tell my manager is that I'm neutral on it. My working theory is that the UI, a low-grade web-based SQL editor and catalog brow…