Live data from Hacker News

Static search trees: 40x faster than binary search (2024)

curiouscoding.nl

11–20 of 22 posts

Re: Static search trees: 40x faster than binary search (2024)

#11
post #7

Earlier quoted context omitted.

Is « cacheability » a property of the data structure or of the lookup algorithm?

Locality is a property of how data is arranged, so it's a property of the data structure, no?

It's a combination of both. Your data layout could be very cachable for one algorithm, but very much not so for another algorithm.

Re: Static search trees: 40x faster than binary search (2024)

#12
post #7

Earlier quoted context omitted.

Is « cacheability » a property of the data structure or of the lookup algorithm?

Locality is a property of how data is arranged, so it's a property of the data structure, no?

Data arrangement and data structure are the same word...

Re: Static search trees: 40x faster than binary search (2024)

#13
post #7

Earlier quoted context omitted.

Is « cacheability » a property of the data structure or of the lookup algorithm?

Locality is a property of how data is arranged, so it's a property of the data structure, no?

It has to be both. You can lay things out in memory so they are tightly packed together and thus ostensibly cache efficient but that doesn't help you if you index into that data structure in such a way that every new index loads a new cache line.

Re: Static search trees: 40x faster than binary search (2024)

#14

> The main benefit of the Eytzinger layout is that all values needed for the first steps of the binary search are close together, so they can be cached efficiently: we put the root at index 1 and the two children of the node at index i are at 2i and 2i + 1. This is exactly what is done in good old binary heaps; though binary heaps do not maintain a balanced binary tree, only the property that key(parent) . Binary hea…

Is « cacheability » a property of the data structure or of the lookup algorithm?

Both. The hypothesis with Eytzinger is that you're doing vanilla binary search on a data structure where each hop is one operation. It doesn't, by itself, do anything to optimize around particular hot leaves, so assuming you aren't doing a weighted rebalance operation before construction it additionally assumes access patterns are somewhat uniform. That's the algorithm and input pattern whose cachability we're trying to optimize.

Imagine, e.g., doing a b-tree lookup on a binary Eytzinger layout. You would always grab more cache lines than optimal. Even more obviously, consider an inorder traversal. The properties of an algorithm and data structure depend properly on both components.

Re: Static search trees: 40x faster than binary search (2024)

#15
> Input. A sorted list of 32bit unsigned integers vals: Vec.

Okay, but that's not even remotely like the kind of input that this tree was created for. From the next paragraph, this work is in part

> [...] to make efficient datastructures to index DNA [...]. One such datastructure is the suffix array, that sorts the suffixes of the input string. Classically, one can then find the locations where a string occurs by binary searching the suffix array.

So where is the analysis of how it performs for that use-case? Searching through "already sorted 32 bit numbers" has nothing to do with searching a 3 billion character string (that by definition cannot be internally sorted) for substrings.

Re: Static search trees: 40x faster than binary search (2024)

#16
post #12
post #7

Earlier quoted context omitted.

Locality is a property of how data is arranged, so it's a property of the data structure, no?

Data arrangement and data structure are the same word...

Kind of. Many dynamic set data structures do not require the set elements to be in some layout inside an array; the storage is abstracted.

When we put the binary tree nodes into an array and move from the parent to children using indexing calculations, rather following pointers that could go anywhere, then it's an explicit part of the data structure.

Re: Static search trees: 40x faster than binary search (2024)

#17

> Input. A sorted list of 32bit unsigned integers vals: Vec . Okay, but that's not even remotely like the kind of input that this tree was created for. From the next paragraph, this work is in part > [...] to make efficient datastructures to index DNA [...]. One such datastructure is the suffix array, that sorts the suffixes of the input string. Classically, one can then find the locations where a string occurs by bi…

We often use genomic coordinates and intervals instead of the DNA strings themselves. There's a ton of genomic data out there that consists of sorted intervals.
Post reply on HN