Makes me wonder which data structures have "parallel" versions besides the two mentioned.
Topics in Advanced Data Structures [pdf]
41–50 of 89 posts
Re: Topics in Advanced Data Structures [pdf]
#42Does anyone in their work find that they are able to employ data structures like this, and if so, what do you work on? I've almost always had to delegate all my state to a database using default indexes, etc., which is productive, yet a little disappointing, because I'm always applying my brain power instead toward more mundane tasks.
I will also point out that when you view the problem of data structures as an implementation that solves various queries, you can start building tools that automate the implementation of complex data structures given the queries you want to ask the data structure. I fully expect to see these tools start to become available over the next decade or so, given the current progress of program synthesis I see in the academic literature.
[1] Or insert, delete, or update. But usually you already have the record at that point, and you just want to update the data structure's representation of that record.
[2] You can apply the same techniques to cache access and even vector register usage for purely in-memory data structures. Same problem, just with different sizes of disparity.
Re: Topics in Advanced Data Structures [pdf]
#43Re: Topics in Advanced Data Structures [pdf]
#44Earlier quoted context omitted.
I do plasma simulations and recently had the problem of finding the distance to the nearest neighbor for every of the particles in the simulation. Doing that naively is O(n^2) and took hours even for small test problems. Building an R-tree once and using if for nearest-neighbor look-ups brought that down to 5 minutes. libspatialindex lacks documentation, but worked really nicely. The rtree interface in python is much…
I'm curious, how many particles do your simulations typically contain?
The thing I was working on when I switched from naive O(n^2) to R-trees had half a million (5e5) particles.
Re: Topics in Advanced Data Structures [pdf]
#45Please provide the solutions in git repo. Thanks.
Re: Topics in Advanced Data Structures [pdf]
#46Does anyone in their work find that they are able to employ data structures like this, and if so, what do you work on? I've almost always had to delegate all my state to a database using default indexes, etc., which is productive, yet a little disappointing, because I'm always applying my brain power instead toward more mundane tasks.
I do plasma simulations and recently had the problem of finding the distance to the nearest neighbor for every of the particles in the simulation. Doing that naively is O(n^2) and took hours even for small test problems. Building an R-tree once and using if for nearest-neighbor look-ups brought that down to 5 minutes. libspatialindex lacks documentation, but worked really nicely. The rtree interface in python is much…
If you only build the tree once and do no insertions what is the benefit of an R-Tree vs KDTree?
Re: Topics in Advanced Data Structures [pdf]
#47Does anyone in their work find that they are able to employ data structures like this, and if so, what do you work on? I've almost always had to delegate all my state to a database using default indexes, etc., which is productive, yet a little disappointing, because I'm always applying my brain power instead toward more mundane tasks.
Re: Topics in Advanced Data Structures [pdf]
#48Earlier quoted context omitted.
I do plasma simulations and recently had the problem of finding the distance to the nearest neighbor for every of the particles in the simulation. Doing that naively is O(n^2) and took hours even for small test problems. Building an R-tree once and using if for nearest-neighbor look-ups brought that down to 5 minutes. libspatialindex lacks documentation, but worked really nicely. The rtree interface in python is much…
I’m taking Advanced Data Structures at UCSD right now and our first assignment was making a K-D Tree and an efficient KNN Classifier. It was surprisingly simple and the efficiency between the KD Tree and brute force implementation was quite drastic. If you only build the tree once and do no insertions what is the benefit of an R-Tree vs KDTree?
Re: Topics in Advanced Data Structures [pdf]
#49I was going to roll my eyes about stuff no one will ever hear of, much less use in their day job, but there are some really relevant structures here. Finger trees, cache-oblivious structures, R-trees, etc., just to name a couple from a random page or two. The "why they're worth studying" summaries are gold. Thanks!
Re: Topics in Advanced Data Structures [pdf]
#50Does anyone in their work find that they are able to employ data structures like this, and if so, what do you work on? I've almost always had to delegate all my state to a database using default indexes, etc., which is productive, yet a little disappointing, because I'm always applying my brain power instead toward more mundane tasks.
But then life changes and you may find yourself in need of this knowledge. I used to laugh at graph algorithm questions on interviews because I never directly used a graph in 20 years of SWE. Then I got a job where I am on a team maintaining a graph-based API. Jokes on me, now those 'silly' algorithms are very relevant.