Live data from Hacker News

The DISTINCT in Your COUNT

boringsql.com

1–8 of 8 posts

Re: The DISTINCT in Your COUNT

#2
If you are satisfied with an approximation of "DISTINCT", there is a facinating probabilistic algorithm by Flajolet and Martin

https://en.wikipedia.org/wiki/Flajolet%E2%80%93Martin_algori...

which fits on 10 lines and does not require sorting. Improved versions of it are LogLog and HyperLogLog.

Re: The DISTINCT in Your COUNT

#4

If you are satisfied with an approximation of "DISTINCT", there is a facinating probabilistic algorithm by Flajolet and Martin https://en.wikipedia.org/wiki/Flajolet%E2%80%93Martin_algori... which fits on 10 lines and does not require sorting. Improved versions of it are LogLog and HyperLogLog.

APPROX_COUNT_DISTINCT / APPROX_DISTINCT

https://www.sketchingbigdata.org/

Re: The DISTINCT in Your COUNT

#7
I don't understand the argument that COUNT(DISTINCT ...) cannot be parallelized, but you can count distinct values in parallel using COUNT(*) GROUP BY ...

But then again the article is being accused of heavy LLM. If you notice that COUNT(DISTINCT ...) doesn't parallelize and you ask an LLM to argue why, you get easily get an article without a good thread.