Show HN: ADS-B visualizer

#1

Post by zX41ZdbW » Wed, Apr 10, 2024, 1:15 PM UTC

I've created a web app for querying and visualization of ADS-B datasets: https://adsb.exposed/

Source code: https://github.com/ClickHouse/adsb.exposed/

The results significantly exceeded my expectations because the pictures are insanely beautiful, and the data is a treasure trove.

It proves many statements that were not certain: - it is feasible to generate tiles by aggregation on a pixel level (instead of hexagons or rectangular grid); - it does not require JPG/PNG tiles - we can transfer raw bitmap data with zstd compression; - it is possible to do it in real time;

Show HN: ADS-B visualizer
adsb.exposed

Re: Show HN: ADS-B visualizer

#2

Post by systemz » Wed, Apr 10, 2024, 2:07 PM UTC

Hi, thanks for sharing! Unfortunately besides empty map I don't see any visualization. Browser dev console is showing some CORS errors.

EDIT: Nevermind, clickhouse.com was on disconnect's ad blocking list which I used for DNS blocking.

Re: Show HN: ADS-B visualizer

#3

Post by parker-3461 » Wed, Apr 10, 2024, 2:07 PM UTC

systemz wrote: post #2

Hi, thanks for sharing! Unfortunately besides empty map I don't see any visualization. Browser dev console is showing some CORS errors. EDIT: Nevermind, clickhouse.com was on disconnect's ad blocking list which I used for DNS blocking.

It seems to be all working on my end though.

Re: Show HN: ADS-B visualizer

#4

Post by panki27 » Wed, Apr 10, 2024, 2:14 PM UTC

Wow, this is beautiful!

I predict this will get a hug of death $soon

Re: Show HN: ADS-B visualizer

#5

Post by zX41ZdbW » Wed, Apr 10, 2024, 2:19 PM UTC

panki27 wrote: post #4

Wow, this is beautiful! I predict this will get a hug of death $soon

I keep the dashboard open :) So far ok with ~2000 QPS.

Re: Show HN: ADS-B visualizer

#6

Post by zX41ZdbW » Wed, Apr 10, 2024, 2:21 PM UTC

systemz wrote: post #2

Hi, thanks for sharing! Unfortunately besides empty map I don't see any visualization. Browser dev console is showing some CORS errors. EDIT: Nevermind, clickhouse.com was on disconnect's ad blocking list which I used for DNS blocking.

We bought clickhouse.com from the previous owner 2.5 years ago, who used it for some ad network - it was in some block lists, but I hope we managed to clean up most of them.

Re: Show HN: ADS-B visualizer

#7

Post by windexh8er » Wed, Apr 10, 2024, 2:23 PM UTC

This is really cool when you dig into how much fidelity there is here. Also, a fantastic marketing campaign for Clickhouse!

As for the dataset - is this continually updated or how "fresh" is it at any given moment?

Re: Show HN: ADS-B visualizer

#8

Post by underyx » Wed, Apr 10, 2024, 2:28 PM UTC

https://adsb.lol provides this data licensed under ODbL, this site violates the attribution and share alike clauses

Re: Show HN: ADS-B visualizer

#9

Post by zX41ZdbW » Wed, Apr 10, 2024, 2:29 PM UTC

windexh8er wrote: post #7

This is really cool when you dig into how much fidelity there is here. Also, a fantastic marketing campaign for Clickhouse! As for the dataset - is this continually updated or how "fresh" is it at any given moment?

There are two data sources: adsb.lol and adsbexchange. The first is updated each day from https://github.com/adsblol/globe_history_2024. The second should be updated each month (they provide only sample data for the first day of each month), but I still have to put it in cron.

The update scripts are also open-source, published here: https://github.com/ClickHouse/adsb.exposed/blob/main/prepare...

Re: Show HN: ADS-B visualizer

#10

Post by Solvency » Wed, Apr 10, 2024, 2:31 PM UTC

systemz wrote: post #2

Hi, thanks for sharing! Unfortunately besides empty map I don't see any visualization. Browser dev console is showing some CORS errors. EDIT: Nevermind, clickhouse.com was on disconnect's ad blocking list which I used for DNS blocking.

fully empty map on iOS safari for me.