Overture Maps Foundation releases open map dataset

Post by yencabulator » Thu, Jul 27, 2023, 11:54 PM UTC

bdon wrote: post #84

mdaniel wrote: post #27

Earlier quoted context omitted.

their demo isn't doing them any favors since it seems to stop at some random zoomlevel, eliding the kind of detail that I'd care about if I were evaluating that solution digging into their GH repos surfaces https://protomaps.github.io/PMTiles/?url=https%3A%2F%2Fr2-pu... which is at least more detailed if not quite a GMaps killer

I just updated https://protomaps.com it to use the more detailed file you found, thanks. So instead of a zoom level of 12 it should work down to 20+ - the actual dataset contains up to zoom 15, which is ~1 billion tiles in a single 110GB file. It's important to me that I showcase the system working as advertised - you are free to download the 110GB file from that static storage with no restrictions. Unfortunately, th…

Post by bdon » Fri, Jul 28, 2023, 4:40 AM UTC

metadaemon wrote: post #97

bdon wrote: post #82

Earlier quoted context omitted.

Library author here - yes, one execution happens per tile, if you have CloudFront in front those will only happen when the PoP has a miss. With 512MB RAM these generally complete in under 100ms so the unit costs of Lambda are within a few multiples of Cloudflare Workers (.5USD / million invocations)

Hey, want to say I'm super excited by protomaps. I'm struggling a bit to convert existing OSM pbf files into the pmtiles format. Specifically, I'm trying to convert this guy https://daylightmap.org/ Do you have any tips for doing so without renting memory in the cloud?

Post by bdon » Fri, Jul 28, 2023, 4:22 PM UTC

yencabulator wrote: post #104

bdon wrote: post #102

Earlier quoted context omitted.

This is Cloudflare's new blob storage product R2. Putting the free Cloudflare CDN and cache infront of R2 doesn't work with HTTP Range headers, likely for product differentiation from their Video CDN. The latency of R2 is also much higher than S3 or GCP, but I know the R2 team is working hard on improving this.

FWIW you can add your own caching logic with Workers, if the CDN for some reason doesn't do Range. The Cache API exposed to Workers is quite useful.