Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Overture Maps Foundation releases open map dataset

overturemaps.org

Post reply on HN
Print view View original

81–90 of 105 posts

Re: Overture Maps Foundation releases open map dataset

#81

Post by claytongulick »

tony_cannistra wrote: post #9

For context, Overture Maps is a project that intends to enable large players in the geospatial space (TomTom, Amazon, Microsoft, but notably _not_ Google) to leverage open data sets (OpenStreetMap among them) alongside proprietary data and processes that they own. The consortium intends to enable a framework for enhancing geospatial data based in open data sets (e.g. OSM) with their own proprietary processes, and re-…

It would be super helpful if they at least released the name of their data sources.

The places layer would be invaluable for (for example, stuff I'm working on now) geospatial healthcare access analytics if I could rely on the places being a reasonably accurate source of provider locations.

It's a lot of work to tie all the CMS data with health plan data etc.. and then to geocode it all with OSM tiger geocoders. If I could rely on that data already being present and scrubbed, it would be a godsend.

Re: Overture Maps Foundation releases open map dataset

#82

Post by bdon »

simmschi wrote: post #34
joshstrange wrote: post #23

If you are looking for maps themselves (a la Google Maps) I highly recommend checking out Protomaps [0]. It provides a single file (PMTile format) that contains all the map data and you can request ranges from the single file to get the required vector data you need for a given area/zoom. So you can setup something like the following: S3 (host the myfile.pmtiles) Then you can setup tiles.mydomain.com (or use the clou…

So one Lambda execution per tile?

Library author here - yes, one execution happens per tile, if you have CloudFront in front those will only happen when the PoP has a miss.

With 512MB RAM these generally complete in under 100ms so the unit costs of Lambda are within a few multiples of Cloudflare Workers (.5USD / million invocations)

Re: Overture Maps Foundation releases open map dataset

#83

Post by mdaniel »

nine_k wrote: post #80
mdaniel wrote: post #74

Earlier quoted context omitted.

> I don't understand why big corporations find it so hard to see that the real potential in AI is usually in augmenting, not _replacing_, human labor IMHO because now I have twice as much work: knowing the problem domain and reviewing someone else's contribution. It's like code review 24/7 from untrusted contributors: it requires more focus than just trying to understand and author the original contribution

Not entirely like that; it's mostly fixing small edge cases when the bulk of the work has been done correctly. Think about e.g. automatic background removal from photos: most of the time you only need to introduce small corrections, instead of painstakingly tracing shapes by hand. But without these corrections the results are often slightly but visibly incorrect.

> Not entirely like that; it's mostly fixing small edge cases when the bulk of the work has been done correctly

Well, I guess one can just continue to prompt any such AI over and over "have you done it correctly? No? Then try harder"

I recognize that my experiences and expectations from AI differ from seemingly the vast majority of users who get benefit from it. I'm glad for them, but I don't ever want to opt-in to having "AI assistance" because with the current state of the art it generates more work for me than value in my life

Re: Overture Maps Foundation releases open map dataset

#84

Post by bdon »

mdaniel wrote: post #27
joshstrange wrote: post #23

If you are looking for maps themselves (a la Google Maps) I highly recommend checking out Protomaps [0]. It provides a single file (PMTile format) that contains all the map data and you can request ranges from the single file to get the required vector data you need for a given area/zoom. So you can setup something like the following: S3 (host the myfile.pmtiles) Then you can setup tiles.mydomain.com (or use the clou…

their demo isn't doing them any favors since it seems to stop at some random zoomlevel, eliding the kind of detail that I'd care about if I were evaluating that solution digging into their GH repos surfaces https://protomaps.github.io/PMTiles/?url=https%3A%2F%2Fr2-pu... which is at least more detailed if not quite a GMaps killer

I just updated https://protomaps.com it to use the more detailed file you found, thanks. So instead of a zoom level of 12 it should work down to 20+ - the actual dataset contains up to zoom 15, which is ~1 billion tiles in a single 110GB file.

It's important to me that I showcase the system working as advertised - you are free to download the 110GB file from that static storage with no restrictions. Unfortunately, the demo is slow because I'm hosting it on Cloudflare R2 which has no outgoing bandwidth fees. Before, it was on DigitalOcean Spaces, which is low latency but would cost me $1-2 out of my own pocket each time someone clicked the link.

The Lambda/Workers integration as described in the other comment is the preferred solution to this for developers operating this at planet scale. Of course, the static storage solution is perfect for small to medium-sized areas, even on GitHub Pages.

Re: Overture Maps Foundation releases open map dataset

#85

Post by bdon »

wiredfool wrote: post #40
simmschi wrote: post #34

Earlier quoted context omitted.

So one Lambda execution per tile?

It shouldn’t be required if the range requests are right and you have a compatible renderer in the client. To expand a bit -- There are adapters for mapbox(gl/libre) and leaflet, and so on that will allow you to use a .pmtiles directly from the client with a range request supporting server, like s3 or nginx. I've used protomaps basemaps to generate an Ireland and EU basemaps for a project from OSM data. I still haven…

The transformation of OpenStreetMap features into the basemap is open source and available under a permissive license now at http://github.com/protomaps/basemaps

This is the focus of most development for the next few months - like you said, it's also a matter of aesthetics and context, like if the map is underlying another PMTiles data layer it should be lower contrast then if it's overlaid with pin markers. The end goal is to have a flexible basemap solution adaptable to most apps but you are free to roll your own proprietary style on top of the open source tiles if you'd like (there are already companies doing this)

Re: Overture Maps Foundation releases open map dataset

#86

Post by uneekname »

Doctor_Fegg wrote: post #65
uneekname wrote: post #29

Earlier quoted context omitted.

Editing OpenStreetMap isn't quite equivalent to commenting on a post. OSM allows you to edit anything, which is fantastic but also allows for more serious vandalism. We have seen major cities renamed to racial slurs, for example. As with Wikipedia, the community is generally very good about correcting these issues quickly. It's an uncommon problem that a lot of people work to mitigate. But I stand by what I said: van…

> We have seen major cities renamed to racial slurs, for example. Once in 19 years, I think? It’s not great but let’s not pretend it’s more of a problem than it is.

No, it's not a huge issue within the OSM community. But surely you see why it's an issue for large companies looking to use the OSM basemap in their projects.

Re: Overture Maps Foundation releases open map dataset

#87

Post by jmye »

claytongulick wrote: post #81
tony_cannistra wrote: post #9

For context, Overture Maps is a project that intends to enable large players in the geospatial space (TomTom, Amazon, Microsoft, but notably _not_ Google) to leverage open data sets (OpenStreetMap among them) alongside proprietary data and processes that they own. The consortium intends to enable a framework for enhancing geospatial data based in open data sets (e.g. OSM) with their own proprietary processes, and re-…

It would be super helpful if they at least released the name of their data sources. The places layer would be invaluable for (for example, stuff I'm working on now) geospatial healthcare access analytics if I could rely on the places being a reasonably accurate source of provider locations. It's a lot of work to tie all the CMS data with health plan data etc.. and then to geocode it all with OSM tiger geocoders. If I…

Your project is really interesting to me - are you just looking at the physical buildings (e.g. you have 5 urgent cares within X distance), or are you trying to cross-reference provider data to number doctors/specialties? Or something else entirely?

Totally understand if you can’t discuss (or don’t want to), but it’s in my domain and I’ve spent a fair amount of time thinking about how to do it without coming up with much, so I’m super curious about your thoughts.

Re: Overture Maps Foundation releases open map dataset

#89

Post by antod »

divbzero wrote: post #30

Between this, Natural Earth, OpenStreetMap, USGS, and others, the availability of map data today would be stunning to early cartographers.

I tried my hand at pulling data from opentopology recently to use in blender and thought it was an amazing source of data for my country - I later realised that it seems like only the US and NZ are well represented there though (guess I was just lucky - thank you LINZ).

Re: Overture Maps Foundation releases open map dataset

#90

Post by matkoniecz »

culi wrote: post #72
RicoElectrico wrote: post #52

Earlier quoted context omitted.

Another bit of context: OSM mappers were quite discontent with edits of many of Overture members. Be it low-paid contractors or bulk importing stuff that AI derived from satellite imagery.

Do you know when these contributions began? Has the scene changed much since then?

First known corporation detected by https://piebro.github.io/openstreetmap-statistics/#b34d was in 2008.
Post reply on HN