Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Overture Maps Foundation releases open map dataset

overturemaps.org

Post reply on HN
Print view View original

11–20 of 105 posts

Re: Overture Maps Foundation releases open map dataset

#11

Post by justinclift »

tony_cannistra wrote: post #7
dhx wrote: post #3

I have an interest in this topic as a contributor to AllThePlaces[1], an open source project collating Scrapy spiders (MIT license) that crawl websites of franchises/retail chains that you'd find listed in name-suggestion-index[2] to retrieve location data (CC-0 license). The project is just short of collecting 3 million points of interest from almost 1700 spiders. Overture Maps appears to be quite a closed and propr…

> 2. There is no published tooling for how someone else can reproduce the same data. This is true, and is actually the whole point of Overture. Overture was developed to enable private companies to leverage open data (like OpenStreetMap) but also combine it with their proprietary data and processes. The intention is to share the result with a relatively permissive license (a new thing called the Community Database Li…

Sounds like that's going to be a problem for proving/reproducing results independently then. :(

Re: Overture Maps Foundation releases open map dataset

#12

Post by uneekname »

tony_cannistra wrote: post #7
dhx wrote: post #3

I have an interest in this topic as a contributor to AllThePlaces[1], an open source project collating Scrapy spiders (MIT license) that crawl websites of franchises/retail chains that you'd find listed in name-suggestion-index[2] to retrieve location data (CC-0 license). The project is just short of collecting 3 million points of interest from almost 1700 spiders. Overture Maps appears to be quite a closed and propr…

> 2. There is no published tooling for how someone else can reproduce the same data. This is true, and is actually the whole point of Overture. Overture was developed to enable private companies to leverage open data (like OpenStreetMap) but also combine it with their proprietary data and processes. The intention is to share the result with a relatively permissive license (a new thing called the Community Database Li…

Yes, exactly. Overture is, for better or worse, looking to create a dataset that is more difficult to mess with / contribute to.

I'm big on OpenStreetMap, but I can't deny its a bit of a liability for Facebook and other companies that display maps to their users. There is the occasional vandalism edit that simply can't be shown to an end-user. Facebook put significant effort into maintaining a moderated version of the OSM database that lags behind the real-time edits. Facebook, Microsoft, TomTom, etc. know this is a ton of work and want to pool their resources. Making it open also helps to openly compete with Google, the other big map data provider.

If you want to contribute to Overture as an end-user, AFAICT your best option is to edit OpenStreetMap and see if your changes eventually get pulled in. Overture has promised the OSM community that they'll make much of their data available to be contributed back, we'll see if that pans out.

When it comes to AllThePlaces -- as an OSM nerd it seems like there is an opportunity to build a better bridge between this and OpenStreetMap, to make it easier to quickly update businesses in an area. Recently there has been a pretty successful push to link OSM data with WikiData, using tools like the OSM ↔ Wikidata matcher [0]. For POIs, it's a lot of work to add a bunch of local businesses, even with tools like EveryDoor [1]. It would be so cool to see AllThePlaces integration into RapID for example, if there isn't already(?)

[0] https://osm.wikidata.link/

[1] https://every-door.app/

Re: Overture Maps Foundation releases open map dataset

#13

Post by teddyh »

uneekname wrote: post #12
tony_cannistra wrote: post #7

Earlier quoted context omitted.

> 2. There is no published tooling for how someone else can reproduce the same data. This is true, and is actually the whole point of Overture. Overture was developed to enable private companies to leverage open data (like OpenStreetMap) but also combine it with their proprietary data and processes. The intention is to share the result with a relatively permissive license (a new thing called the Community Database Li…

Yes, exactly. Overture is, for better or worse, looking to create a dataset that is more difficult to mess with / contribute to. I'm big on OpenStreetMap, but I can't deny its a bit of a liability for Facebook and other companies that display maps to their users. There is the occasional vandalism edit that simply can't be shown to an end-user. Facebook put significant effort into maintaining a moderated version of th…

> There is the occasional vandalism edit that simply can't be shown to an end-user.

I remember the same sort of arguments being made about how web sites could not possibly ever accept user comments or submissions, or could not ever risk having users sending links to one another. Those all proved to be false.

Re: Overture Maps Foundation releases open map dataset

#14

Post by stderrout »

tony_cannistra wrote: post #7
dhx wrote: post #3

I have an interest in this topic as a contributor to AllThePlaces[1], an open source project collating Scrapy spiders (MIT license) that crawl websites of franchises/retail chains that you'd find listed in name-suggestion-index[2] to retrieve location data (CC-0 license). The project is just short of collecting 3 million points of interest from almost 1700 spiders. Overture Maps appears to be quite a closed and propr…

> 2. There is no published tooling for how someone else can reproduce the same data. This is true, and is actually the whole point of Overture. Overture was developed to enable private companies to leverage open data (like OpenStreetMap) but also combine it with their proprietary data and processes. The intention is to share the result with a relatively permissive license (a new thing called the Community Database Li…

Wonder what could be reasoning behind this. Is it they dont want disclose data collection practices or cant do from legal points.

Things like it could come from alexa, pc or any devices devices with forced opt ins that keep scanning all your neighbours wifi networks and mac addresses.

Believe there was also an initiative where amazon devices will provide adhoc internet connectivity by piggy backing on other amazon devices on different networks with connectivity.

So all the openness but without any controls. There should already be a better term for things like this.

Re: Overture Maps Foundation releases open map dataset

#15

Post by sneak »

teddyh wrote: post #13
uneekname wrote: post #12

Earlier quoted context omitted.

Yes, exactly. Overture is, for better or worse, looking to create a dataset that is more difficult to mess with / contribute to. I'm big on OpenStreetMap, but I can't deny its a bit of a liability for Facebook and other companies that display maps to their users. There is the occasional vandalism edit that simply can't be shown to an end-user. Facebook put significant effort into maintaining a moderated version of th…

> There is the occasional vandalism edit that simply can't be shown to an end-user. I remember the same sort of arguments being made about how web sites could not possibly ever accept user comments or submissions, or could not ever risk having users sending links to one another. Those all proved to be false.

There are many links to legal content that Instagram and FB messenger will not allow you to send to your friends, so I'm not sure how vindicated you are.

Re: Overture Maps Foundation releases open map dataset

#17

Post by OfSanguineFire »

teddyh wrote: post #13
uneekname wrote: post #12

Earlier quoted context omitted.

Yes, exactly. Overture is, for better or worse, looking to create a dataset that is more difficult to mess with / contribute to. I'm big on OpenStreetMap, but I can't deny its a bit of a liability for Facebook and other companies that display maps to their users. There is the occasional vandalism edit that simply can't be shown to an end-user. Facebook put significant effort into maintaining a moderated version of th…

> There is the occasional vandalism edit that simply can't be shown to an end-user. I remember the same sort of arguments being made about how web sites could not possibly ever accept user comments or submissions, or could not ever risk having users sending links to one another. Those all proved to be false.

> I remember the same sort of arguments being made about how web sites could not possibly ever accept user comments or submissions

The heyday of comments sections on news websites is now in the past. Not long ago, Lonely Planet took down its renowned Thorn Tree forums, which had been a big part of the travel internet since the 1990s. Friends who run a major website for a particular hobby told me that they canceled their plans to launch a forum, since their site is advertising-supported and a forum could damage their relationships with advertisers.

Reliable moderation costs money, and if you don’t moderate heavily enough, you’re going to get user comments that tarnish your brand (or at least scare execs into thinking that the brand will be tarnished).

Re: Overture Maps Foundation releases open map dataset

#18

Post by teddyh »

sneak wrote: post #15
teddyh wrote: post #13

Earlier quoted context omitted.

> There is the occasional vandalism edit that simply can't be shown to an end-user. I remember the same sort of arguments being made about how web sites could not possibly ever accept user comments or submissions, or could not ever risk having users sending links to one another. Those all proved to be false.

There are many links to legal content that Instagram and FB messenger will not allow you to send to your friends, so I'm not sure how vindicated you are.

That’s more of an indictment of Meta than an argument against uncensored user-to-user communication.

Re: Overture Maps Foundation releases open map dataset

#19

Post by matkoniecz »

uneekname wrote: post #12
tony_cannistra wrote: post #7

Earlier quoted context omitted.

> 2. There is no published tooling for how someone else can reproduce the same data. This is true, and is actually the whole point of Overture. Overture was developed to enable private companies to leverage open data (like OpenStreetMap) but also combine it with their proprietary data and processes. The intention is to share the result with a relatively permissive license (a new thing called the Community Database Li…

Yes, exactly. Overture is, for better or worse, looking to create a dataset that is more difficult to mess with / contribute to. I'm big on OpenStreetMap, but I can't deny its a bit of a liability for Facebook and other companies that display maps to their users. There is the occasional vandalism edit that simply can't be shown to an end-user. Facebook put significant effort into maintaining a moderated version of th…

> It would be so cool to see AllThePlaces integration into RapID for example, if there isn't already(?)

Part of the problem is not entirely clear copyright/copyright-like status of this dataset. Thanks to https://en.wikipedia.org/wiki/Database_right and similar things (in general OSM is really careful with legal status of datasets being imported).

Re: Overture Maps Foundation releases open map dataset

#20

Post by dhx »

tony_cannistra wrote: post #7
dhx wrote: post #3

I have an interest in this topic as a contributor to AllThePlaces[1], an open source project collating Scrapy spiders (MIT license) that crawl websites of franchises/retail chains that you'd find listed in name-suggestion-index[2] to retrieve location data (CC-0 license). The project is just short of collecting 3 million points of interest from almost 1700 spiders. Overture Maps appears to be quite a closed and propr…

> 2. There is no published tooling for how someone else can reproduce the same data. This is true, and is actually the whole point of Overture. Overture was developed to enable private companies to leverage open data (like OpenStreetMap) but also combine it with their proprietary data and processes. The intention is to share the result with a relatively permissive license (a new thing called the Community Database Li…

Wouldn't the closed processes and underlying data severely limit communities such as OSM from using Overture Maps results for anything other than a validation of what OSM already knows from other sources?

Perhaps Overture Maps has used impressively accurate satellite imagery tracing to detect the demolition and rebuild of a structure somewhere in Sudan, and can output a new polygon. No OSM mapper is setting foot in Sudan, and recent satellite imagery for the area is not available through companies that share such data for OSM use.

The issue for an OSM mapper who sees the conflict between OSM (with the old building) and Overture Maps (with the new building) is they don't have any information to know which result is accurate. Is OSM just out of date? Has Overture Maps produced the result from outdated satellite imagery and OSM is more up-to-date? Is the result form Overture Maps the result of a mistake in an automated tracing algorithm?

Post reply on HN