It's a bit bothersome they nudge you to install and use aws tools to download the data, instead of providing a plain CSV or JSON downloadable dump instead.
Foursquare Open Source Places: A new foundational dataset
31–36 of 36 posts
Re: Foursquare Open Source Places: A new foundational dataset
#32[dead]
Re: Foursquare Open Source Places: A new foundational dataset
#33It's a bit bothersome they nudge you to install and use aws tools to download the data, instead of providing a plain CSV or JSON downloadable dump instead.
It's S3 so this works to list the bucket contents:
curl -s "https://fsq-os-places-us-east-1.s3.amazonaws.com/?list-type=2&prefix=release/dt=2024-11-19/places/parquet/&delimiter=/"
curl -O "https://fsq-os-places-us-east-1.s3.amazonaws.com/release/dt=2024-11-19/places/parquet/places-00000.snappy.parquet"Re: Foursquare Open Source Places: A new foundational dataset
#34I used to work for Nokia Maps (before it was renamed Here Maps) working on their places registry, which was a proprietary data set compiled from various sources of data with a similar amount of places. It was really messy data. Lots of duplicates, lots of stale data, lots of misleading data (e.g. hotels claiming to be right on the beach that in reality were a few kilometers away), etc. Part of my job was cleaning tha…
To be honest, this problem is unsolvable. The only API that's closest is Google Maps, I've just accepted it and gone all-in with them.
Re: Foursquare Open Source Places: A new foundational dataset
#35It's a bit bothersome they nudge you to install and use aws tools to download the data, instead of providing a plain CSV or JSON downloadable dump instead.
I mean not really, why would you want to direct download a CSV or JSON dump this big
Re: Foursquare Open Source Places: A new foundational dataset
#36It's a bit bothersome they nudge you to install and use aws tools to download the data, instead of providing a plain CSV or JSON downloadable dump instead.
I also found it hard to deal with the AWS CLI and Parquet.
I built this site so you can download it in CSV and Geopackage.