Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Dataset Search

toolbox.google.com

Post reply on HN
Print view View original

61–70 of 81 posts

Re: Google Dataset Search

#61

Post by Moghammed »

fnord123 wrote: post #35
wiredfool wrote: post #5

Earlier quoted context omitted.

https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)

Playing around, a lot of countries use this url scheme: https://data.gov.be http://data.gov.ro/ https://www.dati.gov.it/ (note, Italy redirects data. to dati.) https://data.gov.pl/ https://data.gov.za/ (South Africa's has a cert problem) https://data.gov.in https://data.gov.au/ https://datos.gob.mx/

https://data.overheid.nl/

Re: Google Dataset Search

#64

Post by lolive »

MrEfficiency wrote: post #16

What is the best way for a website to format data to the public? I already have my presentation, but I can also provide it as a .xls, .csv, sql, or html table. What would be best to help programmers/data scientists use my data?

CSV is your best option. CSVW is a CSV+a metadata file to convert the tabular data to graph data (plus it types the nodes and relationships of the graph). You may want to have a look at it.

Re: Google Dataset Search

#65

Post by rxdazn »

heinrichhartman wrote: post #20

The state of data sharing seems to be still quite sad. * Hosting problems. The first link I tried was already broken. * Format problems. Also the presented data is in all kinds of formats, some "data sets" even require me to read data off images: https://www.ceicdata.com/en/indicator/germany/gdp-per-capita And even if it's JSON, this is not particularly great either (Unicode support? Large (64bit) integers?). * Updat…

Open Data portals powered by OpenDataSoft let you see/sort/filter/visualize data in your browser. You can access the data via API (including sorting/filtering) or download static files (CSV/JSON/XLS etc.).

I haven't seen many other platforms offer the same kind of functionality.

e.g This one is a dataset of CCTVs across Leicester. You can easily see all of the columns, sort data around, display a chart of camera types, see their location on a map etc.

https://data.opendatasoft.com/explore/dataset/cctv-cameras%4...

Screenshots: https://postimg.cc/gallery/j5e5thv2/

A few portals powered by them:

- Paris https://opendata.paris.fr/explore/

- Mannheim https://mannheim.opendatasoft.com/page/home/

- Durham NC https://opendurham.nc.gov/pages/home/

disclaimer: I was an intern there 4 years ago

Re: Google Dataset Search

#66

Post by lolive »

combatentropy wrote: post #33
MrEfficiency wrote: post #16

What is the best way for a website to format data to the public? I already have my presentation, but I can also provide it as a .xls, .csv, sql, or html table. What would be best to help programmers/data scientists use my data?

I vote CSV. - simple - lightweight - open It's easy for the consumer of your data to convert a CSV to whatever format they need. - spreadsheet, for personal analysis - SQL database, for industrial-strength analysis - HTML, for pretty output to their users

Oh, and don't forget that CSV is a rigorous data format, with many tricks. Don't just append some text together, separated by commas, and call it CSV. Instead, use a dedicated lib to create the CSV for you.

Re: Google Dataset Search

#67

Post by lolive »

MrEfficiency wrote: post #16

What is the best way for a website to format data to the public? I already have my presentation, but I can also provide it as a .xls, .csv, sql, or html table. What would be best to help programmers/data scientists use my data?

You probably ask here the most controversial question of the Web today. The fact that CSV is the prefered answer is a HUUUGE fail.

Re: Google Dataset Search

#70

Post by rufuspollock »

MrEfficiency wrote: post #16

What is the best way for a website to format data to the public? I already have my presentation, but I can also provide it as a .xls, .csv, sql, or html table. What would be best to help programmers/data scientists use my data?

Suggest CSV plus a Table Schema in a nice little Data Package: https://frictionlessdata.io/data-packages/

There's a wide set of tooling for Tabular Data Packages, plus underlying data is CSV which anyone can use.

If you want this done automatically you can just publish your CSV to https://datahub.io/ and your Tabular Data Package is made automatically for you.

Post reply on HN