Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Dataset Search

toolbox.google.com

Post reply on HN
Print view View original

41–50 of 81 posts

Re: Google Dataset Search

#41

Post by ramfox »

heinrichhartman wrote: post #32
heinrichhartman wrote: post #31

Earlier quoted context omitted.

That looks interesting. IPFS backed -- nice. A web interface would be nice so that I don't have to install a tool to browse the content. Going to give it a shot non-theless.

Hmm: "Qri backend is unavailable". Going to come back tomorrow.

Hey! thanks for checking us out. If you are still having trouble, please head over to our github (http://www.github.com/qri-io/frontend) and I'd be happy to help out.

You would be doing us a huge solid, working through these use cases irl is beyond helpful.

Re: Google Dataset Search

#42

Post by wiredfool »

handelaar wrote: post #29
wiredfool wrote: post #5

Earlier quoted context omitted.

https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)

I'm a particular fan of the boundary "dataset" you have that's a low-resolution TIFF file. (edit to add something more productive: the site is littered to the tune of at least 25% and maybe even a third with junk "data", all obviously added to get the number of records as high as possible, with no regard to whether that data is either useful to anybody, is machine-readable in any way at all, or even -- in the example…

The quality of the datasets varies greatly depending on the source. Some work well, some, less so. There are data sources that are undergoing active development to harvest them more accurately. None of them were added to pump up the numbers.

The biggest numbers bump recently was ca 1600 Met Eireann rainfall records datasets from all around the country, some of them daily rainfall dating back 60 years. (Spoiler, there’s a lot of rain)

This is specifically a catalog of data sets, it doesn’t host the data except for previews, and even doing that is pretty complicated in all its glory.

Re: Google Dataset Search

#43

Post by wiredfool »

eruci wrote: post #34
wiredfool wrote: post #5

Earlier quoted context omitted.

https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)

Are you going to release any street address datasets at some point?

I believe that the eircode dataset is one of the most highly requested sources, but it’s a private for profit database.

If you are aware of such a dataset that a public body is hosting, then it would certainly be something to include. Convincing (and helping) the public bodies to publish their data is still a big task.

Re: Google Dataset Search

#45

Post by danso »

philipashlock wrote: post #11
danso wrote: post #2

Very nice. Worth keeping in mind prior examples for comparison's sake. My favorites so far: - https://www.opendatanetwork.com -- what I would call the "Google, for Socrata datasets" - https://public.enigma.com/ -- One of the best collections of U.S. federal data, with good taxonomy and lots of useful options for refining a search, such as filtering by dataset size. - https://www.data.gov/ -- Not as useful as what mos…

@danso thanks for the feedback on data.gov. I'm part of the small (3 person) team that helps to manage it. If you have a moment to chat I'll see if I can reach out to you to see if you'd be interested in participating in some more in-depth user research in the future. Folks can also always leave feedback via email, github, twitter, and other means - https://www.data.gov/contact The Federal Data Strategy will also be…

Definitely, feel free to email me (in my user bio). Thanks for the info about the upcoming comment period, will have to put a reminder on my calendar for that.

Re: Google Dataset Search

#47

Post by izyda »

thebooglebooski wrote: post #37
philipashlock wrote: post #11

Earlier quoted context omitted.

@danso thanks for the feedback on data.gov. I'm part of the small (3 person) team that helps to manage it. If you have a moment to chat I'll see if I can reach out to you to see if you'd be interested in participating in some more in-depth user research in the future. Folks can also always leave feedback via email, github, twitter, and other means - https://www.data.gov/contact The Federal Data Strategy will also be…

I think the biggest blocker with using publicly available datasets is stale data. If you, or anyone else who aggregates these datasets could make it EASY to find the FREQUENCY of updates, rather than just the LAST UPDATED timestamp, it'd incentivize people to consume APIs more. I realize having a snapshot from 2014 is better than what was publicly available before. But I feel no one's really talked about why they wou…

I think this is exactly correct. Frequency of updates (and clear documentation of the lag relationship between when data is reported and for what period data is applicable too) is often missing or hard to find.

The value of increasing the cadence of updates should also not be understated! A lot of public dataset report on annual frequencies with more than a quarter of delay... Although this is a different issue altogether that has more to do with the processes of the reporting agency.

Re: Google Dataset Search

#48

Post by Untit1ed »

danso wrote: post #2

Very nice. Worth keeping in mind prior examples for comparison's sake. My favorites so far: - https://www.opendatanetwork.com -- what I would call the "Google, for Socrata datasets" - https://public.enigma.com/ -- One of the best collections of U.S. federal data, with good taxonomy and lots of useful options for refining a search, such as filtering by dataset size. - https://www.data.gov/ -- Not as useful as what mos…

Blatantly self-promoting, but we (in Australia) are trying to develop a general solution for better open data search over at https://search.data.gov.au - solution is all open source at https://github.com/magda-io/magda.

Re: Google Dataset Search

#50

Post by snaily »

fnord123 wrote: post #35
wiredfool wrote: post #5

Earlier quoted context omitted.

https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)

Playing around, a lot of countries use this url scheme: https://data.gov.be http://data.gov.ro/ https://www.dati.gov.it/ (note, Italy redirects data. to dati.) https://data.gov.pl/ https://data.gov.za/ (South Africa's has a cert problem) https://data.gov.in https://data.gov.au/ https://datos.gob.mx/

https://data.gov.sg/ (Singapore)
Post reply on HN