Most of them are paid.
Google Dataset Search
51–60 of 81 posts
Re: Google Dataset Search
#52Earlier quoted context omitted.
https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)
Playing around, a lot of countries use this url scheme: https://data.gov.be http://data.gov.ro/ https://www.dati.gov.it/ (note, Italy redirects data. to dati.) https://data.gov.pl/ https://data.gov.za/ (South Africa's has a cert problem) https://data.gov.in https://data.gov.au/ https://datos.gob.mx/
https://www.data.gouv.fr (France)
Re: Google Dataset Search
#53Looks like this doesn’t crawl one of the most important source for data: academic torrents. For example, I searched for
ilsvrc lmdb
This should have found imagenet data in lmdb format available somewhere but it returned no results.
Re: Google Dataset Search
#54Nice to see Google trying this again!
It's one of those areas they have long attempts at involvement in - e.g. Google Public Data Explorer which never quite reached it's potential, and Freebase which although flawed was good and was shut down after Google acquired it.
I like that this is search based! The web is still the best place to publish data - in fact in my view normal Google search is still by far the best way to find datasets, even though it isn't directly designed for that.
There's a link from the about page of Google Dataset Search to this help for webmasters on how to mark up content for it - although it is a bit odd, mainly showing how to mark a dataset with a DOI (so good for academics certainly!):
https://productforums.google.com/forum/#!topic/webmasters/nP...
Just metadata about data feels like a very niche thing to search to me - I'm still not convinced anyone will maintain the metadata well enough to help. Possibly will work in particular domains.
Does Dataset Search have some way to search column headings, types or content (of CSV, Excel, JSON etc)? I can imagine a load of operators that would make that really powerful for finding badly meta-marked up datasets deep in the web. Would seem like the obvious extra thing a dataset search would do.
Also previews please!!! Just nicely render the fist ten rows of common formats - CSV and Excel to begin with.
What part of Google is doing this?
Re: Google Dataset Search
#55Earlier quoted context omitted.
https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)
Playing around, a lot of countries use this url scheme: https://data.gov.be http://data.gov.ro/ https://www.dati.gov.it/ (note, Italy redirects data. to dati.) https://data.gov.pl/ https://data.gov.za/ (South Africa's has a cert problem) https://data.gov.in https://data.gov.au/ https://datos.gob.mx/
https://www.data.gv.at/ (Austria)
Re: Google Dataset Search
#56Earlier quoted context omitted.
I think the biggest blocker with using publicly available datasets is stale data. If you, or anyone else who aggregates these datasets could make it EASY to find the FREQUENCY of updates, rather than just the LAST UPDATED timestamp, it'd incentivize people to consume APIs more. I realize having a snapshot from 2014 is better than what was publicly available before. But I feel no one's really talked about why they wou…
I think this is exactly correct. Frequency of updates (and clear documentation of the lag relationship between when data is reported and for what period data is applicable too) is often missing or hard to find. The value of increasing the cadence of updates should also not be understated! A lot of public dataset report on annual frequencies with more than a quarter of delay... Although this is a different issue altog…
Yes, it's interesting how much difference the data about data management can make in people's engagement with the platform.
Re: Google Dataset Search
#57Earlier quoted context omitted.
Are you going to release any street address datasets at some point?
I believe that the eircode dataset is one of the most highly requested sources, but it’s a private for profit database. If you are aware of such a dataset that a public body is hosting, then it would certainly be something to include. Convincing (and helping) the public bodies to publish their data is still a big task.
I believe that An Post built a similar system many moons ago, and they should presumably be more amenable to open-sourcing.
The handling of the whole Eircode thing makes my blood boil, to be honest.
Re: Google Dataset Search
#58Google is so damn bad on UX. An excellent example of interaction of unlimited ressources and priorities.
Re: Google Dataset Search
#59You may want to try [https://data.opendatasoft.com](https://data.opendatasoft.com... -- thousands of datasets available through the same API, usable online, no download required.
Re: Google Dataset Search
#60Earlier quoted context omitted.
https://data.gov.ie —- this is a repository of a bunch of the open data produced in the Irish public sector. (Disclosure, I work on this)
Playing around, a lot of countries use this url scheme: https://data.gov.be http://data.gov.ro/ https://www.dati.gov.it/ (note, Italy redirects data. to dati.) https://data.gov.pl/ https://data.gov.za/ (South Africa's has a cert problem) https://data.gov.in https://data.gov.au/ https://datos.gob.mx/
although data.gov.pl exists, and even presents a valid cert, it has no content. The place with the data is:
https://danepubliczne.gov.pl/en/#
(website is being terribly slow for me right now)