Google launches Public Datasets program
cloud.google.com
Google launches Public Datasets program
1–10 of 98 posts
Re: Google launches Public Datasets program
#2"HACKER NEWS -
A dataset that contains all stories and comments from Hacker News since its launch in 2006."
I know what I'm doing this weekend.
Re: Google launches Public Datasets program
#3Site doesn't render well on my Moto X.
Re: Google launches Public Datasets program
#4I work and play in data. By far the best resource I've encountered is https://app.enigma.io/
Signups are free. The aggregated public data is plentiful and easily discovered, indexed, filtered, and exported.
Free account have API limitations, but as far as govt data is concerned, I don't find that its updated often enough to peg my API rate limiter anyway.
Re: Google launches Public Datasets program
#5One large difference between this program and alternative programs is that data already resides in Google BigQuery:
- You do not need to spin up a database to work with BigQuery
- You can simply start writing SQL on top of BigQuery
- You may leverage Dataflow and MapReduce connectors to work with this data directly in Hadoop, Spark, or Dataflow
- BigQuery has a free tier - one Terabyte of data processed per month
Finally, for folks who would like to share their datasets, BigQuery offers free hosting and credits to help get a pipeline going.
(disclosure: work on BigQuery)
Re: Google launches Public Datasets program
#6Can we extract the datasets to work with them on our own (cheaper to query) servers?
Re: Google launches Public Datasets program
#7Can we extract the datasets to work with them on our own (cheaper to query) servers?
Of course! BigQuery export operations are free.
Although compared with other cloud technologies, BigQuery is incredibly cost-effective :)
Re: Google launches Public Datasets program
#8Re: Google launches Public Datasets program
#9I get 404s for all Looker iframes...
Re: Google launches Public Datasets program
#10This is a much more useful list: https://www.reddit.com/r/bigquery/wiki/datasets
I'm not sure why Google hosts it on Reddit. There's some interesting (and more up-to-date) stuff on there.