I am looking for datasets of size greater than 1 GB for a graduate academic project.
Datasets which are publicly available (or available upon request) and contain location-data and/or vary over a period of time.
Ask HN: Where can I find datasets of size greater than 1 GB?
1–10 of 10 posts
Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#2Look for the following:
Census data
Maybe wikipedia's data is available?
Is there some open search engine, which gives its data free?
There could be more but I'm tired and this will hopefully be of help.
Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#3Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#4You can download Wikipedia data; with only articles, it's around 20gb.
Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#5Try http://academictorrents.com/
See also the comments in https://news.ycombinator.com/item?id=7149006
Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#6Historical weather would fit your description. The NOAA has a large collection going back a century or more from different weather stations.
ftp://ftp.ncdc.noaa.gov/pub/data/
Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#7Openstreetmap?
Not sure that is the sort of data you want. In the U.S., lots of states and the federal government also have extensive geographical data sets (so you mind find one with a theme you are more interested in).
Re: Ask HN: Where can I find datasets of size greater than 1 GB?
#8OpenCrawl has TBs worth of info.