Live data from Hacker News

Show HN: CIA World Factbook Archive (1990–2025), searchable and exportable

cia-factbook-archive.fly.dev

101–106 of 106 posts

Re: Show HN: CIA World Factbook Archive (1990–2025), searchable and exportable

#101
post #36
post #27

Earlier quoted context omitted.

To clarify, I am a shill for fly.io and wanted to get you to spend more money by scaling it up. The site loaded instantaneously on the first try, so fast I thought it was local.

All good. Needed to be scaled anyway:)

Lmao. You are good sports. Wish you best of luck.

Re: Show HN: CIA World Factbook Archive (1990–2025), searchable and exportable

#103

There is a github of the factbook for anyone that just wants JSON or markdown files:=> https://github.com/factbook "A cache for datasets for the country profiles from the World Factbook in the original (1:1) format from the cia.gov website" https://github.com/factbook/cache.factbook.json

Ahhhh yes thank you for this link! I'm working on a project and my agent referred me to the factbook. It said all this great savory information was made available on the factbook website. I thought great but when I went to check it was all very basic. Truly I thought my agent was hallucinating!

It wasn't! Note to self: also check archive.org in case there is an internet archive for any sites an agent might reference.

I checked out this repo -- it has the information useful to my project. Thanks for sharing this!

Re: Show HN: CIA World Factbook Archive (1990–2025), searchable and exportable

#105

Earlier quoted context omitted.

it is a lot of fun and rewarding to do this! I've done it several times for medium-sized datasets, like wikipedia dumps, the entire geospatial dataset to mapreduce it (pgsql). The wikipedia one was great, i had it set up to query things like "show me all ammunition manufactured after 1950 that is between .30 and .40" and it could just return it nearly instantly. The wikimedia dumps keep the infoboxes and relations in…

Do you have a write-up of this somewhere? When I last looked at the Wikipedia dumps, they looked like a mess to parse. How were you getting structured information?

unfortunately, i consider it proprietary.

Re: Show HN: CIA World Factbook Archive (1990–2025), searchable and exportable

#106

Earlier quoted context omitted.

it is a lot of fun and rewarding to do this! I've done it several times for medium-sized datasets, like wikipedia dumps, the entire geospatial dataset to mapreduce it (pgsql). The wikipedia one was great, i had it set up to query things like "show me all ammunition manufactured after 1950 that is between .30 and .40" and it could just return it nearly instantly. The wikimedia dumps keep the infoboxes and relations in…

Do you have a write-up of this somewhere? When I last looked at the Wikipedia dumps, they looked like a mess to parse. How were you getting structured information?

You'd presumably have to run some part of the transclusion pipeline to properly handle template/module/page transclusion.
Post reply on HN