Live data from Hacker News

CIA to Sunset the World Factbook

abc.net.au

31–40 of 279 posts

Re: CIA to Sunset the World Factbook

#31

An outdated service that belongs to the era of encyclopedia. Wikipedia moved us past it. ChatGPT has moved us so far past it, it's become a relic.

Isn't it essentially a source for both of those things? If all the sources dry up then LLM 'facts' will be time constrained.

It aggregates many public sources, so much of it is findable, but not all.

Re: CIA to Sunset the World Factbook

#33

Earlier quoted context omitted.

Where do you think the information on Wikipedia comes from? Not that Wikipedia strongly relies on The World Factbook, but it can't exist without other secondary sources like these.

Wikipedia is actually the secondary source when someone reads a page on it, and it requires primary sources (like factbooks) to cite to exist.

This is incorrect. Wikipedia relies primarily on secondary sources, which makes it a tertiary source, and it describes itself this way.[1] The World Factbook does not collect the information it provides, making it a secondary source.

[1]: https://en.wikipedia.org/wiki/WP:PSTS

Re: CIA to Sunset the World Factbook

#35
post #28

Unfortunate. So many essays that I wrote in school cited The World Facebook as a source. I'm worried that the death of these easily accessible sources will push more and more pupils into relying on Wikipedia or even worse: AI. Being critical of what you see online and finding facts yourself is crucial to digital literacy.

"Facebook" :)

I initially read it as Facebook as well and almost celebrated :D

Re: CIA to Sunset the World Factbook

#36
post #9

The Factbook dates from a time when this was the most convenient source of updated concise summaries of all countries. It didn’t necessarily go into great detail except for countries important to the US national interest. This has been eclipsed by Wikipedia, the information there is far more comprehensive and govt officials will go there to make updates and corrections.

Where do you think the information on Wikipedia comes from? Not that Wikipedia strongly relies on The World Factbook, but it can't exist without other secondary sources like these.

Most countries have some kind of statistics department that publishes that kind of data in great detail.

The issues start when you try to compare data, because different sources will use different methodologies

Re: CIA to Sunset the World Factbook

#37
post #3

Feels very short sighted, the Factbook is a great example of low cost soft power.

Are we remembering the same Factbook? It had summary statistics for every country and some brief blurbs about their history, climate, economy, etc. Strictly speaking yeah it generated some legitimacy to publish a resource like this and I find it hard to believe the CIA can't scrape a few quarters together to keep it running, but most of it's value is sentimental.

Re: CIA to Sunset the World Factbook

#39
20 years ago, I was working on a consumer device, doing indexing and searching of books. The indexer had about 1 MB of RAM available, and had to work in the background on a very slow, single core CPU, without the user noticing any slowdown. A lot of the optimization work involved trying to get algorithmic complexity and memory use closer to a function of the distinct words in books than to a function of the total words in books. Typical novels have on the order of 10 K distinct words and 100 K total words.

If you're indexing numbers, which we did, this book has little difference between total words and distinct words because it has so many distinct numbers in it. It ended up being a regular stress test to make sure our approach to capping memory use was working. But, because it constantly triggered that approach to capping memory usage, it took far longer to index than more typical books, including many that were much larger.

Re: CIA to Sunset the World Factbook

#40

Earlier quoted context omitted.

I remember this from literally 20 years ago. Maybe the traffic made it not worth the cost? And 'soft power'? Like lying about stats and using it for propaganda? Otherwise its just objective and someone else can do the work. For some reason I never attributed it to the US or CIA.

You can make propaganda without lying, by choosing what metrics you value over others for example, by adding them or omitting them or implying whether a stat increasing is positive or negative.

Also choosing which methodology is the "right" one to measure a specific number.

There are lots of ways to measure ethnic groups, the size of the capital or the unemployment rate. If you publish the numbers you get to choose which one suits you best, you just have to be globally consistent

Post reply on HN