Live data from Hacker News

Local LLMs versus offline Wikipedia

evanhahn.com

91–100 of 200 posts

Re: Local LLMs versus offline Wikipedia

#91
post #86
post #78

Earlier quoted context omitted.

You might want to read about a technology called "farming". Pretty sure as far as transformative incredible technologies, the ability for humans to create nourishment at global scale blows the pants off the text / image imitation machine

I think you’re probably right, but more because of erroneous categorization of what is a “technology.” We take for granted technology older than like 600 years ago (basically most people would say the printing press is a technology and maybe forget that the wheel and, indeed, crop cultivation). AI could certainly be in the top 3 most significant technologies of things developed since (inclusive) the printing press. W…

> We take for granted technology older than like 600 years ago (basically most people would say the printing press is a technology and maybe forget that the wheel and, indeed, crop cultivation).

The printing press is more than 600 years old. It's more than 1200 years old.

Re: Local LLMs versus offline Wikipedia

#92
post #7

One important distinction is that the strength of LLMs isn't just in storing or retrieving knowledge like Wikipedia, it’s in comprehension. LLMs will return faulty or imprecise information at times, but what they can do is understand vague or poorly formed questions and help guide a user toward an answer. They can explain complex ideas in simpler terms, adapt responses based on the user's level of understanding, and…

Not sure if “more” valuable but certainly valuable.

I strongly dislike the way AI is being used right now. I feel like it is fundamentally an autocomplete on steroids.

That said, I admit it works as a far better search engine than Google. I can ask Copilot a terse question in quick mode and get a decent answer often.

That said, if I ask it extremely in depth technical questions, it hallucinates like crazy.

It also requires suspicion. I asked it to create a repo file for an old CentOS release on vault.centos.org. The output was flawless except one detail — it specified the gpgkey for RPM verification not using a local file but using plain HTTP. I wouldn’t be upset about HTTPS (that site even supports it), but the answer presented managed to completely thwart security with the absence of a single character…

Re: Local LLMs versus offline Wikipedia

#93
post #4

This is a sensible comparison. My "help reboot society with the help of my little USB stick" thing was a throwaway remark to the journalist at a random point in the interview, I didn't anticipate them using it in the article! https://www.technologyreview.com/2025/07/17/1120391/how-to-r... A bunch of people have pointed out that downloading Wikipedia itself onto a USB stick is sensible, and I agree with them. Wikipedi…

Someone should start a company selling USB sticks pre-loaded with lots of prepper knowledge of this type. In addition to making money, your USB sticks could make a real difference in the event of a global catastrophe. You could sell the USB stick in a little box which protects it from electromagnetic interference in the event of a solar flare or EMP.

I suppose the most important knowledge to preserve is knowledge about global catastrophic risks, so after the event, humanity can put the pieces back together and stop something similar from happening again. Too bad this book is copyrighted or you could download it to the USB stick: https://www.amazon.com/Global-Catastrophic-Risks-Nick-Bostro... I imagine there might be some webpages to crawl, however: https://www.lesswrong.com/w/existential-risk

Re: Local LLMs versus offline Wikipedia

#94

Is there any project that combines a local LLM with a local copy of Wikipedia. I don’t know much about this but I think it’s called a RAG? It would be neat if I could make my local LLM fact check itself against the local copy of Wikipedia.

https://www.abramjackson.com/artificial-intelligence/the-arc...

Re: Local LLMs versus offline Wikipedia

#95
post #4

This is a sensible comparison. My "help reboot society with the help of my little USB stick" thing was a throwaway remark to the journalist at a random point in the interview, I didn't anticipate them using it in the article! https://www.technologyreview.com/2025/07/17/1120391/how-to-r... A bunch of people have pointed out that downloading Wikipedia itself onto a USB stick is sensible, and I agree with them. Wikipedi…

Someone should start a company selling USB sticks pre-loaded with lots of prepper knowledge of this type. In addition to making money, your USB sticks could make a real difference in the event of a global catastrophe. You could sell the USB stick in a little box which protects it from electromagnetic interference in the event of a solar flare or EMP. I suppose the most important knowledge to preserve is knowledge abo…

https://arstechnica.com/information-technology/2009/11/hands...

https://www.amazon.com/WikiReader-PANREADER-Pocket-Wikipedia...

Re: Local LLMs versus offline Wikipedia

#97
post #9
post #7

One important distinction is that the strength of LLMs isn't just in storing or retrieving knowledge like Wikipedia, it’s in comprehension. LLMs will return faulty or imprecise information at times, but what they can do is understand vague or poorly formed questions and help guide a user toward an answer. They can explain complex ideas in simpler terms, adapt responses based on the user's level of understanding, and…

An unreliable computer treated as a god by a pre-information-age society sounds like a Star Trek episode.

Also a recent episode of Lazarus. Though s/pre-information-age/cult

Re: Local LLMs versus offline Wikipedia

#98
post #4

This is a sensible comparison. My "help reboot society with the help of my little USB stick" thing was a throwaway remark to the journalist at a random point in the interview, I didn't anticipate them using it in the article! https://www.technologyreview.com/2025/07/17/1120391/how-to-r... A bunch of people have pointed out that downloading Wikipedia itself onto a USB stick is sensible, and I agree with them. Wikipedi…

No need to muck around with SQL, just use Kiwix.

Re: Local LLMs versus offline Wikipedia

#99
post #4

This is a sensible comparison. My "help reboot society with the help of my little USB stick" thing was a throwaway remark to the journalist at a random point in the interview, I didn't anticipate them using it in the article! https://www.technologyreview.com/2025/07/17/1120391/how-to-r... A bunch of people have pointed out that downloading Wikipedia itself onto a USB stick is sensible, and I agree with them. Wikipedi…

Someone should start a company selling USB sticks pre-loaded with lots of prepper knowledge of this type. In addition to making money, your USB sticks could make a real difference in the event of a global catastrophe. You could sell the USB stick in a little box which protects it from electromagnetic interference in the event of a solar flare or EMP. I suppose the most important knowledge to preserve is knowledge abo…

https://shop.sacred-texts.com/product/ista-usb-flash-drive-9...

Re: Local LLMs versus offline Wikipedia

#100
post #33

Earlier quoted context omitted.

Definitely sounds like a plausible and fun episode. On the other hand, real history if filled with all sorts of things being treated as a god that were much worse than "unreliable computer". For example, a lot of times it's just a human with malice. So how bad could it really get

"as bad as it can get" is somewhere in the realm of universal paperclips

That will merely kill everyone.

"As bad as it can get" is an AI that, either by accident or due to malign influence, takes "I Have No Mouth, and I Must Scream" as a guide book.

Actually, I take that back, it would be what happens in the hells in Surface Detail.

Post reply on HN