There are non English versions of Wikipedia also. Can anyone please point to information on how we can download a copy of one specific language version?
You can find plenty of other languages here [1] for example. These are the Kiwix versions.
Wikipedia: Database Download
41–50 of 106 posts
Re: Wikipedia: Database Download
#42If you've got some spare bandwidth & storage then seeding some of the torrents here is a cheap and fun way of helping Wikipedia out. I've served around 20TB of these dumps in the past year. https://meta.wikimedia.org/wiki/Data_dump_torrents
Do you happen to know why wikipedia didn't embrace torrents as the default download method?
Re: Wikipedia: Database Download
#43Is there a RAG for Wikipedia?
I may not be using the term correctly here. In short, I would love a local LLM + Wikipedia snapshot so that I can have an offline, self-hosted ... Hitchhiker's Guide to Earth.
Re: Wikipedia: Database Download
#44Re: Wikipedia: Database Download
#45Earlier quoted context omitted.
My go-to as well. Pre-war steel.
it's not about pre-war. it's about pre-trinity-nuclear tests. which means uncontaminated by atmospheric radioactive isotopes. it happened at the end of ww-ii but that is not the point.
It's an important distinction because a lot of ships were sunk during WWII.
Re: Wikipedia: Database Download
#46I wonder how easy it would be to make a practically indestructible, everlasting Wikipedia reader.
Something using solar for power, with a rugged and water-resistant enclosure, made of extremely high-quality components that won't break for hundreds of years at least. Maybe add an IRDA port for good measure, to make it possible to transfer all the data out somewhat quickly.
You could make hundreds of these and put them in hard-to-reach locations around the world, to make sure at least one survives whatever calamity might befall us in the future.
Re: Wikipedia: Database Download
#47Earlier quoted context omitted.
Also helps save Wikipedia if it gets shut down - which might happen!
True. Musk for example is publicly attacking it for spreading "left-wing lies" because in his wiki page there are statements like "He has been criticized for making unscientific and misleading statements, including COVID-19 misinformation and promoting conspiracy theories, and affirming antisemitic, racist, and transphobic comments." which are just pure facts. It would be nice to have something like this more decentr…
I was perusing some recent discussions on sources with interest. It seems that Wikipedia's intelligentsia have managed to "blacklist" (deprecate or declare "generally unreliable") practically every prominent source of news in the US that is not centrist or leftist.
I kid you not; through a process of attrition they've attacked the very reliability and reputation of every source, including Fox News and the like, and they've told editors sitewide that they simply can't be cited as a "Reliable Secondary Source", like at all.
I am not sure if that is an accurate assessment of the situation on the ground for mainstream media, but it certainly exposes some real systemic bias.
And this is the highest-order and most enduring method of ingraining systemic bias in the project: by weeding out sources with unfavorable viewpoints and perspectives, saying they publish lies and untruth, and being able to prohibit them globally from any use.
And I was pondering this state of affairs and just thinking about Karoline Leavitt's press room, and wondering what will the landscape be, if there is precious little intersection between press outlets who may be favorable or deferent to the present administration, and those which are allowed to be cited on Wikipedia? Ouch!
Re: Wikipedia: Database Download
#48Okay, that looked a bit ridiculous in the pre-AI era (who needs to download the whole Wikipedia?), but now I can see the sense in it.
> who needs to download the whole Wikipedia Anyone who wants to have access while off-line, for whatever reason. This can be as simple as saving costs via more complicated as accessing content from regions with spotty and/or expensive connectivity (you're on a ship out of reach of shore-based mobile networks, you do not have access to Starlink or something similar, you're deep in the jungle, deep underground, etc) to…
You have bad politics. This is bad politics.
Re: Wikipedia: Database Download
#49If you've got some spare bandwidth & storage then seeding some of the torrents here is a cheap and fun way of helping Wikipedia out. I've served around 20TB of these dumps in the past year. https://meta.wikimedia.org/wiki/Data_dump_torrents
Do you happen to know why wikipedia didn't embrace torrents as the default download method?
I think it is a nice use case for IPFS
Re: Wikipedia: Database Download
#50Earlier quoted context omitted.
True. Musk for example is publicly attacking it for spreading "left-wing lies" because in his wiki page there are statements like "He has been criticized for making unscientific and misleading statements, including COVID-19 misinformation and promoting conspiracy theories, and affirming antisemitic, racist, and transphobic comments." which are just pure facts. It would be nice to have something like this more decentr…
I was perusing some recent discussions on sources with interest. It seems that Wikipedia's intelligentsia have managed to "blacklist" (deprecate or declare "generally unreliable") practically every prominent source of news in the US that is not centrist or leftist. I kid you not; through a process of attrition they've attacked the very reliability and reputation of every source, including Fox News and the like, and t…
It's not Wikipedia's fault that the vast majority of right wing media consists of pure propaganda, disinformation, and lies.