Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Internet Archive is waging war on misinformation

ft.com

Post reply on HN
Print view View original

151–160 of 323 posts

Re: The Internet Archive is waging war on misinformation

#151

Post by DuskStar »

JulianMorrison wrote: post #134
fromthestart wrote: post #129

Earlier quoted context omitted.

[flagged]

And they would be wrong. Liberation literature is not in the same category as hate screeds. I don't buy the moral abdication you're selling. You know what's evil - it's the stuff full of race hate and misogyny. There is no moral equivalence.

> Liberation literature is not in the same category as hate screeds.

Just as one man's Freedom Fighter is another's Terrorist, this really depends on perspective.

Das Kapital is kinda negative about capital holders, after all.

> You know what's evil - it's the stuff full of race hate and misogyny. There is no moral equivalence.

Is it all the stuff full of racial hatred and mistreatment of women? Because you're going to have a hell of a time banning the Torah, Bible and Koran - to say nothing of other religious texts.

Re: The Internet Archive is waging war on misinformation

#152

Post by OrgNet »

chongli wrote: post #147
OrgNet wrote: post #137

Earlier quoted context omitted.

Apparently, we need a storage capacity breakthrough so that everyone can store everything so that we do not have to relay on what someone else say is acceptable.

That will never work. Data will always expand to use up all available storage. It's like trying to build more roads when your city has a traffic problem. You build roads to reduce traffic and improve commute times, and then more people start commuting from further away.

you are probably right... but what if it was like IPV6 where there are so many IPs that they should never run out... the unlimited storage dream.

Re: The Internet Archive is waging war on misinformation

#153

Post by Rebelgecko »

dredmorbius wrote: post #121
Rebelgecko wrote: post #52

Earlier quoted context omitted.

I got frustrated with this one time when I tried to look up a defunct website in the Wayback Machine. The website was gone, but had been replaced by a domain squatter with a restrictive robots.txt. Because of the new roboots.txt, all of the old site was retroactively made unavailable. As time passes and more websites change hands, it would be a nice compromise if the default behavior was only to make retroactive dele…

IA are specifically refusing to follow robots.txt directives largely on account of just this behaviour. https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea... https://archive.org/post/184024/robotstxt-policy-is-a-failur...

That's great news. Is there any update to the 2017 blog post? Is the new policy still only for .mil and .gov sites?

Re: The Internet Archive is waging war on misinformation

#154

Post by crisnoble »

3xblah wrote: post #145

"Mr Graham said he was an "optimist", but conceded that the archive had not yet saved as much as he would like. Take YouTube, for example: the team is only archiving a "small fraction" of all the videos published each week." Is it true one can nudge the IA crawlers to archive a page that would otherwise be ignored? https://blog.archive.org/2017/01/25/see-something-save-somet... Is this as simple as sending a GET requ…

If you put that link as a link in your video description, google crawlers might follow the link, thus triggering the GET request the same as curl.

Re: The Internet Archive is waging war on misinformation

#155

Post by DuskStar »

RobertRoberts wrote: post #111

9/11 in the Archive. Go look at all the news websites on September 10th, 2001... and back about a month or two. All empty until 9/11.

Supposedly a lot of news sites were pummeled with traffic on 9/11, which prompted investment following that.

Re: The Internet Archive is waging war on misinformation

#156

Post by eukaryote31 »

OrgNet wrote: post #152
chongli wrote: post #147

Earlier quoted context omitted.

That will never work. Data will always expand to use up all available storage. It's like trying to build more roads when your city has a traffic problem. You build roads to reduce traffic and improve commute times, and then more people start commuting from further away.

you are probably right... but what if it was like IPV6 where there are so many IPs that they should never run out... the unlimited storage dream.

Unlike IP addresses where you get exponentially more of them per unit cost (i.e size), storage space costs 1 bit per bit.

Re: The Internet Archive is waging war on misinformation

#157

Post by dredmorbius »

tpmx wrote: post #146
dredmorbius wrote: post #127

Earlier quoted context omitted.

ArchiveTeam is NOT the Internet Archive, though the two groups work closely. If you hit the AT's IRC channel, you probably got bounced or told to go to the discussion side channel. The main ArchiveTeam channel on Efnet is basically for "the house is on fire" emergencies. Normally you'll be asked to bounce to the chat/discussion channel. That may be inconsistently applied. I worked with ArchiveTeam in the G+ shutdown…

As Googler (?) working to give them data you were presumably not "competing" with them. Kind of a separate kind of sitatuation.

Clarifying: I am not / have never worked at or for Google.

I was a G+ user, and helped coordinate the exodus and information ("plexodus").

Re: The Internet Archive is waging war on misinformation

#158

Post by dredmorbius »

Rebelgecko wrote: post #153
dredmorbius wrote: post #121

Earlier quoted context omitted.

IA are specifically refusing to follow robots.txt directives largely on account of just this behaviour. https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea... https://archive.org/post/184024/robotstxt-policy-is-a-failur...

That's great news. Is there any update to the 2017 blog post? Is the new policy still only for .mil and .gov sites?

I don't know, though you could research via their blogsite.

Re: The Internet Archive is waging war on misinformation

#159

Post by tpmx »

dredmorbius wrote: post #157
tpmx wrote: post #146

Earlier quoted context omitted.

As Googler (?) working to give them data you were presumably not "competing" with them. Kind of a separate kind of sitatuation.

Clarifying: I am not / have never worked at or for Google. I was a G+ user, and helped coordinate the exodus and information ("plexodus").

Ah, ok.

Re: The Internet Archive is waging war on misinformation

#160

Post by dragonwriter »

JulianMorrison wrote: post #122
devmunchies wrote: post #104

> But Mr Graham argued that simply removing false information or offensive content isn’t necessarily the answer. Hateful material need not remain publicly available, he said, but certain researchers and politicians should be able to study it. They're planting the seed and seeing how the public reacts. This is ridiculous! Mark something "controversial", "possibly fake", but don't memory-hole us. An archive only archiv…

There is no public-interest benefit in hate screeds. Those are memetic viruses with established body counts and should be studied, if at all, in the manner one studies smallpox.

> There is no public-interest benefit in hate screeds.

Sure there is.

If you can't read Mein Kampf, you can't recognize when a new work is following in its footprints.

Post reply on HN