The Geocities Torrent (~1TB of awesomeness) • Hacker News Board

Re: The Geocities Torrent (~1TB of awesomeness)

#21

Post by arst » Wed, Oct 27, 2010, 11:11 PM UTC

jacquesm wrote: post #16

arst wrote: post #15

Earlier quoted context omitted.

While I think the web is probably a better place with reocities than without it, slapping ads on this content feels a tad bit slimy to me. I'm curious to hear your take on the ethical and legal implications of it.

The ads are actually a boost for a HN'er. And let's suppose for a second that they were not (as they have not been in the past), reocities has cost a fairly large amount of money to date (instead of made money, as you suggest), not a single person that has asked me to remove the content has ever commented on the presence of the ads, and neither has anybody that has found their stuff again because I backed it up. On t…

(instead of made money, as you suggest)

I apologize if that's how you read my post; I certainly didn't intend to suggest that or to belittle the amount of work and money that you've put into this project.

Re: The Geocities Torrent (~1TB of awesomeness)

#22

Post by jacquesm » Wed, Oct 27, 2010, 11:15 PM UTC

arst wrote: post #21

jacquesm wrote: post #16

Earlier quoted context omitted.

The ads are actually a boost for a HN'er. And let's suppose for a second that they were not (as they have not been in the past), reocities has cost a fairly large amount of money to date (instead of made money, as you suggest), not a single person that has asked me to remove the content has ever commented on the presence of the ads, and neither has anybody that has found their stuff again because I backed it up. On t…

(instead of made money, as you suggest) I apologize if that's how you read my post; I certainly didn't intend to suggest that or to belittle the amount of work and money that you've put into this project.

If you put up half of the money that went in to it sight unseen then we'll call it even , deal ? ;)

Re: The Geocities Torrent (~1TB of awesomeness)

#23

Post by Luyt » Wed, Oct 27, 2010, 11:20 PM UTC

TamDenholm wrote: post #12

1TB of internet nostalgia.

Argh, they're gonna revive and store the stuff I was so ashamed for that I hoped it would never resurface.

Re: The Geocities Torrent (~1TB of awesomeness)

#24

Post by bobf » Wed, Oct 27, 2010, 11:21 PM UTC

jacquesm wrote: post #17

a1k0n wrote: post #14

Earlier quoted context omitted.

Have you tried de-duping files to save space? I imagine there's a finite number of MIDI files and "under construction" GIFs that could just be symlinked to save a ton of space...

Space is not the problem, I've got plenty of that. The bigger problem is that the underlying filesystem is having some problems dealing with the total number of files. Total disk space usage on the array that holds reocities is about 10.5 T (that includes a master copy though) and runs to 233 million files.

Have you considered implementing a NoSQL solution to store the files? I've successfully done something similar with HBase.

Re: The Geocities Torrent (~1TB of awesomeness)

#25

Post by mhd » Wed, Oct 27, 2010, 11:25 PM UTC

roadnottaken wrote: post #19

mhd wrote: post #4

How many "web rings" fit into 1 TB?

Wow, when did those disappear? That phrase immediately brought me back to ~1994. :)

Disappear? webring.com is still there. I dare you to enter "goth poetry" in its search window. Double dare, as a matter of fact.

Re: The Geocities Torrent (~1TB of awesomeness)

#26

Post by mhd » Wed, Oct 27, 2010, 11:28 PM UTC

jacquesm wrote: post #7

corin_ wrote: post #5

Earlier quoted context omitted.

I imagine at least somebody will download to a server and host them all there. Might grab a new 1TB drive into one of my servers and do it if I'm bored enough...

I've been doing that for the last 12 months, and the collection is significantly larger than that. http://www.reocities.com/

And after only two random clicks, I'm at a (bad) foot fetish site. Well, it was either that, or a "Mr. T ate my "…

Re: The Geocities Torrent (~1TB of awesomeness)

#27

Post by Devilboy » Wed, Oct 27, 2010, 11:32 PM UTC

Luyt wrote: post #23

TamDenholm wrote: post #12

1TB of internet nostalgia.

Argh, they're gonna revive and store the stuff I was so ashamed for that I hoped it would never resurface.

What happens on the internet... stays on the internet.

Re: The Geocities Torrent (~1TB of awesomeness)

#28

Post by steve19 » Wed, Oct 27, 2010, 11:36 PM UTC

This may be the largest public torrent ever created!

Re: The Geocities Torrent (~1TB of awesomeness)

#29

Post by jacquesm » Wed, Oct 27, 2010, 11:50 PM UTC

bobf wrote: post #24

jacquesm wrote: post #17

Earlier quoted context omitted.

Space is not the problem, I've got plenty of that. The bigger problem is that the underlying filesystem is having some problems dealing with the total number of files. Total disk space usage on the array that holds reocities is about 10.5 T (that includes a master copy though) and runs to 233 million files.

Have you considered implementing a NoSQL solution to store the files? I've successfully done something similar with HBase.

No, but that's a good idea, I'll definitely look in to that when the next round of reocities improvements rolls around.

Re: The Geocities Torrent (~1TB of awesomeness)

#30

Post by hartror » Thu, Oct 28, 2010, 12:01 AM UTC

naz wrote: post #20

jbail wrote: post #3

Wow. This site is amazing. Tons of gems: http://www.textfiles.com/underconstruction/

Was under construction the first web meme? All these people couldn't have arrived at the same metaphor individually (as obvious as it is).

I remember back in `95 building websites that were basically just animated gifs, (no judging i was a kid). I used some under construction ones because I had seen it everywhere and I was constructing!