Live data from Hacker News

Hashify: what becomes possible when one is able to store documents in URLs?

hashify.me

21–30 of 84 posts

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#21
I've sometimes wondered about a system where the URL of a document is an actual hash, like SHA-1, of the document. That'd chance the semantics of hyperlinks from "link to document at this internet address" to "link to document with these contents", just like Hashify does, but it could do arbitrarily large documents.

The tricky part with that system would be that you'd also need some new mechanism to retrieve the files. Instead of the regular WWW stack, you'd need something like a massive distributed hash table that could handle massive distributed querying and transferring the hashed files. Many P2P file sharing systems are already doing this, but a sparse collection of end-user machines containing a few hashed files each isn't a very efficient service cloud. If every ISP had this sort of thing in their service stack or if Amazon and Google decided to run the service, all of them dynamically caching documents in greater demand in more nodes, things might look very different.

This would mean that very old hypertext documents would still be trivially readable with working links, as long as a few copies of the page documents were still hashed somewhere, even if the original hosting servers were long gone. It would also make it easy to do distributed page caching, so that pages that get a sudden large influx of traffic wouldn't create massive load on a single server.

On the other hand, any sort of news sites where the contents of the URL are expected to change wouldn't work, nor would URLs expected to point to a latest version of a document instead of the one at the time of linking. Once the hash URL was out, no revision to the hashed document visible from following the URL would be possible without some additional protocol layer. The URL strings would also be opaque to humans and too long and random to be committed to memory or typed by hand. The web would probably need to be somehow split into human-readable URLs for dynamic pages and hash URLs for the static pieces of content served by those pages.

I'm probably reinventing the wheel here, and someone's already worked out a more thought out version of this idea.

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#22

I've sometimes wondered about a system where the URL of a document is an actual hash, like SHA-1, of the document. That'd chance the semantics of hyperlinks from "link to document at this internet address" to "link to document with these contents", just like Hashify does, but it could do arbitrarily large documents. The tricky part with that system would be that you'd also need some new mechanism to retrieve the file…

http://en.wikipedia.org/wiki/Uniform_resource_name

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#23
post #22

I've sometimes wondered about a system where the URL of a document is an actual hash, like SHA-1, of the document. That'd chance the semantics of hyperlinks from "link to document at this internet address" to "link to document with these contents", just like Hashify does, but it could do arbitrarily large documents. The tricky part with that system would be that you'd also need some new mechanism to retrieve the file…

http://en.wikipedia.org/wiki/Uniform_resource_name

Right. Turns out my use of 'URL' everywhere in grandparent comment is a misnomer then. Should've used URN or URI.

I'm not quite sure if URN is exactly right for the hash thing either, given that it both fails to unify things which humans would probably assign the same URN to, such as two image files of the same picture using different encodings, and it has the theoretical chance of assigning the same hash to two entirely different things.

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#24

"Internet Explorer cannot display the webpage" is what happens here (IE 8).

Not really a good reply, but I think that hashify.me's potential for an IE audience was probably small to start with. But consider this: if this idea took off, wouldn't this press MS into keeping IE more modern?

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#25
post #15
post #13

The first use case that comes to mind is anonimity.

Solutions like pastebin.com provide the same, with a small url.

These messages are SOPA proof. They can never be "taken down" since they don't actually reside on the server

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#26
post #15

Earlier quoted context omitted.

Solutions like pastebin.com provide the same, with a small url.

These messages are SOPA proof. They can never be "taken down" since they don't actually reside on the server

They do however reside on server hosting the link

Re: Hashify: what becomes possible when one is able to store documents in URLs?

#27
post #8
post #6

Earlier quoted context omitted.

It also assumes that there's no limit on URL space that bit.ly provide. Tomorrow they could just max out the "long_url" field or whatever they call it to just accept 1500 chars or something

There is: "Storing a document in a URL is nifty, but not terribly practical. Hashify uses the [bit.ly API][4] to shorten URLs from as many as 30,000 characters to just 20 or so. In essence, bit.ly acts as a document store!" http://tinyurl.com/3n6h8px

This was my point, they're passing their 30,000 char URL to bit.ly to return a short URL (20 chars)

But what happens if bit.ly just say "Sorry incoming URLS (long urls) can only be a maximum of 1500 chars"?

Post reply on HN