Live data from Hacker News

Show HN: Self-hosted offline Internet from your browsing history

github.com

61–70 of 166 posts

Re: Show HN: Self-hosted offline Internet from your browsing history

#61
post #56
post #50

Earlier quoted context omitted.

I'm not sure that was the use-case. With pre-DHTML HTML4, there really just wasn't anything on a page that could continue to interact with the server after the page finished loading. So, presuming the button was for your described use-case, what would the difference be between "going offline" and just... not clicking any more links? (It's not like Netscape could or should signal your modem to hang up — Netscape doesn…

You must be young :) These browsers were born in the era of dialup Internet that had per minute charges and/or long distance charges. At the very least you were tying up your family's phone line. Basically it's like paying for every minute your cable modem is plugged in. For the feature itself: Netscape had integration with the modem connectivity for the OS and would initiate a connection when you tried to visit a re…

I ran a BBS, my friend :) I'm quite familiar with modems. I just never used Windows (or the web!) until well past the Netscape era, so I'm not too familiar with the intersection of modems and early web browsers.

> Netscape had integration with the modem connectivity for the OS and would initiate a connection when you tried to visit a remote page.

That's not "integration with modem connectivity", that's just going through the OS's socket API (or userland socket stack, e.g. Trumpet Winsock); where the socket library dials the modem to serve the first bind(2). Sort of like auto-mounting a network share to serve a VFS open(2).

Try it yourself: boot up a Windows 95 OSR2 machine with a (configured) modem, and try e.g. loading your Outlook Express email. The modem will dial. It's a feature of the socket stack.

These socket stacks would also automatically hang up the modem if the stack was idle (= no open sockets) for long enough.

My point was that a quiescent HTML4 browser has no open sockets, whether or not it's intentionally "offline." If you do as you say — load up a bunch of pages, and then sit there reading them — your modem will hang up, whether or not you play with Netscape's toggles.

(On single-tasking OSes like DOS — where a TCP/IP socket stack would be a part of a program, rather than a part of the OS — there was software that would eagerly hang up the modem whenever its internal socket refcount dropped to zero. But this isn't really a useful strategy for a multitasking OS, since a lot of things — e.g. AOL's chatroom software presaging AIM — would love to poll just often enough to cause the line that had just disconnected to reconnect. Since calls were charged per-minute rather than per-second, these reconnects had overhead costs!)

> [Netscape's] offline mode let you disable automatic dialing of the modem.

When you do... what?

When you first open the browser, to avoid loading your home page? (I guess that's sensible, especially if you're using Netscape in its capacity as an email client to read your already-synced email; or using it to author and test HTML; or using it to read local HTML documentation. And yet, not too sensible, since you need to open the browser to get to that toggle... is this a thing you had to think about in advance, like turning off your AC before shutting off your car?)

But I think you're implying that it's for when you try to navigate to a URL in the address bar, or click a link.

In which case, would the page, in fact, be served from the client-side cache, or would you just get nothing? (Was HTTP client-side caching even a thing in the early 90s? Did disks have the room to hold client-side caches? Did web servers by-and-large bother to send HTTP/1.0 Expires and Last-Modified headers? Etc.)

Re: Show HN: Self-hosted offline Internet from your browsing history

#62

I’ve been storing my research as text files (manual copy and paste of web page content) for years. And, I’ve wanted a _search history first_ plugin for web search to find pages I missed saving, but recall reading. Since the former takes time and the latter doesn’t exist, I gather I could buy storage and save browsing using this tool. It would be interesting to see how it works in practice—saving so much data. Also, F…

Just chiming in to say that Firefox location bar has some great filters [1] that might help you search history first (and other things). It doesn't do a full text search, but often helps me in a way I think you're after.

If you type: "^ worms" in the searchbar it will search your history for 'worms' and show the results in the dropdown. Typing "* worms" will search your bookmarks instead. The rest of the shortcut symbols are listed on the linked page. Hope that helps!

[1] http://kb.mozillazine.org/Location_Bar_search

Re: Show HN: Self-hosted offline Internet from your browsing history

#65
post #40
post #14

Very interesting project. I wish this was actually (optional) built-in behavior for browsers when bookmarking pages, or at least when adding to a "read later" list like Pocket/Instapaper etc. Pocket seems to offer something like this, but only in the premium version, so the "permanent archive" ironically seems to go away when unsubscribing. As a workaround, what if bookmarking a (public) page could actually ping it t…

Pinboard.in (not affiliated, just a happy customer) offers an archiving service for saved bookmarks.

What it doesn’t offer is an integration with the browser to make it seamless to work with those bookmarks. There are various extensions for Firefox which will save to Pinboard (one of them is mine!) but to work with them - you have the option of going to the website or using the mobile site in a sidebar (I do this, with some custom css to make it more readable for me).

There’s a nice MacOS application (sorry can’t remember the name right now) which gives you a better interface, but... they’re bookmarks. I would like them to be integrated with rather browser bookmarks. And to be usable when the site is down or I’m offline. And to appear when I search... lots of possibilities there.

Re: Show HN: Self-hosted offline Internet from your browsing history

#66

I remember seeing this on reddit, the license changed quite a lot over the past month, with some very weird custom licenses asking you not to be a fake victim, lie, etc in the process - https://github.com/c9fe/22120/commits/master/LICENSE - how safe is it to assume that the current license will stay?

Assuming good faith in the creator of this, it looks like they tried to type up something that they thought would cover their bases, then realized that wasn't right and copy/pasted in a real license.

Re: Show HN: Self-hosted offline Internet from your browsing history

#68

Earlier quoted context omitted.

Like the title of the github repo suggests ArchiveBox can be used. You have to manually import your browsing history though.... In theory you could also use yacy... But that is intended as search engine and not as archive. Edit: while looking into it I found alternatives [2] and Memex [3] seems to be interesting. Edit2: I remember 2 Show HNs. One recorded your entire desktop and made it searchable. Can't remember wha…

Add webrecoder to the list

It's now called Conifer and listed under my [2] link :) but thank you for mentioning it by name so I could look it up again, seems interesting.

Looks like I got some research for this week

Re: Show HN: Self-hosted offline Internet from your browsing history

#70
post #50

Earlier quoted context omitted.

I remember that button, too, but I think it had more to do with connection charges than caching. In Netscape days, many people would have to pay by the minute to be connected to the internet. In those days, web pages generally contained far more information than they do now, and were less interactive. So you'd connect, load the content you wanted to see, disconnect, and then just sit there and read it for free, inste…

I'm not sure that was the use-case. With pre-DHTML HTML4, there really just wasn't anything on a page that could continue to interact with the server after the page finished loading. So, presuming the button was for your described use-case, what would the difference be between "going offline" and just... not clicking any more links? (It's not like Netscape could or should signal your modem to hang up — Netscape doesn…

Server-Sent Events? How old is that mechanism?
Post reply on HN