Viewing profile — ikreymer

Every archiving tool out there makes trade-offs about what is archived and how. No one preserves the raw TLS encrypted H3 traffic because that's not useful. When you browse through…

Unfortunately, there is not much we can do about transfer-encoding, but the data is otherwise exactly as is returned from the browser. Browsertrix uses the browser to create web ar…

This isn't really true, our tools do not just modify response data for no reason! Our tools do the best that we can with an old format that is in use by many institutions. The WARC…

Memory usage increases for long-running session, see this issue for more details: https://github.com/microsoft/playwright/issues/6319

If you have other extensions, disable all of them before trying to record. Content from other extensions can't be accessed due to recent security changes in Chromium, and can cause…

A bit late to this thread, but I think WARC is a reasonable format for raw HTTP traffic. We should definitely have better tools to ensure WARC files produced are valid, and that's …

At this point, mostly time constraints maintaining two very different implementations. The archiving is done via the CDP Fetch domain ( https://chromedevtools.github.io/devtools-pr…

ArchiveWeb.page is the latest tool from the Webrecorder project. It works as a Chrome (or Brave, or Edge) browser extension or as a standalone Electron app. There's also an experim…

I'm excited to share the latest update from Webrecorder project, the release of a new OldWeb.today ( https://oldweb.today ), now running emulated browsers using JS/WASM entirely in…

Webrecorder supports remote browsers that allow you to run older browsers pre-configured with Flash, as well as Java applets. http://rhizome.org/editorial/2016/oct/25/rhizome-relea…

Unfortunately, this approach alone will only work for sites that are mostly static, eg. do not use JS to load dynamic content. That is a small (and shrinking) percent of the web. O…

Thanks Jack for mentioning Webrecorder! This is a project I started and it is now part of rhizome.org, a non-profit dedicated to promoting internet-based art and digital culture. I…

I don't think JS-based emulators are quite there yet in terms of performance, but I've no doubt that they will be eventually. I think this is the next best option for now.

Yes good point, this warrants some more research. The sudo was useful for install but I should see if it can be removed. Should also explore if there are concrete ways that the hos…

There are many reasons. From technology standpoint, as the web changes, old technologies may no longer work in new browsers. One case in point: Java applets. A few of the old brows…

oldweb.today connects to various web archives and allows users to browse old websites in old browsers, each running in a Docker container. Emulators such as Basilisk, Sheepshaver a…