Live data from Hacker News

Speedcube.de forum archive using wget and squashfs

github.com

1–3 of 3 posts

Re: Speedcube.de forum archive using wget and squashfs

#2
Great docs. If you want to create WARC files for archival purposes [1], wget supports doing so natively [2]. grab-site automates this [3].

[1] https://en.wikipedia.org/wiki/WARC_(file_format)

[2] https://wiki.archiveteam.org/index.php/Wget_with_WARC_output

[3] https://github.com/ArchiveTeam/grab-site

Re: Speedcube.de forum archive using wget and squashfs

#3

Great docs. If you want to create WARC files for archival purposes [1], wget supports doing so natively [2]. grab-site automates this [3]. [1] https://en.wikipedia.org/wiki/WARC_(file_format) [2] https://wiki.archiveteam.org/index.php/Wget_with_WARC_output [3] https://github.com/ArchiveTeam/grab-site

Thanks, looks very promising! I'll dig into this the next time I'll need to archive a web page.