The Tale of Creating a Distributed Web Crawler
benbernardblog.com