How to be a good citizen when crawling web sites? #1 Post by deedee » Tue, May 22, 2012, 5:21 AM UTC How to be a good citizen when crawling web sites?programmers.stackexchange.com