Just curious what technologies you are using? Also how quickly will this update on the 1st when a new thread is posted...again - just curious. Great job! Much better than ctrl-f-ing my way through postings [just like you were doing].
Thanks. To answer your first question: I'm using a custom scraper to get the results. I request the job pages through a random http proxy every so often, parse them, and update the cached json of all the comments. Getting a reliable, free, machine-friendly list of http proxies is harder than I thought. It was automatic, but the proxy provider I was using went down (doh!) so now I manually pull one from a list and tri…
Thanks for the info !