Show HN: Easy to Use Open Source PHP Web Scraper

#1

Post by mahadazad » Mon, Dec 08, 2014, 3:34 PM UTC

Show HN: Easy to Use Open Source PHP Web Scraper
github.com

Re: Show HN: Easy to Use Open Source PHP Web Scraper

#2

Post by softdev12 » Mon, Dec 08, 2014, 4:22 PM UTC

This looks nice. I'm going to try it out. I've used Xpath before and it (mostly) works on well-formed web pages. Also, I'm not completely sure if the advanced parsing mode allows for conditional non-link tests? Something like if title==X, then scrape the page. Good work.

Re: Show HN: Easy to Use Open Source PHP Web Scraper

#3

Post by mahadazad » Mon, Dec 08, 2014, 4:24 PM UTC

softdev12 wrote: post #2

This looks nice. I'm going to try it out. I've used Xpath before and it (mostly) works on well-formed web pages. Also, I'm not completely sure if the advanced parsing mode allows for conditional non-link tests? Something like if title==X, then scrape the page. Good work.

well right now title==X is not supported. However, you can fork the project and contribute. I am also planning to add a css selector to it. So that i would be much easier