Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Getting started with Puppeteer and Chrome Headless for Web Scraping

github.com

Post reply on HN
Print view View original

1–10 of 39 posts

Re: Show HN: Getting started with Puppeteer and Chrome Headless for Web Scraping

#2

Post by Giroflex »

> Since the official announcement of Chrome Headless, many of the industry standard libraries for automated testing have been discontinued by their maintainers. The prominent of these are PhantomJS and Selenium IDE for Firefox.

Correct me if I'm wrong, but if I'm notm mistaken Selenium IDE has been discontinued due to lack of mantainers, and that has little if any relation to Chrome Headless.

The IDE is just a more effective way of programming test behavior; the Selenium webdriver is still up and working with straight code (as is the case of this tutorial).

Re: Show HN: Getting started with Puppeteer and Chrome Headless for Web Scraping

#4

Post by jaxn »

Giroflex wrote: post #2

> Since the official announcement of Chrome Headless, many of the industry standard libraries for automated testing have been discontinued by their maintainers. The prominent of these are PhantomJS and Selenium IDE for Firefox. Correct me if I'm wrong, but if I'm notm mistaken Selenium IDE has been discontinued due to lack of mantainers, and that has little if any relation to Chrome Headless. The IDE is just a more e…

Related or not, it seems like a valid point.

We switched to chrome headless after a post from thoughtbot made me question Capybara-WebKit's future.

Re: Show HN: Getting started with Puppeteer and Chrome Headless for Web Scraping

#5

Post by kyriakos »

Giroflex wrote: post #2

> Since the official announcement of Chrome Headless, many of the industry standard libraries for automated testing have been discontinued by their maintainers. The prominent of these are PhantomJS and Selenium IDE for Firefox. Correct me if I'm wrong, but if I'm notm mistaken Selenium IDE has been discontinued due to lack of mantainers, and that has little if any relation to Chrome Headless. The IDE is just a more e…

There's still nothing equivalent to selenium ide for chrome headless.

Re: Show HN: Getting started with Puppeteer and Chrome Headless for Web Scraping

#7

Post by escap »

jaxn wrote: post #4
Giroflex wrote: post #2

> Since the official announcement of Chrome Headless, many of the industry standard libraries for automated testing have been discontinued by their maintainers. The prominent of these are PhantomJS and Selenium IDE for Firefox. Correct me if I'm wrong, but if I'm notm mistaken Selenium IDE has been discontinued due to lack of mantainers, and that has little if any relation to Chrome Headless. The IDE is just a more e…

Related or not, it seems like a valid point. We switched to chrome headless after a post from thoughtbot made me question Capybara-WebKit's future.

Selenium IDE was discontinued due to the change of extension (from XPI to WebExtension) in Firefox. Nothing to do with Chrome Headless.

see https://seleniumhq.wordpress.com/2017/08/09/firefox-55-and-s... and associated HN discussion https://news.ycombinator.com/item?id=15061605

Re: Show HN: Getting started with Puppeteer and Chrome Headless for Web Scraping

#8

Post by emadehsan »

Giroflex wrote: post #2

> Since the official announcement of Chrome Headless, many of the industry standard libraries for automated testing have been discontinued by their maintainers. The prominent of these are PhantomJS and Selenium IDE for Firefox. Correct me if I'm wrong, but if I'm notm mistaken Selenium IDE has been discontinued due to lack of mantainers, and that has little if any relation to Chrome Headless. The IDE is just a more e…

You are right! Also the discontinuation has no relation to Chrome Headless as far as I know.

I have updated the article so it doesn't seem like the two events are related.

Post reply on HN