Finding the best ticket price – Simple web scraping with Python
danielforsyth.me
Finding the best ticket price – Simple web scraping with Python
1–10 of 36 posts
Re: Finding the best ticket price – Simple web scraping with Python
#2Useful article, I use lxml myself. Find that this is a good resource: http://jakeaustwick.me/python-web-scraping-resource/
Re: Finding the best ticket price – Simple web scraping with Python
#3There is also iftt.com that can poll a specific CL search and email you when something hits.
Re: Finding the best ticket price – Simple web scraping with Python
#4Useful article, I use lxml myself. Find that this is a good resource: http://jakeaustwick.me/python-web-scraping-resource/
[deleted]
Re: Finding the best ticket price – Simple web scraping with Python
#5You should integrate this in weboob [0]
Re: Finding the best ticket price – Simple web scraping with Python
#6I can recommend scrapy[0] if you work on a bit bigger problem. But even then if you familiar with scrapy it's incredible fast to write a simple scraper with your data neatly exported in .json.
[0]: http://scrapy.org/
Re: Finding the best ticket price – Simple web scraping with Python
#7I can recommend scrapy[0] if you work on a bit bigger problem. But even then if you familiar with scrapy it's incredible fast to write a simple scraper with your data neatly exported in .json. [0]: http://scrapy.org/
I don't recommend scrapy. Classic example of a framework that should have been a library. It will work up until a point and then it will railroad your app and you will have a really painful time breaking out of the 'scrapy' way of doing things. Classic 'framework' problem.
I prefer a combination of celery (distributed task management), mechanize (pretend web browser) and pyquery (jquery selectors for python).
Re: Finding the best ticket price – Simple web scraping with Python
#8This reminds me of something I knocked up back in 2006. It's not a scraper, it's not Python, but here you are:
Searches multiple UK ticket sites and returns the artist page matching the query.
Clicking a header label (i.e. Ticketweb) switches to that provider.
Double-clicking the header re-searches based on the value of the search box.
I use it for the 9am scramble for newly released tickets.
Oh, it seems Ticketmaster has broken. Maybe I'll fix that one day... I haven't used it in a while.
Re: Finding the best ticket price – Simple web scraping with Python
#9I can recommend scrapy[0] if you work on a bit bigger problem. But even then if you familiar with scrapy it's incredible fast to write a simple scraper with your data neatly exported in .json. [0]: http://scrapy.org/
I don't recommend scrapy. Classic example of a framework that should have been a library. It will work up until a point and then it will railroad your app and you will have a really painful time breaking out of the 'scrapy' way of doing things. Classic 'framework' problem. I prefer a combination of celery (distributed task management), mechanize (pretend web browser) and pyquery (jquery selectors for python).
Agreed. I used BeautifulSoup in combination with Celery.
To me scraping is such a specific thing it's best to write your own 'framework'.
Re: Finding the best ticket price – Simple web scraping with Python
#10Combine this with Pushover[0] to get alerted whenever there is a new lowest price. I had to resort to scraping+pushover to snatch a garage parking spot in SF.