I wonder if this would work better / be more expressive with XPATH-style selectors?
Generate RSS feed for any website using CSS selectors
11–20 of 55 posts
Re: Generate RSS feed for any website using CSS selectors
#12Other services like this: https://www.fivefilters.org/feed-creator/
Re: Generate RSS feed for any website using CSS selectors
#13For me PolitePol is best because if doesn't limit the amount of feeds and the free plan is pretty good: https://politepol.com
Re: Generate RSS feed for any website using CSS selectors
#14I wonder if this would work better / be more expressive with XPATH-style selectors?
rss-bridge also has xpath-style bridge: https://rss-bridge.org/bridge01/#bridge-XPathBridge
Re: Generate RSS feed for any website using CSS selectors
#15[dead]
Re: Generate RSS feed for any website using CSS selectors
#16The lack of feed generation is why I so many of the latest blog platforms are non-starters in my book. It boggles my mind. Honestly, if you don't generate a feed of some sort, I really can't take you seriously.
Re: Generate RSS feed for any website using CSS selectors
#17RSSHub[0] is in the same ballpark, but consists of a large library of site-specific code[1][2].
[0]https://github.com/DIYgod/RSSHub/
Re: Generate RSS feed for any website using CSS selectors
#18These days I just let chagpt generate a script that scrapes a site and spits out an rss file. Then I run it with cron.
Re: Generate RSS feed for any website using CSS selectors
#19This honestly is standard web scraping but these projects always catch my attention.
You're bound at the mercy of rate-limiting firewalls (so you'll have to rotate proxies if you intend on using this heavily) on top of the standard CloudFront bot detection recaptcha, and div-obfuscation (a good example of this is Facebook).
Re: Generate RSS feed for any website using CSS selectors
#20I've wondered why people have tried all sorts of cumbersome ways to splice metadata onto HTML like RDFa but never tried the obvious approach of basing extraction rules on CSS selectors... Often these work without the cooperation of the target site so long as they use CSS the way it was supposed be used (e.g. not tailwind, bootstrap, etc.)
CSS selectors has been common for the scrapers I've been using for years.