Show HN: RSS feeds for arbitrary websites using CSS selectors
feed-me-up-scotty.vincenttunru.com
Show HN: RSS feeds for arbitrary websites using CSS selectors
1–10 of 134 posts
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#2I very simple plumbing tools like these.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#3This is nice. I’m actually doing much the same with Node-RED’s HTML parser, which also supports simple selectors.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#4I wish there's a snippet of what the XML looks like, even better if it's "rendered"...
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#5I wish there's a snippet of what the XML looks like, even better if it's "rendered"...
That's a good one, I'll see if I can add something to the site. Meanwhile you can see the generated examples here:
- https://vincenttunru.gitlab.io/feeds/funfacts.xml
- https://vincenttunru.gitlab.io/feeds/wikivoyage.xml
And the combined feed:
- https://vincenttunru.gitlab.io/feeds/all.xml
Add those links to your feed reader to see rendered examples while I update the site.
Edit: preview added to the website.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#6This is nice. I’m actually doing much the same with Node-RED’s HTML parser, which also supports simple selectors.
Thanks. I initially used a regular HTML parser as well, but I quickly ran into sites that wouldn't render without JavaScript. I'm therefore now using a regular browser controlled by Playwright to fetch the websites.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#7Very nice! I work on Feed Creator - https://createfeed.fivefilters.org - which is similar, although unlike yours doesn't use a headless browser, so selecting Javacript-inserted elements isn't supported.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#8Very nice! I work on Feed Creator - https://createfeed.fivefilters.org - which is similar, although unlike yours doesn't use a headless browser, so selecting Javacript-inserted elements isn't supported.
That looks great! I ran into a couple of feed generators when I first needed this myself, but they were either paid or clumsy to use. That's when I thought, "alright, I can build this myself, and then I can even use CSS selectors, since I'm comfortable with those anyway". Of course, that is the point I should've thought about explicitly searching for one that supported that :)
Ah well. What I do like about my current approach is that I have full control without having to run my own server, which is nice.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#9I wish there's a snippet of what the XML looks like, even better if it's "rendered"...
That's a good one, I'll see if I can add something to the site. Meanwhile you can see the generated examples here: - https://vincenttunru.gitlab.io/feeds/funfacts.xml - https://vincenttunru.gitlab.io/feeds/wikivoyage.xml And the combined feed: - https://vincenttunru.gitlab.io/feeds/all.xml Add those links to your feed reader to see rendered examples while I update the site. Edit: preview added to the website.
FYI, the links inside your feeds don't work, because they are relative, not absolute.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#10Woah this is cool! What you did with the setup documentation and the bit about automation was a nice touch, I wish more projects had this attention to the detail. Very simple, useful and elegant. Thanks for sharing this with us, Vincent!