Live data from Hacker News

RSS Box – RSS for websites that do not support RSS

rssbox.herokuapp.com

21–30 of 110 posts

Re: RSS Box – RSS for websites that do not support RSS

#21
RSS Box is great - perfect for the kind of sites where scraping from the HTML is problematic because the HTML changes so much.

I work on a somewhat similar project called Feed Creator which can be used for less popular pages where you can select elements for the feed using CSS selectors: https://createfeed.fivefilters.org

Re: RSS Box – RSS for websites that do not support RSS

#24
post #2

> FYI: If you enable JavaScript then you be able to access additional options in the dropdown menus. The website should still be somewhat usable, but recent versions of Firefox will try to download the RSS feeds. This is how you communicate with people with JavaScript disabled! Kudos. Most sites either present you with a blank page with no information, a blank page asking to enable JavaScript (even when the content i…

> What if we don’t have control over the frequency of requests (e.g. using a service like Feedly)? Do those happen often enough that we’d need to host the app ourselves?

I run a similar service where I rate limit. I've whitelisted the IPs of the centralised feed readers like Feedly (at least the ones I've been able to identify), but the reate limit for non-whitelisted IPs is generous enough that it's really there to only catch the really problematic scripts which crop up from time to time.

Re: RSS Box – RSS for websites that do not support RSS

#25
Off topic but since we are talking about RSS feeds: Is there a web service to replay feeds?

Use case are old blog archive one wants to (re-) read sequentially from the start but not in binge mode. So maybe one post per day or week. I'm thinking about the old posts of Aaron Swartz or Steve Yegge.

Just adding the feed to a feed reader is often not sufficient because the feed only contains the last 20 entries or so.

Re: RSS Box – RSS for websites that do not support RSS

#26
post #17

In the same vein : RSS-Bridge https://github.com/RSS-Bridge/rss-bridge (you can find multiple instances on the web)

Nice one. As much as I approve of services I'd rather self-host. Tired of people pulling the rug out under my feet

You can self-host this one as well. They mention it on the page and link to the GitHub repo: https://github.com/stefansundin/rssbox

Re: RSS Box – RSS for websites that do not support RSS

#28

The service https://feed43.com will enable you you to build a RSS feed out of pretty much anything with a URL. I use it to build RSS out of sha256 release files, vendor client download release pages, changelogs, etc.

Out of curiosity, what is your software stack?

Re: RSS Box – RSS for websites that do not support RSS

#30
post #23

I wrote a similar tool (but not as polished) that requires you to write custom plugins. This works well if you have websites that are hard to scrape in an automated way. Maybe it's useful to someone else: https://github.com/dewey/feedbridge

Is it necessary to write a plugin for each website?
Post reply on HN