31–40 of 110 posts
I wrote a similar tool (but not as polished) that requires you to write custom plugins. This works well if you have websites that are hard to scrape in an automated way. Maybe it's useful to someone else: https://github.com/dewey/feedbridge
Is it necessary to write a plugin for each website?
> FYI: If you enable JavaScript then you be able to access additional options in the dropdown menus. The website should still be somewhat usable, but recent versions of Firefox will try to download the RSS feeds. This is how you communicate with people with JavaScript disabled! Kudos. Most sites either present you with a blank page with no information, a blank page asking to enable JavaScript (even when the content i…
Feed aggregation services tend to minimize the frequency of requests especially for unpopular feeds since more requests = higher load for them as well. The incentives on the publishing and consuming sides align. Many services only offer to increase crawling frequencies for premium users, and even then only for a limited number of feeds. Not to mention they only need to crawl once for however many subscribers. It’s re…
Prioritizing lower subscribership feeds if a smaller number of premium customers add them makes some sense though.
Does anyone remember Yahoo Pipes? That was awesome, I mostly used it (around 2008-2010) to make RSS for sites where it wasn't available https://en.wikipedia.org/wiki/Yahoo!_Pipes
https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
Off topic but since we are talking about RSS feeds: Is there a web service to replay feeds? Use case are old blog archive one wants to (re-) read sequentially from the start but not in binge mode. So maybe one post per day or week. I'm thinking about the old posts of Aaron Swartz or Steve Yegge. Just adding the feed to a feed reader is often not sufficient because the feed only contains the last 20 entries or so.
Off topic but since we are talking about RSS feeds: Is there a web service to replay feeds? Use case are old blog archive one wants to (re-) read sequentially from the start but not in binge mode. So maybe one post per day or week. I'm thinking about the old posts of Aaron Swartz or Steve Yegge. Just adding the feed to a feed reader is often not sufficient because the feed only contains the last 20 entries or so.
Sounds like internet archive for RSS.
Earlier quoted context omitted.
Feed aggregation services tend to minimize the frequency of requests especially for unpopular feeds since more requests = higher load for them as well. The incentives on the publishing and consuming sides align. Many services only offer to increase crawling frequencies for premium users, and even then only for a limited number of feeds. Not to mention they only need to crawl once for however many subscribers. It’s re…
An aggregator most likely would prioritize feeds by popularity and then run most of their crawlers 24/7. Telling some users that a popular feed has new entries and not telling the free tier sounds complicated. Unless the free tier is getting a read replica of the database, in which case it’s throttled only by how far behind the read replicas get. Prioritizing lower subscribership feeds if a smaller number of premium…
The service https://feed43.com will enable you you to build a RSS feed out of pretty much anything with a URL. I use it to build RSS out of sha256 release files, vendor client download release pages, changelogs, etc.
Out of curiosity, what is your software stack?
I tried a whole lot of solutions before discovering this service, its the only one I've found flexible enough to handle these random tech endpoint formats, it's basically like RSS-Bridge (mentioned in other comments) with a visual regex parser built in to avoid having to write actual code like RSS-Bridge requires. $0.02 YMMV :)
Related (maybe) but tangential, does anyone know of a good web to text converter? Back in the day you used to just use Lynx, is that still the way or has it been surpassed?