Live data from Hacker News

RSS Box – RSS for websites that do not support RSS

rssbox.herokuapp.com

81–90 of 110 posts

Re: RSS Box – RSS for websites that do not support RSS

#81
post #35

I worry about this being swarmed by traffic and hugged to death. Since it's popular on HN, I imagine the particular Heroku instance is overwhelmed. I was surprised that it worked when I used it. I guess I'm gonna have to pony up and donate then...

Looks like you can self host there is a github repo

Re: RSS Box – RSS for websites that do not support RSS

#82

I tried to tackle this issue in a more general way, so i wrote rss proxy [0], that analyzes the dom structure and derives feed candidates from it. Feel free to try the demo [1] [0] https://github.com/damoeb/rss-proxy/ [1] https://rssproxy.migor.org/

This is amazing. I've been looking for this exact solution. Thanks for your work!

Re: RSS Box – RSS for websites that do not support RSS

#83

There's an open source service that does something similar, does anyone remember its name? edit : Both rssbox in the OP, and RSS-bridge[1] are open source. I was thinking of the latter. There's also RSSHub[2]. [1] https://github.com/RSS-Bridge/rss-bridge [2] https://github.com/DIYgod/RSSHub

There's https://easylist.to/easylist/easylist.txt for universal content-blocking rules, youtube-dl for universal video extraction methods.

While building a feed reader of my own, I had a recent idea for a project for universal content crawling rules: how is the content hierarchy organized on each site and how do you extract it from each content page. A single community project that any other project could use to crawl websites for their content.

Looks like rss-bridge comes close to that.

Re: RSS Box – RSS for websites that do not support RSS

#85
post #25

Off topic but since we are talking about RSS feeds: Is there a web service to replay feeds? Use case are old blog archive one wants to (re-) read sequentially from the start but not in binge mode. So maybe one post per day or week. I'm thinking about the old posts of Aaron Swartz or Steve Yegge. Just adding the feed to a feed reader is often not sufficient because the feed only contains the last 20 entries or so.

Google reader used store every entry in the feed ever, and it was my primary reason for using it. I was subscribed to tons of webcomics, and this allowed me to easily keep track of where I was. The only limitations to this was the rate they checked feeds at (I never read about any complaints about this, but also wasn't looking and wouldn't have been interested at the time), they only had history starting when the first person added a feed, and a large number of blogs and comics would only put notifications in the feed, without any actual content.

Re: RSS Box – RSS for websites that do not support RSS

#86

serious question: does anybody use RSS nowadays?

Found this story via RSS, and once again I find myself surprised that there are nerds out there that read HN but do so through the Olde Timey expedient of going to the home page.

I'd say 95% of my content discovery comes from RSS; the few sites that don't tend to be high volume sites - like news - where I get value from visiting the home page to see how editors have prioritised stories.

Re: RSS Box – RSS for websites that do not support RSS

#87
post #15

Anyone ever did something like this for Facebook? I know it'd have to be subjective per user (security ACLs ⇒ different accounts seeing differing subsets of other accounts' posts); but I'd be fine with just getting my own account's subjective view, by logging into such a service using Facebook OAuth (or, if that isn't enough, then I'd be fine with handing over my Facebook creds themselves, ala XAuth, provided the ser…

RSSBox used to have Facebook support (but only for public pages, no personal content), but when Facebook started cordoning off their API two years ago, I had to turn it off since I was unable to get my application approved. The code is still there, but I am doubtful it would work even if you manage to get an API key that works. I think the best option may be to scrape the web content now, unfortunately.

I have assumed for a while the only way to convert FB -> RSS would be to scrape the home page, but from what I recall the HTML & DOM is all kinds of messed up - intentionally obfuscated to prevent adblocking. From a quick look just now it does seem like it would be a nightmare to try to parse it as-is - and I would guess FB changes a lot of the output regularly anyway to defeat adblockers, making efforts to keep up pretty challenging.

Re: RSS Box – RSS for websites that do not support RSS

#88
post #78

You can actually get RSS feeds for YouTube: emacs users like myself who consume YouTube via elfeed have been doing it like so: " rel="nofollow">https://www.youtube.com/feeds/videos.xml?playlist_id= Or " rel="nofollow">https://www.youtube.com/feeds/videos.xml?channel_id= More info here: https://joshrollinswrites.com/help-desk-head-desk/20200611/ It really helps to break away from the addictive properties of YouTube's…

Wow... I wrote my own WebSub receiver and put it on an always-on server to get around the fact that I assumed YouTube doesn't have RSS from the fact that I couldn't find this information anywhere.

It's crazy how rare it's become to see an RSS link on websites that actually have it if you add /feed or /feed.xml to the url.

I have to wonder how much more dead RSS would be if Wordpress (like, 90% of blogs/news sites) didn't create a /feed by default.

Re: RSS Box – RSS for websites that do not support RSS

#89

A somewhat unconventional UI for following content, which incidentally works with RSS Box, is Fraidycat[0]. It groups recent posts under “individuals” with a visualization of how much recent activity there is in a given feed, and allows to choose “follow intensity” which works in a nice and transparent way. [0] https://news.ycombinator.com/item?id=22545878

Hey thanks for this lovely pitch, goblin89. <3 all my goblin friends out there

I learned of Fraidycat in an RSS related HN comment yesterday and have been trying it out. Love some of the homemade quirkiness that I forgot software used to have -- the video is great too.

Only question I have: do you really have to assign every Github issue to yourself, the sole developer? Something about it cracks me up: https://github.com/kickscondor/fraidycat/issues

> "Thanks for the bug report. Fortunately for you, our best man is on the job!"

> kickscondor has assigned the issue to kickscondor

Anyways, just playing. Great product and great shepherding of the Github project.

Re: RSS Box – RSS for websites that do not support RSS

#90

There's an open source service that does something similar, does anyone remember its name? edit : Both rssbox in the OP, and RSS-bridge[1] are open source. I was thinking of the latter. There's also RSSHub[2]. [1] https://github.com/RSS-Bridge/rss-bridge [2] https://github.com/DIYgod/RSSHub

There's https://easylist.to/easylist/easylist.txt for universal content-blocking rules, youtube-dl for universal video extraction methods. While building a feed reader of my own, I had a recent idea for a project for universal content crawling rules: how is the content hierarchy organized on each site and how do you extract it from each content page. A single community project that any other project could use to craw…

To help extract article content, you might be interested in this collection I help maintain: https://github.com/fivefilters/ftr-site-config/

It's used, in addition to an automatic article extractor, in Full-Text RSS: http://ftr.fivefilters.org

Post reply on HN