Show HN: Full Text, Full Archive RSS Feeds for Any Blog • Hacker News Board

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#21

Post by kevindamm » Mon, Sep 02, 2024, 5:05 PM UTC

8organicbits wrote: post #20

breck wrote: post #14

The future of RSS is "git clone". RSS was invented in 1999, 6 years before git! Now we have git and should just be "git cloning" blogs you like, rather than subscribing to RSS feeds. I still have RSS feeds on all my blogs for back-compat, but git clone is way better.

What problems does that solve? Reading blogs over git clone sounds like re-inventing the wheel. Are there even any tools that do that? If anything were to replace RSS (and Atom) I'd personally hope for h-feed [1] since it's DRYer. But realistically it's going to be hard to eclipse RSS, there's far too much adoption and it is mostly sufficient. [1] https://indieweb.org/h-feed

I'm not the GP commenter, but I'm supposing there would be some way of announcing the git repo where you can find the source -- similar to the `` tag used for RSS, you could have a

..and tooling could take care of all the things you like in an RSS reader. I could see this working really well for static site generators like vitepress or Jekyll or what have you, but going beyond what's in the source is kind of project-specific, but maybe I'm interested in just a summary of commits/PRs

Anyway, there isn't an official IANA-defined type for a git repo (the application/x-git is my closest guess until one became official) but my point is it isn't too far beyond what auto-discovery of RSS is.

I think the GP's comment is from the point of view of making it easy to retrieve the contents of the blog archive, easier than the hoops mentioned (bulk archive retrieval and generating WordPress page sequences, etc.) as well as solving the problem in TFA (partial feeds, partial blog contents in the feed).

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#22

Post by renegat0x0 » Mon, Sep 02, 2024, 5:08 PM UTC

Similar goal, different approach. I wrote RSS reader, that captures link meta from various RSS sources. The meta data are exported every day. I have different repositories for bookmarks, different for daily links, different for 'known domains'.

Written in Django.

I can always go back, parse saved data. If web page is not available, I fall back to Internet Archive.

- https://github.com/rumca-js/Django-link-archive - RSS reader / web scraper

- https://github.com/rumca-js/RSS-Link-Database - bookmarks I found interesting

- https://github.com/rumca-js/RSS-Link-Database-2024 - every day storage

- https://github.com/rumca-js/Internet-Places-Database - internet domains found on the internet

After creating python package for web communication, that replaces requests for me, which uses sometimes selenium I wrote also CLI interface to read RSS sources from commandline: https://github.com/rumca-js/yafr

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#23

Post by breck » Mon, Sep 02, 2024, 5:15 PM UTC

xiande04 wrote: post #15

breck wrote: post #14

The future of RSS is "git clone". RSS was invented in 1999, 6 years before git! Now we have git and should just be "git cloning" blogs you like, rather than subscribing to RSS feeds. I still have RSS feeds on all my blogs for back-compat, but git clone is way better.

And if the blog's repo is private or, gasp, it's not versioned with git?

Then it's not worth reading.

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#24

Post by breck » Mon, Sep 02, 2024, 5:16 PM UTC

8organicbits wrote: post #20

breck wrote: post #14

The future of RSS is "git clone". RSS was invented in 1999, 6 years before git! Now we have git and should just be "git cloning" blogs you like, rather than subscribing to RSS feeds. I still have RSS feeds on all my blogs for back-compat, but git clone is way better.

What problems does that solve? Reading blogs over git clone sounds like re-inventing the wheel. Are there even any tools that do that? If anything were to replace RSS (and Atom) I'd personally hope for h-feed [1] since it's DRYer. But realistically it's going to be hard to eclipse RSS, there's far too much adoption and it is mostly sufficient. [1] https://indieweb.org/h-feed

> What problems does that solve?

A million?

Having your own local copy of your favorite authors' collections is the absolute way to go. So much faster, searchable, transformable, resistant to censorship, et cetera.

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#25

Post by pentagrama » Mon, Sep 02, 2024, 5:22 PM UTC

> generally the RSS and ATOM feeds for any blog, are limited in two ways;

> 1. [limited history of posts]

> 2. [partial content]

To fix the limitation N°1 on some cases, maybe the author can rely on sitemaps [1], is a feature present in many sites (as RSS feeds) and it shows all the pages published.

[1] https://www.sitemaps.org/

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#26

Post by twoprops » Mon, Sep 02, 2024, 5:33 PM UTC

Does no one find it ironic that one of the complaints about RSS feeds is they don't give you the full content, forcing you to visit the site, while trying to access the poster's web site through reader view gives you a warning that you have to visit the site directly to get the full content?

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#27

Post by [deleted] » Mon, Sep 02, 2024, 6:18 PM UTC

z3t4 wrote: post #9

The mystical creature - the URL - is a link to a resource that doesn't have to be static, it's only the URL that is static. eg. the content might change. So you might want to have the program revisit the resource once in a while to see if there are updates.

[deleted]

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#28

Post by breck » Mon, Sep 02, 2024, 7:09 PM UTC

kevindamm wrote: post #21

8organicbits wrote: post #20

Earlier quoted context omitted.

What problems does that solve? Reading blogs over git clone sounds like re-inventing the wheel. Are there even any tools that do that? If anything were to replace RSS (and Atom) I'd personally hope for h-feed [1] since it's DRYer. But realistically it's going to be hard to eclipse RSS, there's far too much adoption and it is mostly sufficient. [1] https://indieweb.org/h-feed

I'm not the GP commenter, but I'm supposing there would be some way of announcing the git repo where you can find the source -- similar to the ` ` tag used for RSS, you could have a ..and tooling could take care of all the things you like in an RSS reader. I could see this working really well for static site generators like vitepress or Jekyll or what have you, but going beyond what's in the source is kind of project…

>

This is a _great_ idea. Let's make this happen.

Edit: okay this is live now in Scroll and across PLDB, my blog, and other sites. Would love if someone could post this link to HackerNews: https://scroll.pub/blog/gitOverRss.html

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#29

Post by zczc » Mon, Sep 02, 2024, 7:22 PM UTC

Looks like a nice tool for extending existing RSS sources. As for the sites that don't have RSS support in the first place, there is also RSSHub [1]. Sadly, you can't use both for the same source: history4feed's trick with the Wayback Machine wouldn't work with the RSSHub feed.

[1] https://rsshub.app/

Re: Show HN: Full Text, Full Archive RSS Feeds for Any Blog

#30

Post by nhggfu » Mon, Sep 02, 2024, 7:26 PM UTC

twoprops wrote: post #26

Does no one find it ironic that one of the complaints about RSS feeds is they don't give you the full content, forcing you to visit the site, while trying to access the poster's web site through reader view gives you a warning that you have to visit the site directly to get the full content?

[flagged]