Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

openorb.idiot.sh

Post reply on HN
Print view View original

41–50 of 195 posts

Re: Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

#41

Post by marginalia_nu »

marginalia_nu wrote: post #4

Tangentially on this note, if anyone is interested, I can produce a list of every RSS feed known to the marginalia search crawler. It's a pretty noisy list, but any thing I can do to help the spread, discovery and adoption of RSS I'm happy to help with so just let me know. I a tool in place to export this data to help power the experimental RSS preview feature[1], but haven't had the inspiration to do much with that…

Alright, about half a million RSS feeds available at: https://downloads.marginalia.nu/exports/ [select feeds.csv]

The data is, as mentioned, pretty noisy. It's a best-effort guess as to which is the canonical RSS feed for the particular domain. There doesn't appear to be any convention for specifying this, so when there's multiple a fair bit of guesswork is involved. Expect a fair number of dead URLs, lots of spam from CRMs that generate uninteresting feeds.

Re: Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

#44

Post by tl »

toyg wrote: post #40
tl wrote: post #18

Earlier quoted context omitted.

> No I totally know it's in ascent, that's my point! Haha! :) How do you "know" this? Show some proof! RSS has two well-known use cases: news and podcasts. It is fighting a pitched battle against players with deep pockets who want you to consume content where they can monetize it with ads. Google Reader survived for as long as it did because such a service is incredibly cheap to run. Google only ended it to push peop…

I agree with your view, but if we put down our old greybeard hats for a minute - isn't it nice to see a new generation of people potentially getting excited about RSS? The parent comment is clearly by an optimistic youngster, who has just discovered an awesome technology that (he thinks) could change the world. And maybe it can! Just because we've seen it beaten once (well, a few times), it doesn't mean it's dead, an…

> The parent comment is clearly by an optimistic youngster

My only objection is when the "youngster" had his viewpoint questioned, his response was "no I totally know it's in ascent". Objective evidence points in the opposite direction.

Re: Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

#45

Post by 8organicbits »

mariusor wrote: post #23
marginalia_nu wrote: post #4

Tangentially on this note, if anyone is interested, I can produce a list of every RSS feed known to the marginalia search crawler. It's a pretty noisy list, but any thing I can do to help the spread, discovery and adoption of RSS I'm happy to help with so just let me know. I a tool in place to export this data to help power the experimental RSS preview feature[1], but haven't had the inspiration to do much with that…

Isn't there a way to integrate this type of info into the actual search engine? Ie, search for type:rss or atom and return the links to the RSS feeds? [edit] I mean, to have it closer to what OP showed.

I know the Google search console lets you upload a site map, which can be an RSS feed, so the information is readily available. I suspect Google isn't incentivised to promote RSS, especially after they killed Google Reader.

Re: Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

#46

Post by swyx »

gbrindisi wrote: post #2

I really like the idea! At some point I put up a miniflux instance and it has surprisingly been a breath of fresh air for my content consumption. What miniflux and my setup lacks is a way to retrieve stuff I read and this OpenOrb might fit the use case... I will try it out!

https://github.com/miniflux/v2 in case anyone else was also wondering

Re: Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

#47

Post by fabianholzer »

toastal wrote: post #36

Great to it’s hosted on a free software forge too not locking in contributions! Not sure I always agree that feeds should have the full post tho. This not only (obviously) bloats the size of the feed, but there are valid reasons to want to drive users to your site--especially if you have demos or you write about code & have your code blocks syntax highlighted (statically, never do this with a JavaScript) as it provid…

As a feed consumer I am always happy if a feed contains the full content, but I am not sure if the feed must also include all articles that a site ever published. That would basically make the feed a serialized version of the whole website (which is indeed what a few feeds that I subscribe to do by including sections that are common on personal sites like about/contact/now as items of their feed - but those are the minority). That would actually be fine as long as the archive is small or at certain size, when the feed is paginated. But I am under the impression that most feed generators do not have pagination in mind, also I don't know how well the individual aggregators and readers handle it on the consuming end.

Re: Show HN: OpenOrb, a curated search engine for Atom and RSS feeds

#48

Post by corney91 »

gbrindisi wrote: post #22
freetonik wrote: post #21

Earlier quoted context omitted.

What do you mean by "retrieve stuff I read"?

sometimes I stumble into stuff I’m sure I’ve already read something about in an article but if I didn’t bookmarked or made a note of it it’s very hard to find again (miniflux flushes content after a certain age)

I've set the following in Miniflux to stop it deleting things:

CLEANUP_ARCHIVE_READ_DAYS=-1 CLEANUP_ARCHIVE_UNREAD_DAYS=-1

Post reply on HN