Earlier quoted context omitted.
There’s usually some way to target what you want through descendent/sibling, tag name, and attribute selectors.
Yes, if you're determined enough you can scrape anything. Just not sure what the new thing here is.
Show HN: RSS feeds for arbitrary websites using CSS selectors
61–70 of 134 posts
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#62Earlier quoted context omitted.
Pretty great for April 1st... Or whenever you find an unlocked machine!
When I saw it, I did do the quick calc based on the last update: worked out to around Christmas. OP might have just been bored over the holidays.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#63Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#64Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#65Browsing OP's repositories was this gem: https://gitlab.com/vincenttunru/flatuscode A VSCode extension. That adds farts on every keypress. That's all.
Pretty great for April 1st... Or whenever you find an unlocked machine!
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#66I’m glad to see that you’re using Atom rather than RSS, but you’re still calling it RSS. Can I convince you to stop calling it that? It’s factually inaccurate, and keeps RSS, the inferior format, more popular by virtue of mindshare. Just call them feeds, the proper generic term.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#67Nice, but it's essentially scraping? Scraping is brittle. Some design changes and the whole thing breaks. Maintenance nightmare.
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#68What do I do to get this working? So far I've forked feeds, edited feeds.toml, checked it out as a branch gh-pages, pushed the branch up to github. I can see the page at .github.io/feeds/" rel="nofollow">https:// .github.io/feeds/ but .github.io/feeds/actions" rel="nofollow">https:// .github.io/feeds/actions is just a 404.
Does that work?
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#69Earlier quoted context omitted.
I'm not sure I understand the criticism. What exactly is supposed to be the alternative? It's not like this is supposed to be used for high-availability purposes or stock trading or something. It scratches a particular itch for a handful of end users who just want to get all their news in their feed reader. It's expected that they'll maintain their own scraper parameters.
Pick a number of programming languages and you can scrape a page in 10-20 lines of code in many cases. The barrier to entry is understanding the DOM layout for a particular website, which is subject to change at any moment. Purely IMO, a more friendly way to go about it to abstract from code and CSS knowledge is to run a UI that highlights elements, lets you select them, select the title, description, link etc and th…
And how would that software then remember your chosen elements if not by their CSS ids/classes?
Re: Show HN: RSS feeds for arbitrary websites using CSS selectors
#70Great project, but that's a shitty name.