51–55 of 55 posts
"Generate RSS feed for any website using CSS selectors" For me, "CSS selectors" always seems like a deceptive term, if it means selecting HTML tag elements. What if the website does not use styling. I read 1000s of websites, including all HN submissions, without using CSS. When I want to extract information from a website, I focus on patterns in the page. They might be HTML, they might be style elements, but they cou…
Earlier quoted context omitted.
The web was nicer when you could inspect, learn, & riff off of what others where doing in the industry–like the old music industry used to do when covering & borrowing a phrase was considered homage not grounds for lawsuit. It’s now all meant to be closed off & behind build tools that complect the output where most folks don’t even know how their pipeline works; and this is strange since the simple tools of HTML, CSS…
Agree completely. As a minor nicety, though, I’ve noticed most sites publish sourcemaps in production now. So, in a few ways it’s become more possible to inspect and study JS, compared to when sourcemaps weren’t there, and you could only see mangled source.
Earlier quoted context omitted.
Are you not limited by the cut off date of the content the model is trained off ?
1. the script is generated by the llm 2. the user runs the script that does the scraping these are temporally separate actions
These days I just let chagpt generate a script that scrapes a site and spits out an rss file. Then I run it with cron.
I’m guessing they paste a portion of the website’s source then tell ChatGPT to generate a script that can generate an RSS feed from that site.
Earlier quoted context omitted.
1. the script is generated by the llm 2. the user runs the script that does the scraping these are temporally separate actions
Fine, but it’s subject to html selectors brittleness no? Oh, you subject the raw html when you need it maybe?
1. Tell chatGPT to create a python script that scrapes example.com and generate an rss file.
2. Paste a snippet of the html and tell it to modify the script to use that.
3. I do some minor tweaks myself to fix the date format.