[dead]
Show HN: I made a tool to clean and convert any webpage to Markdown
71–80 of 107 posts
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#72Vercel!! Watch out for you bill now this is being hugged. Hopefully you are not using like they pester you to do.
it has actually scaled pretty well and has been negligible cost-wise.
I didn’t have to do anything to handle HN traffic. Just a boilerplate nextjs app.
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#73Earlier quoted context omitted.
Wouldn’t that describe Pocket, Readwise Reader, Matter, or another one of those many apps? Edit: read too fast. Didn’t notice the automatic and systematic aspects.
Pocket saves the address; I don't think they save the content.
Just checked it, they also save the content.
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#74I built a no-code github blog deployer thingy that lets you deploy a blog to to github pages from a codespace. https://github.com/ShelbyJenkins/easy-astro-blog-creator
Anyways, it uses astro + markdown.
It'd be really neat if I could scrape my medium account to convert it to markdown to save me the trouble.
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#75Vercel!! Watch out for you bill now this is being hugged. Hopefully you are not using like they pester you to do.
it's pretty sad, they motivate you all throughout their docs to use it, when just a webp would work ok
it's literally that meme of the bus — the happy guy is you and vercel and the sad one is your wallet
(unless you need dynamic scaling and minification though)
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#76I did cnn.com and it just downloaded a file that said cnn.com can't be found lol
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#77Converting websites to markdown comes with 3 distinct problems: 1. Throughly scraping the content of page (high recall) 2. Dropping all the ads/auxilliary content (high precision) 3. And getting the correct layout/section types (formatting) For #2 and #3 - Trafilatura, Newspaper4k and python-readability based solutions work best out of the box. For #1, any scraping service + selenium is going to do a great job. Could…
Those are pretty damn cool i didnt know those even existed.
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#78Pretty cool.
I build something very similar - smort.io . Just prepend smort.io/ before any article URL to easily edit, annotate and share it with anyone.
Also works on ArXiv papers!
This was the Show HN post for Smort - https://news.ycombinator.com/item?id=30673502
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#79I did cnn.com and it just downloaded a file that said cnn.com can't be found lol
I wonder if it's not following redirects well
Re: Show HN: I made a tool to clean and convert any webpage to Markdown
#80Earlier quoted context omitted.
how is it compared to mozilla/readability?
it uses readibility but does some additional stuff like relink images to local paths etc., which I needed
I have had challenges with readability. The output is good for blogs but when we try it for other type of content, it misses on important details even when the page is quite text-heavy just like blog.