Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made a tool to clean and convert any webpage to Markdown

markdowndown.vercel.app

Post reply on HN
Print view View original

31–40 of 107 posts

Re: Show HN: I made a tool to clean and convert any webpage to Markdown

#31

Post by cactusfrog »

IanCal wrote: post #27
chrisweekly wrote: post #20

Earlier quoted context omitted.

"How do you do it without AI" is a question I (sadly) expect to see more often.

Feel free to answer then, how do you do the same functions this does with gpt(3/4) without AI? Edit - This is an excellent use of it, a free text human input capable of doing things like extracting summaries. It does not seem to be used at all for the basic task of extracting content, but for post filtering.

I think “copy from a PDF” could be improved with AI. It’s been 30 years and I still get new lines in the middle of sentences when I try to copy from one.

Re: Show HN: I made a tool to clean and convert any webpage to Markdown

#32

Post by asadm »

foundzen wrote: post #28
LeonidBugaev wrote: post #3

One of the cases when AI not needed. There is very good working algorithm to extract content from the pages, one of implementations: https://github.com/buriy/python-readability

how is it compared to mozilla/readability?

it uses readibility but does some additional stuff like relink images to local paths etc., which I needed

Re: Show HN: I made a tool to clean and convert any webpage to Markdown

#33

Post by rubyn00bie »

blobcode wrote: post #30

This is one of those things that the ever-amazing pandoc ( https://pandoc.org/ ) does very well, on top of supporting virtually every other document format.

I second this. Pandoc is up there as one of the most useful tools that exist, that almost no one talks about. It's amazing, easy to use, and works. I regularly see new tools in the space pop-up, but someone would have to have a REALLY unique and compelling feature, or highly optimized use case to get me to use anything else (besides Pandoc).

Re: Show HN: I made a tool to clean and convert any webpage to Markdown

#36

Post by IanCal »

cactusfrog wrote: post #31
IanCal wrote: post #27

Earlier quoted context omitted.

Feel free to answer then, how do you do the same functions this does with gpt(3/4) without AI? Edit - This is an excellent use of it, a free text human input capable of doing things like extracting summaries. It does not seem to be used at all for the basic task of extracting content, but for post filtering.

I think “copy from a PDF” could be improved with AI. It’s been 30 years and I still get new lines in the middle of sentences when I try to copy from one.

That's a great use case, you might be able to do this if you've got a copy and paste on the command line with

https://github.com/simonw/llm

In between. An alias like pdfwtf translating to "paste | llm command | copy"

Re: Show HN: I made a tool to clean and convert any webpage to Markdown

#37

Post by kwhitefoot »

Davidbrcz wrote: post #17
ChadNauseam wrote: post #5

This is awesome. I kind of want a browser extension that does this to every page I read and saves them somewhere.

Singlefile for Firefox https://addons.mozilla.org/en-US/firefox/addon/single-file/

Also WebScrapBook: https://github.com/danny0838/webscrapbook

Re: Show HN: I made a tool to clean and convert any webpage to Markdown

#38

Post by kwhitefoot »

katehikes88 wrote: post #24

links -dump elinks -dump lynx -dump let me guess, you need more?

If the page is rendered using JavaScript then yes you need more.

If there were a version of links, elinks, or lynx that executed JS that would be wonderful.

Post reply on HN