Anyone else getting an error page about this site being reported to be an "attack website"?
Of course it's an "attack website." It'll strip away your HTML, and then what will you have?
The Easy Way to Extract Useful Text from Arbitrary HTML
11–13 of 13 posts
Re: The Easy Way to Extract Useful Text from Arbitrary HTML
#12It's an interesting idea and probably useful in some situations. It would be much more useful, though, if the parser kept structural information about where in the html tree a particular text fragment was found. Lines could still serve as the unit to which statistical analysis is applied (although that seems error prone), but knowing more about the structure would enable further processing down the line.
Re: The Easy Way to Extract Useful Text from Arbitrary HTML
#13Earlier quoted context omitted.
I think it's blacklisted by google but it appears to be perfectly safe
Most attack sites do. Appear to be perfectly safe, that is. For anyone who wants to read the article, this works. (I put in URL_HERE as a placeholder because HN truncates the URL): lynx --dump URL_HERE > output.txt Ironic that to read the article, I used a technique that solves the problem the article is talking about solving. In a much easier way, I might add!
That doesn't solve the actual problem of extracting the article content itself from a page.