Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: TLDR This – Auto summarize any article or webpage in a click

tldr.hackeryogi.com

Post reply on HN
Print view View original

71–80 of 117 posts

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#71

Post by asdkhadsj »

On this note - anyone familiar with a similar implementation, preferably one like Outline.com that copies the whole content, but in a local.. none web-based format?

I'm writing a Rust library that for Archival purposes I want to immutably refer to source content. So in short, I need to download it and store it immutably. Yet, don't want to grab all the html, UI images, ads, etc - I just want the content. I've found Outline.com amazing, but the tool I'm writing is "distributed", so I don't want to depend on a service.

Anyone familiar with local tooling for these types of services? TLDR, Outline, etc?

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#72

Post by hacker089 »

andreareina wrote: post #30
radhakrsna wrote: post #23

Earlier quoted context omitted.

Hi, - Yes, you are totally right. TextRank is an extractive method. - Ah right. But we aren't storing any information on our servers, just showing selected sentences to the user. - We select the top 5 sentences which have the highest relevancy to the article. I am not an expert in this field so not too sure if that's the best way. Just started with NLP a few days back and wanted to test it out by developing a small a…

> But we aren't storing any information on our servers, just showing selected sentences to the user. If this is in reference to the copyright comment, it doesn't matter -- you're still transmitting/redistributing the content, which is what matters. One way to get around this is to ship the code and have the code execute on the user's machine (i.e. what you're presumably doing with the extension).

Well, my copyright comment was targetted at a distinct case (like "redistributing the summary" on another website or in a book)

Though, just by copying & summarizing with your current implementation, there would be NO ONE to sue you, since you are just grabbing it and displaying it in the browser (sure, depending on the jurisdiction, one may rate this simple step already as some type of copyright issue)

In reality, this will not happen. (Except in North Korea ;-)

My comment regarding copyright was really about grabbing, summarizing and re-distributing it on another webpage, like a news aggregator.

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#73

Post by asdkhadsj »

bbmario wrote: post #67

Any open-source libraries that do this, or anything similar to this?

I actually commented[1] similar to this. I may end up eventually writing one, though I have no idea what is involved. What are your use cases? Are you aware of anything even close? I could definitely use jumping off points for implementation, as I've got no idea how to write something like this.

[1]: https://news.ycombinator.com/item?id=20547875

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#74

Post by donohoe »

HugThem wrote: post #59
andreareina wrote: post #30

Earlier quoted context omitted.

> But we aren't storing any information on our servers, just showing selected sentences to the user. If this is in reference to the copyright comment, it doesn't matter -- you're still transmitting/redistributing the content, which is what matters. One way to get around this is to ship the code and have the code execute on the user's machine (i.e. what you're presumably doing with the extension).

you're still transmitting/redistributing the content Parts of it. Google does the same in their search results. The user can even decide which parts, because they show you the part that contains the search term. So they provide a service that includes storing your content in it's entirety. Has this ever been tested in court?

Google is doing something different in regular search results.

They are showing a small extract for context OR a summary specified by the publisher.

That’s completely legit and fair use.

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#77

Post by thekyle »

asdkhadsj wrote: post #71

On this note - anyone familiar with a similar implementation, preferably one like Outline.com that copies the whole content, but in a local.. none web-based format? I'm writing a Rust library that for Archival purposes I want to immutably refer to source content. So in short, I need to download it and store it immutably. Yet, don't want to grab all the html, UI images, ads, etc - I just want the content. I've found O…

There is a Python library called Newspaper that is designed to do that. I believe this is what outline.com uses.

There is also a JS library called readability which is what is used by Firefox's reader mode.

https://newspaper.readthedocs.io/en/latest/

https://github.com/mozilla/readability

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#78

Post by LoSboccacc »

romeo and juliet out of project gutenberg: all sentences were extracted from project gutenberg's own introduction

http://www.gutenberg.org/cache/epub/1777/pg1777.html > https://i.imgur.com/pRX5eeP.png

so I looked for something that was just the play http://shakespeare.mit.edu/romeo_juliet/full.html > https://i.imgur.com/f2bM8yW.png

and there are only a handful character entrances

we seems to be quite a way off from summarizing 'anything'.

Re: Show HN: TLDR This – Auto summarize any article or webpage in a click

#79

Post by simonebrunozzi »

Good luck! I tried to launch something like this years ago [0] specifically to summarize HN, it's not easy but I think there's value in this type of service.

In my case, the summarization was manual - I wanted to see if people liked the service, before building the summarization engine.

I also created a chrome extension to be able to see summarize with just one click from HN itself.

[0]: https://github.com/simonebrunozzi/MNMN

Post reply on HN