Show HN: News Extract API – Pull structured data from online news articles • Hacker News Board

Re: Show HN: News Extract API – Pull structured data from online news articles

#21

Post by rkwz » Tue, Apr 21, 2020, 6:57 AM UTC

I worked on something similar using a different approach:

Fetch the article

=> Run it through Mozilla Readability library

=> Extract plain content

https://github.com/sheshbabu/readable-scraper/blob/master/in...

Re: Show HN: News Extract API – Pull structured data from online news articles

#22

Post by sloev » Tue, Apr 21, 2020, 7:04 AM UTC

If you want to stay in control of deployment i can recommend Lambdarest instead. Its much simpler: only does routing and input marshaling. Has been in prod since 2017 and is actively maintained (i am doing that ;-)

https://github.com/trustpilot/python-lambdarest

Re: Show HN: News Extract API – Pull structured data from online news articles

#23

Post by artembugara » Tue, Apr 21, 2020, 7:18 AM UTC

sloev wrote: post #22

If you want to stay in control of deployment i can recommend Lambdarest instead. Its much simpler: only does routing and input marshaling. Has been in prod since 2017 and is actively maintained (i am doing that ;-) https://github.com/trustpilot/python-lambdarest

wow, great. I will have a look today

Re: Show HN: News Extract API – Pull structured data from online news articles

#24

Post by dennisy » Tue, Apr 21, 2020, 9:25 AM UTC

holler wrote: post #18

thundergolfer wrote: post #16

Earlier quoted context omitted.

Damn, yeah that's pretty unloved. Weirdly the developer is still advertising consulting services for the project and allowing donations. Given how popular the project is and the owner's absence, community ownership seems like a no-brainer.

I'm using newspaper for a new project and this has me wondering how hard it would be to either fork it or create a new repo and let the community run it... hrmm. For me it's not pressing right now but if it really stays stagnant then maybe.

I am using this lib too in one of our projects, I would be keen to do this.

How best do you think to structure this, move it into its own new org?

I also assume it would be good to try and get hold of the creator first?

Re: Show HN: News Extract API – Pull structured data from online news articles

#25

Post by jonnyscholes » Tue, Apr 21, 2020, 12:25 PM UTC

naikas82 wrote: post #19

I was looking for something like this. But with add-on to summarize the news text as close as human. Any idea???

There's a bot on Reddit that summarizes articles, I see it on r/worldnews. It does a pretty good job most of the time. Looks like it's based on smmry [1]

[0] https://www.reddit.com/r/autotldr/comments/31b9fm/faq_autotl...

[1] https://smmry.com/