Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: News Extract API – Pull structured data from online news articles

news.ycombinator.com

Post reply on HN
Print view View original

1–10 of 25 posts

Show HN: News Extract API – Pull structured data from online news articles

#1

Post by artembugara »

Hey HN,

It will be more of a "How I released my API without managing a website, servers, users, and payments. With 0$ up-front cost"

Over the past year, I have come up with a plan of how I could release my own product without having to deal with managing users and/or dealing with payment processing.

It is a 3 steps procedure: 1. Make an API that solves a problem 2. Deploy it with a serverless architecture 3. Distribute through an API Marketplace

That took me about 2-3 days to develop an API using Flask, deploy it via Zappa on AWS, and release through RapidAPI.

Source code of API: https://github.com/kotartemiy/extract-news-api Subscribe to API on Rapid: https://rapidapi.com/provider/4109621/apis/extract-news/user... I'm on ProductHunt today: https://www.producthunt.com/posts/extract-news-api

Full article on how I did it: https://towardsdatascience.com/api-as-a-product-how-to-sell-...

Re: Show HN: News Extract API – Pull structured data from online news articles

#2

Post by axegon_ »

I had done this some years ago but it was completely private and I used it for summarizing news and informing me about certain events and shove a stuff in couchbase for future analysis. Kind of lost interest at some point so I scrapped it.

Looking at yours(This has become some sort of a habit at this point but first thing I did was scroll through the code) the first thing that struck me were the 55 dependencies. Woah...

Re: Show HN: News Extract API – Pull structured data from online news articles

#3

Post by artembugara »

axegon_ wrote: post #2

I had done this some years ago but it was completely private and I used it for summarizing news and informing me about certain events and shove a stuff in couchbase for future analysis. Kind of lost interest at some point so I scrapped it. Looking at yours(This has become some sort of a habit at this point but first thing I did was scroll through the code) the first thing that struck me were the 55 dependencies. Woah…

There are only 3-4 libraries that I installed when developing. Some libraries require other libraries and so on.

Not sure if it is just a Python thing.

Re: Show HN: News Extract API – Pull structured data from online news articles

#5

Post by axegon_ »

artembugara wrote: post #3
axegon_ wrote: post #2

I had done this some years ago but it was completely private and I used it for summarizing news and informing me about certain events and shove a stuff in couchbase for future analysis. Kind of lost interest at some point so I scrapped it. Looking at yours(This has become some sort of a habit at this point but first thing I did was scroll through the code) the first thing that struck me were the 55 dependencies. Woah…

There are only 3-4 libraries that I installed when developing. Some libraries require other libraries and so on. Not sure if it is just a Python thing.

Yeah, figured. I'm guessing you shoved everything from pip freeze into the requirements. I don't recall flask, newspaper or langdetect having pillow as a requirement for example...

Re: Show HN: News Extract API – Pull structured data from online news articles

#6

Post by artembugara »

JPKab wrote: post #4

Thanks for sharing this. I've never played around with Zappa, so looking forward to looking at how you used it. The fact that you're parsing text is icing on the cake, since I love all things NLP.

yeah, Zappa is quite amazing.

Serverless seems like another great tool (supports many languages and many platforms): https://github.com/serverless/serverless

Re: Show HN: News Extract API – Pull structured data from online news articles

#7

Post by speg »

Oh man, I need this. I hope it works better than whatever I was trying before. I was using it to grab all my HN upvote/favs and using Postgres full text search on the article text, but most of them ended up being full of gibberish or missing loads of text. A good way for me to answer "where did I see that article last week..."

Re: Show HN: News Extract API – Pull structured data from online news articles

#8

Post by salmaanp »

Nice, it has some similarities to what I had done earlier. A reddit bot which reads articles and posts a summary in the comments. It lived entirely on the heroku using free dyno. Didn't know there was an API marketplace!

https://github.com/SalmaanP/samacharbot2

Re: Show HN: News Extract API – Pull structured data from online news articles

#9

Post by [deleted] »

axegon_ wrote: post #5
artembugara wrote: post #3

Earlier quoted context omitted.

There are only 3-4 libraries that I installed when developing. Some libraries require other libraries and so on. Not sure if it is just a Python thing.

Yeah, figured. I'm guessing you shoved everything from pip freeze into the requirements. I don't recall flask, newspaper or langdetect having pillow as a requirement for example...

[deleted]
Post reply on HN