Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website

wrapapi.com

Post reply on HN
Print view View original

1–10 of 62 posts

Re: Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website

#2

Post by wrapapi »

Hi everyone! We just released the second version of WrapAPI

We have a new WrapAPI API Builder looks like a browser, and is as easy to use as one too. You can define your API's inputs with a quick tap on the address bar, and point and click at the data you want to extract.

We also have a Chrome extension is smarter and better-integrated than ever. It records your requests and It'll automatically create parameter inputs for the values that change between requests to the same endpoints. The contents of your captures are immediately ready for you to start defining outputs and data to extract too.

Let me know if you have any questions or feedback!

Re: Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website

#4

Post by wrapapi »

salimmadjd wrote: post #3

What if the content you want to scrape->API is behind a login gate? Is there an option of authentication?

You can actually write an API endpoint that'll retrieve a state token (which includes the cookies). For one example, you can use view our Hacker News login endpoint at https://wrapapi.com/#/view/phsource/hackernews/login/latest

That endpoint will then emit a state token, which includes the session cookies. You can feed that state token into your next request and it'll authenticate you

Re: Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website

#7

Post by wrapapi »

RandomBookmarks wrote: post #6

Interesting... how does this compare to https://a9t9.com/kantu/scraping ? WrapApi seems to tackle the same task (web scraping) from a very different angle. I wonder if anyone has used both and can compare.

WrapAPI is meant to not only do scraping (reading information), but also to (1) perform actions with side effects and (2) allow for complex chaining

Let's say you have a web-based inventory management system or CRM that requires a login, but you want to take data a customer has sent you in a spreadsheet and automatically batch enter it into the CRM, which doesn't have that functionality. You could then:

1. Create an API endpoint that allows you to log into that system and return a state token

2. Create a second API endpoint that's parametrized the inputs of the form to create a new inventory entry

3. Chain those 2 API endpoints together so that the 2 actions are actually combined into one API call

Our focus is not only on getting data, but automating the many things that you or your company does with websites to save time

Re: Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website

#8

Post by sharemywin »

wrapapi wrote: post #2

Hi everyone! We just released the second version of WrapAPI We have a new WrapAPI API Builder looks like a browser, and is as easy to use as one too. You can define your API's inputs with a quick tap on the address bar, and point and click at the data you want to extract. We also have a Chrome extension is smarter and better-integrated than ever. It records your requests and It'll automatically create parameter input…

if you take a screen shot of all the items being scraped you could build a dataset for a pretty powerful AI. Something that takes an image of a webpage and out puts machine readable data. Not saying there's a NN that can do it right now but it seems like eventually it could get there.

Re: Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website

#9

Post by sharemywin »

sharemywin wrote: post #8
wrapapi wrote: post #2

Hi everyone! We just released the second version of WrapAPI We have a new WrapAPI API Builder looks like a browser, and is as easy to use as one too. You can define your API's inputs with a quick tap on the address bar, and point and click at the data you want to extract. We also have a Chrome extension is smarter and better-integrated than ever. It records your requests and It'll automatically create parameter input…

if you take a screen shot of all the items being scraped you could build a dataset for a pretty powerful AI. Something that takes an image of a webpage and out puts machine readable data. Not saying there's a NN that can do it right now but it seems like eventually it could get there.

That same dataset in reverse could be an interesting GAN too. takes useful data and outputs a webpage for it.
Post reply on HN