Viewing profile — mateuszbuda

Welcome to the zoo! ScrapingFish :)

Here you can find statistics based on data scraped from Indie Hackers, but it’s not split by the tool size: https://scrapingfish.com/blog/indie-hackers-revenue

There are many different methods used by proxy providers to unethically source their IPs: https://scrapingfish.com/how-ips-for-web-scraping-are-source...

There’s AWS Bedrock Knowledge Base (Amazon proprietary RAG solution) which can digest PDFs and, as far as I tested it on real world documents, it works pretty well and is cost effe…

You can use a USB hub (example with 20 ports: https://www.sipolar.com/product/a-805p-20-ports-usb-2-0-hub/ ) and attach multiple USB dongles to it. This blog post describes a setup…

Do you have an idea what would be my external IP address? On my phone connected to a mobile network, I get assigned mobile IP address which is my external IP address. It's not atta…

Can I use this to run my own mobile network? Is there something like a blank SIM card which I could use for it? I don't need global coverage but is it possible to create my own BTS…

What exactly doesn't work well? Did you consider playwright?

I don’t really know. I don’t write posts to optimize for SEO (include FAQ at the end or something like that) and hope it’s just good content people will share. There are also SEO p…

Content marketing - blog posts with useful content posted around the Internet. Most traffic from HN and Reddit.

I think that LLM costs, even GPT-4o, are probably lower compared to proxy costs usually required for web scraping at scale. The cost of residential/mobile proxies is a few $ per GB…

I agree that web scraping is a shady business in many cases but there is definitely a difference between setting up a few mobile proxies for yourself and using devices and networks…

Here are some insights into how proxies are sourced: https://scrapingfish.com/how-ips-for-web-scraping-are-source... There's also an option to build your own mobile proxy pool whic…

I would also include deceptive credits systems used by SaaS which have usage-based like subscriptions. It’s a bait and switch variant. First, you think one call to the API is one c…

I tried not buying food with added sugar but it’s surprisingly difficult. Here is an interesting analysis I did some time ago which shows that for half of the food items, sugar is …

At https://scrapingfish.com/ we have both options, usage based https://scrapingfish.com/buy and subscriptions (monthly unlimited requests plan) https://scrapingfish.com/unlimited .…

I’m still working on a web scraping API ( https://scrapingfish.com/ ). For some people it’s evil bot but for others it’s enabler for public data access. I think it’s useful.

Anyone can share experience with https://ollama.com/ ?

We keep working on web scraping API with custom-made mobile proxy pool: https://scrapingfish.com/ There is no AI in it so far but we consider adding support for parsing the result …

Two main differentiators. 1. Pricing. We charge for requests and the cost of each successful request is the same as opposed to misleading API credits system used by others. Also, w…

To give you a reference point, at https://scrapingfish.com/ we charge $0.002 per API call but in our case, the API call gives you the value by itself: access to mobile proxies and …

Only around 5% of the products from IndieHackers generate a monthly revenue exceeding ~$8,333 (around ~$100k/year). Source: https://scrapingfish.com/blog/indie-hackers-revenue

A web scraping API: https://scrapingfish.com/