Live data from Hacker News

Viewing profile — grafraf

grafraf

HN member
Joined
Wed, Aug 07, 2024, 7:31 AM UTC
HN karma
10
Public activity
6 items

About grafraf

No profile information was provided.

Recent public activity

  1. comment
    Comment #41188782

    We are storing the result of the parsed scrape as parquet. I would advice to store the raw data as well in a different s3. The database should only have the data it needs and not a…

  2. comment
    Comment #41188745

    We are selling price/distribution data about the products we scrape. We do run some ads and have an affiliate deals. The insight i can share is that the main (tech) goal is to make…

  3. comment
    Comment #41179805

    We received some harsh words in the start but everything we are doing is legally and by the book. We try to establish good relationship with the stores as the customers don't alway…

  4. comment
    Comment #41179772

    We have been blocked a couple of times during they years, usually using proxy has been enough. We try to reach out to the stores and try to establish a friendly relationship. The f…

  5. comment
    Comment #41179270

    Unfortunately no, but i can share some insights that i hope can be of value: - Tech: Everything is hosted in AWS. We are using Golang in docker containers that does the scraping. T…

  6. comment
    Comment #41179102

    We have been doing it for the Swedish market in more than 8 years. We have a website https://www.matspar.se/ , where the customer can browse all the products of all major online st…