Viewing profile — grafraf
grafraf
HN member- Joined
- Wed, Aug 07, 2024, 7:31 AM UTC
- HN karma
- 10
- Public activity
- 6 items
- HN profile
- View on Hacker News ↗
About grafraf
No profile information was provided.
Recent public activity
-
comment
Comment #41188782
We are storing the result of the parsed scrape as parquet. I would advice to store the raw data as well in a different s3. The database should only have the data it needs and not a…
-
comment
Comment #41188745
We are selling price/distribution data about the products we scrape. We do run some ads and have an affiliate deals. The insight i can share is that the main (tech) goal is to make…
-
comment
Comment #41179805
We received some harsh words in the start but everything we are doing is legally and by the book. We try to establish good relationship with the stores as the customers don't alway…
-
comment
Comment #41179772
We have been blocked a couple of times during they years, usually using proxy has been enough. We try to reach out to the stores and try to establish a friendly relationship. The f…
-
comment
Comment #41179270
Unfortunately no, but i can share some insights that i hope can be of value: - Tech: Everything is hosted in AWS. We are using Golang in docker containers that does the scraping. T…
-
comment
Comment #41179102
We have been doing it for the Swedish market in more than 8 years. We have a website https://www.matspar.se/ , where the customer can browse all the products of all major online st…