Live data from Hacker News

Ten years of selling web data: a personal perspective

substack.thewebscraping.club

1–10 of 11 posts

Re: Ten years of selling web data: a personal perspective

#2
“acquiring high-quality alternative data, gathered from nontraditional sources” ?

I’m only a few paragraphs into this, but sure sounds like they’ve been flogging other people’s data so far.

I mean, maybe that’s legal in most places if the data was publicly available ?

Re: Ten years of selling web data: a personal perspective

#3
post #2

“acquiring high-quality alternative data, gathered from nontraditional sources” ? I’m only a few paragraphs into this, but sure sounds like they’ve been flogging other people’s data so far. I mean, maybe that’s legal in most places if the data was publicly available ?

Well, alternative data in general is anonymized and absolutely does not contain any personal info (even because PII is useless for hedge funds, they need to see trends not sell something to people).

Re: Ten years of selling web data: a personal perspective

#4
post #2

“acquiring high-quality alternative data, gathered from nontraditional sources” ? I’m only a few paragraphs into this, but sure sounds like they’ve been flogging other people’s data so far. I mean, maybe that’s legal in most places if the data was publicly available ?

Well, alternative data in general is anonymized and absolutely does not contain any personal info (even because PII is useless for hedge funds, they need to see trends not sell something to people).

I meant data belonging to other companies really, not individuals.

Re: Ten years of selling web data: a personal perspective

#6
Poor guy (/s) complains it's hard to sell data they gained surreptitiously. I mean, screw him, people like this is why you have to run 10x the hardware to serve the actual customers.

I'm not sure what perspective is gained from this post. He says: it's hard to sell raw data, you actually have to provide some value as a business. Shocking.

Scummy scrapper would much rather get something for nothing.

Re: Ten years of selling web data: a personal perspective

#7
post #4

Earlier quoted context omitted.

Well, alternative data in general is anonymized and absolutely does not contain any personal info (even because PII is useless for hedge funds, they need to see trends not sell something to people).

I meant data belonging to other companies really, not individuals.

Unless it’s proprietary data (or data acquired from third parties and elaborated), the other source is mainly web scraping and this is regulated. You need to have the rights to scrape this data, which it means that it’s public data

Re: Ten years of selling web data: a personal perspective

#10
I am unimpressed with the data being sold. For example $25 for prices from a store over time. I fail to see who this market is for. Who needs the data at this price?

They don't tell you what fields, formats just a general description. Not even how big. Doesn't feel good enough

Post reply on HN