Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Personal and social information of 1.2B people discovered in data leak

dataviper.io

Post reply on HN
Print view View original

21–30 of 440 posts

Re: Personal and social information of 1.2B people discovered in data leak

#21

Post by [deleted] »

BrianHenryIE wrote: post #20
toomuchtodo wrote: post #14

Earlier quoted context omitted.

They're everywhere. Just ask Shodan.

> Shodan is a search engine that lets the user find specific types of computers connected to the internet using a variety of filters. Some have also described it as a search engine of service banners, which are metadata that the server sends back to the client. Interesting.

[deleted]

Re: Personal and social information of 1.2B people discovered in data leak

#23

Post by 3fe9a03ccd14ca5 »

imglorp wrote: post #6

In retrospect, it would have been interesting to have a bunch of accounts each containing a unique "map trap", at all of the larger services. Then years later, when the aggregator/broker guys get hacked/sold/leaked, you'd have some picture of the genealogy involved.

The problem is that you often can’t find access to the actual “password” used in the breach. Does anyone know where I can see if it was an actual password or just some made up thing?

Re: Personal and social information of 1.2B people discovered in data leak

#24

Post by Ididntdothis »

Havoc wrote: post #17

Out of curiosity how do you guys think they managed to scrape LinkedIn on such a large scale? I've been wanting to do some social graph experimentation on it (small scale - say 1000 people near me) but concluded I probably couldn't scrape enough via raw scraping without freaking out their anti-scraping. (And API is a non-starter since that basically says everything is verboten).

You probably have to be highly distributed. At least that’s what I did when I tried to scrape a large site some years ago. I had around 100 machines in different countries and gave each of them random pages to scrape.

Re: Personal and social information of 1.2B people discovered in data leak

#25

Post by magashna »

Havoc wrote: post #17

Out of curiosity how do you guys think they managed to scrape LinkedIn on such a large scale? I've been wanting to do some social graph experimentation on it (small scale - say 1000 people near me) but concluded I probably couldn't scrape enough via raw scraping without freaking out their anti-scraping. (And API is a non-starter since that basically says everything is verboten).

It looks like the purpose was data enrichment, so maybe it was pieced together over time from multiple sources. My linkedin from PDL only had 1 bit of wrong info. I wasn't able to find anything on my personal email addresses which is good.

Re: Personal and social information of 1.2B people discovered in data leak

#26

Post by tyri_kai_psomi »

Havoc wrote: post #17

Out of curiosity how do you guys think they managed to scrape LinkedIn on such a large scale? I've been wanting to do some social graph experimentation on it (small scale - say 1000 people near me) but concluded I probably couldn't scrape enough via raw scraping without freaking out their anti-scraping. (And API is a non-starter since that basically says everything is verboten).

Distributed bot and scraper networks. Thousands of IPs geographically dispersed throughout the world. There is only so much you can do with rate limiting.

Re: Personal and social information of 1.2B people discovered in data leak

#27

Post by kerng »

Havoc wrote: post #5
4ad wrote: post #2

Can I do a GDPR request for the data about myself? How?

>Can I do a GDPR request for the data about myself? How? And send it where? It's unclear who owns this server

Start with Google, they will need to figure out and know who the actual owner is and who paid for the resources to host it.

Re: Personal and social information of 1.2B people discovered in data leak

#28

Post by ordinaryradical »

rohan1024 wrote: post #18

Firefox monitor can tell you if your information was leaked in data breaches. I don't think they have this data set though. https://monitor.firefox.com/

Highly recommended. You can put in multiple email addresses, so you can help monitor your non-technical family members’ info as well.
Post reply on HN