What I am curious to know about is - what company buys from whom and the whole dependency graph to visualise how complex our modern economy is.
But not sure that kind of information is in there.
A raw dump of companies from all over the world by LinkedIn handle
11–20 of 108 posts
Re: A raw dump of companies from all over the world by LinkedIn handle
#12Hey HN, we're thrilled to announce our latest project - the World's Largest Open Source Company Dataset. Our team has been working hard on this product for the past few months, and we're excited to finally share it with you all. We started off years ago trying to build a B2B app, but getting basic company data at scale was a huge barrier for us. This 15M+ record dataset attempts to solve that and has all the key comp…
Out of curiosity: Would you be willing to share how you acquired this data? Website scraping or other means?
Data is very likely to be from LinkedIn if you look at the field descriptions and stats. The only field that is 100% available is the one based on the LinkedIn URL. I would guess scraping unless LinkedIn provides an API for this data that I can't find.
Re: A raw dump of companies from all over the world by LinkedIn handle
#13What would be really interesting is to turn this into a graph based on, say, past experience of CEOs/big dealings with each other/etc.
The moment those graph connections will show negative view of some of those CEOs they will start screaming about privacy issues and/or sue the graph creator.
With scraping LinkedIn alone it should already be possible to create such graphs. Not sure why I haven't seen any. Either scraping LinkedIn isn't as straightforward or such grap-creating attempts have been shut down due to potential for defaming someone.
Re: A raw dump of companies from all over the world by LinkedIn handle
#14How hard is it to scrape LinkedIn for all its public profile data? Do you need special developer access? Do you need to sign some contract with MSFT for anything nontrivial?
Re: A raw dump of companies from all over the world by LinkedIn handle
#15"With over 15 million global companies included..." What distinguishes a global from a non-global company? Also, how many of these are anonymous Delaware/Nevada/South Dakota/etc-based shell companies, or are those excluded from the dataset somehow?
I suspect it means "15 million companies from around the world".
Re: A raw dump of companies from all over the world by LinkedIn handle
#16"With over 15 million global companies included..." What distinguishes a global from a non-global company? Also, how many of these are anonymous Delaware/Nevada/South Dakota/etc-based shell companies, or are those excluded from the dataset somehow?
I think they meant 'from across the globe' as in not necessarily from the US only or other specific geographies.
Re: A raw dump of companies from all over the world by LinkedIn handle
#17Is LinkedIn scraped data open source?
Re: A raw dump of companies from all over the world by LinkedIn handle
#18Good luck with your launch! This reminded me of a similar project, the opencorporates database (https://opencorporates.com/), though the target use cases seem different.
Re: A raw dump of companies from all over the world by LinkedIn handle
#19Earlier quoted context omitted.
Out of curiosity: Would you be willing to share how you acquired this data? Website scraping or other means?
Data is very likely to be from LinkedIn if you look at the field descriptions and stats. The only field that is 100% available is the one based on the LinkedIn URL. I would guess scraping unless LinkedIn provides an API for this data that I can't find.
They (Microsoft) have APIs for app/website integration, but that's all I know about.
Re: A raw dump of companies from all over the world by LinkedIn handle
#20Are the entries deduped? If one company owns another, is that represented as well?