LinkedIn loses appeal over access to user profiles

Post by ptero » Sun, Oct 13, 2019, 5:46 PM UTC

psv1 wrote: post #5

echelon wrote: post #2

This is fantastic. I would like to see wider legislation allowing scraping of IMDB, Genius, Reddit, Facebook, and Google made legal. These services receive free input from users. The data should remain free. Edit (sort of off topic): There's still value in the building and providing services at scale, but this lowers the barrier to cross the moat for small players. The first step is data liberation. Then we can work…

Another side of this is that the entity doing the scraping is more often than not another company. Which means that if your proposal is implemented, a user can voluntarily give their personal data to Google/Reddit/Facebook etc but that company then has to make the user's personal data available to another company.

Post by undefined3840 » Sun, Oct 13, 2019, 5:50 PM UTC

Post by OrgNet » Sun, Oct 13, 2019, 5:51 PM UTC

tdhoot wrote: post #11

OrgNet wrote: post #3

Earlier quoted context omitted.

for IMDb, they have a lot of data that is easily accessible, not sure what is missing though: https://datasets.imdbws.com/.. .

Only for personal and non-commercial use, which is probably not what startups need.

Post by brushfoot » Sun, Oct 13, 2019, 5:52 PM UTC

Post by Raidion » Sun, Oct 13, 2019, 5:56 PM UTC

polygot wrote: post #19

echelon wrote: post #2

This is fantastic. I would like to see wider legislation allowing scraping of IMDB, Genius, Reddit, Facebook, and Google made legal. These services receive free input from users. The data should remain free. Edit (sort of off topic): There's still value in the building and providing services at scale, but this lowers the barrier to cross the moat for small players. The first step is data liberation. Then we can work…

If you add .json to the end of a Reddit URL, it will return JSON data. For example: https://www.reddit.com/r/ubuntu.json . It also works with comment threads and posts.