Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hacker News BigQuery Dataset

console.cloud.google.com

Post reply on HN
Print view View original

31–38 of 38 posts

Re: Hacker News BigQuery Dataset

#31

Post by tobr »

dasil003 wrote: post #30
CobrastanJorji wrote: post #28

Earlier quoted context omitted.

The GDPR's super complicated, but I'm pretty sure its Right of Erasure, and specifically Article 7(3), which gives data subjects the right to withdraw consent at any time and the clause “it shall be as easy to withdraw consent as to give it" trumps any ridiculous "irrevocable" license to distribute your content in any form forever. Also importantly, the GDPR requires that a controller not make a service conditional u…

IAANAL, and I don't mean to single you out here, but this seemingly rational argument strikes me as subtle FUD. It's the type of argument that someone with a vested interest in collecting user data for profit might put forth in the hopes of polarizing the tech community and painting GDPR as out of touch with technical common sense. Again, I'm not accusing you of anything here, I'm just pointing out who benefits from…

What about this is out of touch with technical common sense? If you export all your user data and syndicate it, why would it be so unreasonable to have a system in place to be able to syndicate requests to delete data as well?

All of us here are users of this forum, so this concerns the legal rights to our personal information. It’s not FUD for us to discuss how those rights are affected by things like this.

Re: Hacker News BigQuery Dataset

#32

Post by dasil003 »

tobr wrote: post #31
dasil003 wrote: post #30

Earlier quoted context omitted.

IAANAL, and I don't mean to single you out here, but this seemingly rational argument strikes me as subtle FUD. It's the type of argument that someone with a vested interest in collecting user data for profit might put forth in the hopes of polarizing the tech community and painting GDPR as out of touch with technical common sense. Again, I'm not accusing you of anything here, I'm just pointing out who benefits from…

What about this is out of touch with technical common sense? If you export all your user data and syndicate it, why would it be so unreasonable to have a system in place to be able to syndicate requests to delete data as well? All of us here are users of this forum, so this concerns the legal rights to our personal information. It’s not FUD for us to discuss how those rights are affected by things like this.

Let's leave syndication aside for a moment; I don't think it's unreasonable for a forum to have terms of use that you are participating in a public forum that needs to maintain integrity. If people just go deleting their posts then it screws up the public discourse. I've actually had the experience of building and running a forum that allowed deleting your content in this way, and we had to remove the capability as trolls used it in a specifically destructive capacity.

Now this position is certainly debatable, but I think it's at least a reasonable argument that you could take to regulators. Contrast that with the bullshit that Facebook, Google and a zillion ad-tech companies are doing with our data every day. You're free to object to the syndication of HN data, but personally I feel that is a distraction from the issues GDPR is meant to address, and I am hoping regulators feel the same way.

Re: Hacker News BigQuery Dataset

#34

Post by petercooper »

CobrastanJorji wrote: post #28
petercooper wrote: post #19

Earlier quoted context omitted.

If people are sharing their own PII in HN comments, they agreed to HN's T&Cs when signing up. Such T&Cs state (heavily trimmed for length): By uploading any User Content you hereby grant [..] a nonexclusive, worldwide [..] irrevocable license to [..] distribute [..] your User Content for any Y Combinator-related purpose in any form [..] Agreeing to the T&Cs and deliberately sharing information publicly covers the GDP…

The GDPR's super complicated, but I'm pretty sure its Right of Erasure, and specifically Article 7(3), which gives data subjects the right to withdraw consent at any time and the clause “it shall be as easy to withdraw consent as to give it" trumps any ridiculous "irrevocable" license to distribute your content in any form forever. Also importantly, the GDPR requires that a controller not make a service conditional u…

its Right of Erasure, and specifically Article 7(3), which gives data subjects the right to withdraw consent at any time and the clause “it shall be as easy to withdraw consent as to give it" trumps any ridiculous "irrevocable" license to distribute your content

Correct. You can certainly attempt to assert your right of erasure with YC to erase your PII from their data (i.e. Hacker News).

But..! Because we give YC the right to distribute our content freely, we simultaneously realize that there may be many duplications and reproductions of this data. The consequence of this is that we must contact any/every user of that data yourself on a one-by-one basis to assert your right of erasure - there is no legal obligation for HN to track everyone who might have downloaded a legal archive of their data.

Re: Hacker News BigQuery Dataset

#35

Post by petercooper »

tobr wrote: post #29
petercooper wrote: post #19

Earlier quoted context omitted.

If people are sharing their own PII in HN comments, they agreed to HN's T&Cs when signing up. Such T&Cs state (heavily trimmed for length): By uploading any User Content you hereby grant [..] a nonexclusive, worldwide [..] irrevocable license to [..] distribute [..] your User Content for any Y Combinator-related purpose in any form [..] Agreeing to the T&Cs and deliberately sharing information publicly covers the GDP…

I’m not really sure that matters. GDPR includes the right to withdraw consent and the right to erasure, unless there are specific legal reasons why data can not be erased. Requests for erasure should be forwarded to third parties who use the data.

That is correct but this is why the license matters so much. The license determines that there can/will ultimately be many distributed versions of the content and you would need to go to the users one-by-one to withdraw that consent or request erasure.

Re: Hacker News BigQuery Dataset

#36

Post by shanecglass »

minimaxir wrote: post #2

Looks like it stopped updating as of February 2nd, but otherwise it's pretty reliable, and as noted in the description, it's free. (you probably won't hit the 1TB limit working with this dataset). Here's a few queries I've done recently to answer ad-hoc questions to get an exact answer: Top posts about bootstrapping ( https://news.ycombinator.com/item?id=19258249 ): #standardSQL SELECT * FROM `bigquery-public-data.ha…

Hey all,

I manage the BigQuery Public Datasets Program here at Google. You're right, the dataset last updated February 2nd, but we intend to continuing updating it. We had an issue on our end that disrupted our update feed, but we're working to repair it now and get the latest data uploaded to BigQuery.

Re: Hacker News BigQuery Dataset

#37

Post by CobrastanJorji »

dasil003 wrote: post #30
CobrastanJorji wrote: post #28

Earlier quoted context omitted.

The GDPR's super complicated, but I'm pretty sure its Right of Erasure, and specifically Article 7(3), which gives data subjects the right to withdraw consent at any time and the clause “it shall be as easy to withdraw consent as to give it" trumps any ridiculous "irrevocable" license to distribute your content in any form forever. Also importantly, the GDPR requires that a controller not make a service conditional u…

IAANAL, and I don't mean to single you out here, but this seemingly rational argument strikes me as subtle FUD. It's the type of argument that someone with a vested interest in collecting user data for profit might put forth in the hopes of polarizing the tech community and painting GDPR as out of touch with technical common sense. Again, I'm not accusing you of anything here, I'm just pointing out who benefits from…

That honestly scares me, though. A law that everybody is violating but that is only rarely enforced is a law that will be used to go after whoever the government doesn't like. Imagine a European hate speech forum that gets a lot of press sometime. The government will just step in and say "oops, looks like you're not in GDPR compliance!" and sue them into nonexistence.

Re: Hacker News BigQuery Dataset

#38

Post by minimaxir »

shanecglass wrote: post #36
minimaxir wrote: post #2

Looks like it stopped updating as of February 2nd, but otherwise it's pretty reliable, and as noted in the description, it's free. (you probably won't hit the 1TB limit working with this dataset). Here's a few queries I've done recently to answer ad-hoc questions to get an exact answer: Top posts about bootstrapping ( https://news.ycombinator.com/item?id=19258249 ): #standardSQL SELECT * FROM `bigquery-public-data.ha…

Hey all, I manage the BigQuery Public Datasets Program here at Google. You're right, the dataset last updated February 2nd, but we intend to continuing updating it. We had an issue on our end that disrupted our update feed, but we're working to repair it now and get the latest data uploaded to BigQuery.

Great to hear! :)
Post reply on HN