Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Semantic clusters and embeddings for 500k Hacker News comments

app.airtrain.ai

Post reply on HN
Print view View original

21–30 of 54 posts

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#21

Post by maleldil »

GeoAtreides wrote: post #13
neutralino1 wrote: post #9

Earlier quoted context omitted.

The original dataset is located at [1] (not our HF account). HN data is directly available via the HN API [2]. The privacy policy you point to does not cover HN posts. [1] https://huggingface.co/datasets/OpenPipe/hacker-news [2] https://github.com/HackerNews/API

Well, then the original dataset should also remove my data. Just because it's there doesn't mean it's there legally. It covers all User Content, which is comments and post titles (I think) at a minimum.

From your link:

> Hacker News Information: If you create a Hacker News account (ID and profile), we do not collect any Personal Information unless you choose to provide your email address and/or information in the "about" field (“HN Information”). Your submissions to, and comments you make on, the Hacker News site are not Personal Information and are not "HN Information" as defined in this Privacy Policy.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#22

Post by renewiltord »

GeoAtreides wrote: post #5

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

This is pretty clever. Reminds me of Larry Philpot's time-bomb CC-licensed images https://commons.wikimedia.org/wiki/File:Flaming_Lips.jpg

You put things in a place with an expectation of a certain standard of use and then go after people hammer and tongs with a strict interpretation. Sometimes, the strict interpretation need not be valid. You can just shake them down.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#23

Post by Lerc »

GeoAtreides wrote: post #5

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

If they are an entity other than HN, how can they act upon this request when the request is itself data on HN?

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#24

Post by GeoAtreides »

daemonologist wrote: post #19
GeoAtreides wrote: post #12

Earlier quoted context omitted.

> Y Combinator and its affiliated companies My data is licensed only to Y Combinator and its affiliated companies (I would have prefer it to be licensed it only for news.ycombinator,com), not any other rando that can access it via a browser or an API

Sematic (OP's employer; rebranded to Airtrain?) is a YC company. Not a lawyer but I assume that would be included in "affiliated" since YC presumably has some ownership of them. https://www.ycombinator.com/companies/airtrain-ai

Welp, there it is then.

If they are YC affiliated, nothing I can do.

But I do feel saddened and personally betrayed; I thought the licence I gave to YN was just for news.ycombinator.com to store and show my comments, not for any other purposes.

Silly, silly me.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#25

Post by olivierduval »

GeoAtreides wrote: post #5

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

Actually, another problem might be GDPR: I have found my username... and that is a clearly a PII because it's directly and univocally bound to me

I dont really care (for now) about this... but on the principle, I'm a bit fed up too by companies just crawling anything to train anymodel without any care about the datas, the people that produced them, and the consequences on people's life.

Maybe I could use the new European AI Act too (https://artificialintelligenceact.eu/fr/high-level-summary/) ... although I'm not sure because I didn't read it yet

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#26

Post by [deleted] »

GeoAtreides wrote: post #12
thenewnewguy wrote: post #10

Earlier quoted context omitted.

You did, although I have no idea if OP is an affiliate of YC (IANAL but maybe you could argue the public API is a form of sublicensing the data?): > By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, stor…

> Y Combinator and its affiliated companies My data is licensed only to Y Combinator and its affiliated companies (I would have prefer it to be licensed it only for news.ycombinator,com), not any other rando that can access it via a browser or an API

[deleted]

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#27

Post by lolinder »

thenewnewguy wrote: post #10
GeoAtreides wrote: post #5

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

You did, although I have no idea if OP is an affiliate of YC (IANAL but maybe you could argue the public API is a form of sublicensing the data?): > By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, stor…

> IANAL but maybe you could argue the public API is a form of sublicensing the data?

Given that the license is explicitly identified as both sublicensable and transferable and includes the right to distribute, I have a very hard time seeing how anyone could argue that the recipient of data that YC explicitly exposes through their "Official HN API" isn't allowed to use it.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#28

Post by senordevnyc »

GeoAtreides wrote: post #24
daemonologist wrote: post #19

Earlier quoted context omitted.

Sematic (OP's employer; rebranded to Airtrain?) is a YC company. Not a lawyer but I assume that would be included in "affiliated" since YC presumably has some ownership of them. https://www.ycombinator.com/companies/airtrain-ai

Welp, there it is then. If they are YC affiliated, nothing I can do. But I do feel saddened and personally betrayed; I thought the licence I gave to YN was just for news.ycombinator.com to store and show my comments, not for any other purposes. Silly, silly me.

All HN did do was store and show your (public) comments.

What this other company did with that (public) data seems to me to be a separate issue that you should take up with that company, just like the fact that your public comments (which you explicitly gave permission to HN to show) have been indexed by Google, Bing, and probably thousands of other spiders, bots, scrapers, etc.

I'm curious how you expected this to work. Like if you only give HN permission to store and show your comments on the public web, then somehow no other entity out there will be able to do anything with them?

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#29

Post by senordevnyc »

donpark wrote: post #20
GeoAtreides wrote: post #5

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

That's a contract between users and HN. Airtrain is a 3rd-party. If HN API exposes personal information publicly through their API then there is a problem. And AFAICT the only way for HN to prevent user comments from being used by 3rd-party is preventing access to those comments, meaning a) sign-up will have to be more stringent and b) visitors will have to sign-in just to read (or scrape) comments.

And that doesn't really prevent anything, it just (mildly) slows it down.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#30

Post by shadowgovt »

maleldil wrote: post #21
GeoAtreides wrote: post #13

Earlier quoted context omitted.

Well, then the original dataset should also remove my data. Just because it's there doesn't mean it's there legally. It covers all User Content, which is comments and post titles (I think) at a minimum.

From your link: > Hacker News Information: If you create a Hacker News account (ID and profile), we do not collect any Personal Information unless you choose to provide your email address and/or information in the "about" field (“HN Information”). Your submissions to, and comments you make on, the Hacker News site are not Personal Information and are not "HN Information" as defined in this Privacy Policy.

Correct.

I'm a little surprised people don't know the ownership story on HN. Didn't it raise questions when they realized they can't delete their posts without mother-may-I'ing the mods?

HN is pretty up-front that when you post here you are providing them content for free to more-or-less consume as they please.

Post reply on HN