Live data from Hacker News

Show HN: Semantic clusters and embeddings for 500k Hacker News comments

app.airtrain.ai

41–50 of 54 posts

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#41

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

I am an entity other than HN.

Am I not allowed to read your comments?

Am I not allowed to learn from reading your comments?

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#42

Earlier quoted context omitted.

Yes, I expect it to work in the same way instagram works, for example. If a commercial entity started yoinking photos from instagram and using them for commercial purposes, shit will hit the fan. Again, the fact my user data has been scrapped already doesn't mean it was scrapped legally. I'm ok with HN showing my comments, I'm not ok with anyone else than HN using my user data.

> ommercial entity started yoinking photos from instagram and using them for commercial purposes, shit will hit the fan. Will it though? I would imagine Meta would block them and then posture with a C&D or a frivolous lawsuit, but if they share the phones you gave them on the public internet, they're publicly consumable right? What law do you feel is broken there?

It's not Meta that would sue them (although they would), it's the copyright owners (the users) that will. Photos or comments, the User retains copyright on their content, and only license it to Meta or YC for specific purposes. Yes, that means Meta/YC and their affiliated companies can use the content for other purposes than displaying it in a browser, but 3rd parties 100% can't.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#43
I'm not sure about others here, but I occasionally spend time typing out a long reply to someone and then simply deleting the reply without posting. Most of the time I conclude -- a little too late -- that the effort was not worth it.

How nice it would be to have an LLM trained on all of my previous writings and simply be able to click a button to indicate "reply to this person, please." I know I don't have enough training data from HN, and maybe not even from all of the sites I contribute, combined. It is still a nice thought, though.

But: Let's say I do acquire enough training data to have a local LLM do exactly what I describe. My volume of "replies" would certainly increase. Is that a good thing, on average? If the tool became ubiquitous, would it be a good thing for the average social media user? Or more pointedly, would it be a good thing for consumers of that social media? The cynic in me thinks "no" -- the effort required today surely weeds out _some_ idiots....

(Full disclosure, I nearly closed this window without clicking the "add comment" button.)

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#44

I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/

I am an entity other than HN. Am I not allowed to read your comments? Am I not allowed to learn from reading your comments?

You are allowed all rights given to you by (copyright) law, while respecting the YC license: https://www.ycombinator.com/legal/

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#45

Earlier quoted context omitted.

Actually, another problem might be GDPR: I have found my username... and that is a clearly a PII because it's directly and univocally bound to me I dont really care (for now) about this... but on the principle, I'm a bit fed up too by companies just crawling anything to train anymodel without any care about the datas, the people that produced them, and the consequences on people's life. Maybe I could use the new Euro…

I'm not up on the nuance of the GDPR, but has it been tested that your public profile name - which you set knowing it will be displayed publicly - is PII? I'd be very surprised if that were the case.

It's not PII (an American term) but it is personal data (a GDPR term).

Personal data is (broadly) considered to be data that could be used to track or tie your behavior online together into a profile. The UK's ICO calls out usernames specifically as an example of such data. https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-re....

(For those of us who have been around on the Internet long enough to remember the era where people intentionally chose handles to remain pseudonymous and separate from their IRL personas, this seems counter-intuitive and a little preposterous, but the GDPR doesn't care what "netizens" think about privacy; it's a broad attempt to impose a "non-native" concept of privacy over the preexisting net culture).

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#48

Earlier quoted context omitted.

Actually, another problem might be GDPR: I have found my username... and that is a clearly a PII because it's directly and univocally bound to me I dont really care (for now) about this... but on the principle, I'm a bit fed up too by companies just crawling anything to train anymodel without any care about the datas, the people that produced them, and the consequences on people's life. Maybe I could use the new Euro…

I'm not up on the nuance of the GDPR, but has it been tested that your public profile name - which you set knowing it will be displayed publicly - is PII? I'd be very surprised if that were the case.

Well, you choose a username in a specific context, even if it's public.

For example, you may agree to have your linkedIn profile name next to your HN username... maybe. But I'm not sure that you would agree to have your LinkedIn profile name next to your Tinder username.

And you sure don't want that to happen without your agreement and even without you knowing about it (but learning about it from a colleague for example).

That's why GDPR has some right to deletion or modification. And why some days, Europe may go after data brocker

(as a side note: not sure why my comments were downvoted. I didn't say that I would go after anybody - and surely not HN - I only said that uncontrolled use of any data without any anonymization and without consent might be the source of problems with regard to legislation decided BECAUSE too many shady business abused of it. You may not like it but then... well... downvote the abusers)

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#49

Earlier quoted context omitted.

Sematic (OP's employer; rebranded to Airtrain?) is a YC company. Not a lawyer but I assume that would be included in "affiliated" since YC presumably has some ownership of them. https://www.ycombinator.com/companies/airtrain-ai

Welp, there it is then. If they are YC affiliated, nothing I can do. But I do feel saddened and personally betrayed; I thought the licence I gave to YN was just for news.ycombinator.com to store and show my comments, not for any other purposes. Silly, silly me.

Anyone could (in a technical sense) scrape HN or access the data through the API and do whatever they want with it. It's unclear to me whether the license granted to HN by your use of the site gives someone doing so license to your comments (I suspect not but IANAL) but the general argument here is that this would fall under fair use. Certainly that seems the case if they didn't display the dataset itself. I'm not sure how it would fair though given they are displaying the content.

Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments

#50

Earlier quoted context omitted.

> ommercial entity started yoinking photos from instagram and using them for commercial purposes, shit will hit the fan. Will it though? I would imagine Meta would block them and then posture with a C&D or a frivolous lawsuit, but if they share the phones you gave them on the public internet, they're publicly consumable right? What law do you feel is broken there?

It's not Meta that would sue them (although they would), it's the copyright owners (the users) that will. Photos or comments, the User retains copyright on their content, and only license it to Meta or YC for specific purposes. Yes, that means Meta/YC and their affiliated companies can use the content for other purposes than displaying it in a browser, but 3rd parties 100% can't.

Well, are you going to sue? Are you going to sue Google and Bing and whoever else? Have you even bothered to contact the people at Airtrain to ask them to remove your content? Have you contacted HN to have them delete your account and comments?

Or are you complaining here (ironically) to make a point, but you don't actually care that much?

Post reply on HN