I'm not sure how to view the embedding, I clicked on the graph, narrowed down to a comment, but it only shows the row and not the raw array? (Or I've misunderstood)
Oh you cannot actually view the raw embedding vector, only the corresponding row. Any particular use-case to view the raw embedding?
Show HN: Semantic clusters and embeddings for 500k Hacker News comments
11–20 of 54 posts
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#12I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/
You did, although I have no idea if OP is an affiliate of YC (IANAL but maybe you could argue the public API is a form of sublicensing the data?): > By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, stor…
My data is licensed only to Y Combinator and its affiliated companies (I would have prefer it to be licensed it only for news.ycombinator,com), not any other rando that can access it via a browser or an API
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#13I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/
The original dataset is located at [1] (not our HF account). HN data is directly available via the HN API [2]. The privacy policy you point to does not cover HN posts. [1] https://huggingface.co/datasets/OpenPipe/hacker-news [2] https://github.com/HackerNews/API
It covers all User Content, which is comments and post titles (I think) at a minimum.
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#14Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#15Some users comment frequently and uniquely enough that they get their own cluster. I also like how there's "Deno vs Node" lol. It'd be cool if you could click on a comment and get the most similar ones by whatever distance metric you used.
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#16Some users comment frequently and uniquely enough that they get their own cluster. I also like how there's "Deno vs Node" lol. It'd be cool if you could click on a comment and get the most similar ones by whatever distance metric you used.
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#17I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#18Earlier quoted context omitted.
The original dataset is located at [1] (not our HF account). HN data is directly available via the HN API [2]. The privacy policy you point to does not cover HN posts. [1] https://huggingface.co/datasets/OpenPipe/hacker-news [2] https://github.com/HackerNews/API
Well, then the original dataset should also remove my data. Just because it's there doesn't mean it's there legally. It covers all User Content, which is comments and post titles (I think) at a minimum.
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#19Earlier quoted context omitted.
You did, although I have no idea if OP is an affiliate of YC (IANAL but maybe you could argue the public API is a form of sublicensing the data?): > By uploading any User Content you hereby grant and will grant Y Combinator and its affiliated companies a nonexclusive, worldwide, royalty free, fully paid up, transferable, sublicensable, perpetual, irrevocable license to copy, display, upload, perform, distribute, stor…
> Y Combinator and its affiliated companies My data is licensed only to Y Combinator and its affiliated companies (I would have prefer it to be licensed it only for news.ycombinator,com), not any other rando that can access it via a browser or an API
Re: Show HN: Semantic clusters and embeddings for 500k Hacker News comments
#20I did not consent on my HN data being used by entities other than HN[1]. Please remove all my comments and data from this dataset. [1] As per HN license: https://www.ycombinator.com/legal/
If HN API exposes personal information publicly through their API then there is a problem.
And AFAICT the only way for HN to prevent user comments from being used by 3rd-party is preventing access to those comments, meaning a) sign-up will have to be more stringent and b) visitors will have to sign-in just to read (or scrape) comments.