Live data from Hacker News

Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

blog.wilsonl.in

131–140 of 171 posts

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#132

Good example of data engineering/MLops for people who aren't familiar. I'd suggest using HDBScan to generate hierarchical clusters for the points, then use a model to generate names for interior clusters. That'll make it easy to explore topics out to the leaves, as you can just pop up refinements based on the connectivity to the current node using the summary names. The groups need more distinct coloring, which I thi…

For folks with GPUs, note that HDBscan is very optimized in cuML (https://docs.rapids.ai/api/cuml/stable/api/#clustering / https://developer.nvidia.com/blog/faster-hdbscan-soft-cluste...).

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#133

I'd like to see an analysis of the rise of self promotion on HN. I define self promotion on HN as a "Show HN: I ..." post vs "Show HN: Something ..." Examples from the top 100 right now * "Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun" * "Show HN: Browser-based knitting (pattern) software" These are not self promotional titles. The subjects are the exploration and the software respecti…

This is talked about a lot in Einstein's Walter Isaacson biography, so people have been observing this trend for a long time (e.g the Germans accusing Einstein of doing self promotion, the US having celebrity culture in contrast), maybe it's cyclical

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#134

Good example of data engineering/MLops for people who aren't familiar. I'd suggest using HDBScan to generate hierarchical clusters for the points, then use a model to generate names for interior clusters. That'll make it easy to explore topics out to the leaves, as you can just pop up refinements based on the connectivity to the current node using the summary names. The groups need more distinct coloring, which I thi…

For folks with GPUs, note that HDBscan is very optimized in cuML ( https://docs.rapids.ai/api/cuml/stable/api/#clustering / https://developer.nvidia.com/blog/faster-hdbscan-soft-cluste... ).

Ooo thanks for this

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#135
post #33

This is impressive work, especially for a one man show! One thing that stood out to me was the graph of the sentiment analysis over time, I hadn't seen something like that before and it was interesting to see it for Rust. What were the most positive topics over time? And were there topics that saw very sudden drops? I also found this sentence interesting, as it rings true to me about social media "there seems to be a…

Crypto i imagine is in that bucket

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#136

I'd like to see an analysis of the rise of self promotion on HN. I define self promotion on HN as a "Show HN: I ..." post vs "Show HN: Something ..." Examples from the top 100 right now * "Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun" * "Show HN: Browser-based knitting (pattern) software" These are not self promotional titles. The subjects are the exploration and the software respecti…

Your definition of self promotion is a bit different from what I usually think. I usually consider self promotion to be someone promoting something that that same person did. Both of your non-self-promotion examples would be self promotion under my definition. So what you consider to be self promotion vs non-self-promotion, I consider to be self promotion with a title that very clearly indicates that vs self promotio…

> However, the "Show HN" phrase is only used for self promotion I think, so even without the "I", anyone familiar with the convention will know it's self promotion.

I think that's an extremely cynical view though a common one. I've never thought of "Show HN" as self promotion if it doesn't include "I" unless I go through to the actual product/library/post and find it full of self promotion. I agree with you that a post that doesn't include "I" can be self promotion but I don't think it always is even if the person made/worked on it.

"Show HN: XYZ and LLM library in rust" to me is informational. It's point is, more often than not, to inform people of something they might get use out of. I know that's true when I've posted something like that. It's meaning is "here's a useful resource that was just created". Sure I get pleasure from knowing I helped people with something but I'm not trying to promote myself, I'm trying to promote the library/post/info.

"Show HN: I made an LLM Library in rust" to me is self promotional. It might be useful to others but it's intent was clearly self promotion given the subject is "I", not the library/post/product.

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#137

Earlier quoted context omitted.

Your definition of self promotion is a bit different from what I usually think. I usually consider self promotion to be someone promoting something that that same person did. Both of your non-self-promotion examples would be self promotion under my definition. So what you consider to be self promotion vs non-self-promotion, I consider to be self promotion with a title that very clearly indicates that vs self promotio…

> However, the "Show HN" phrase is only used for self promotion I think, so even without the "I", anyone familiar with the convention will know it's self promotion. I think that's an extremely cynical view though a common one. I've never thought of "Show HN" as self promotion if it doesn't include "I" unless I go through to the actual product/library/post and find it full of self promotion. I agree with you that a po…

>Show HN is for sharing your personal work and has special rules.

https://news.ycombinator.com/newsfaq.html

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#138

Earlier quoted context omitted.

Your definition of self promotion is a bit different from what I usually think. I usually consider self promotion to be someone promoting something that that same person did. Both of your non-self-promotion examples would be self promotion under my definition. So what you consider to be self promotion vs non-self-promotion, I consider to be self promotion with a title that very clearly indicates that vs self promotio…

> However, the "Show HN" phrase is only used for self promotion I think, so even without the "I", anyone familiar with the convention will know it's self promotion. I think that's an extremely cynical view though a common one. I've never thought of "Show HN" as self promotion if it doesn't include "I" unless I go through to the actual product/library/post and find it full of self promotion. I agree with you that a po…

Show HN is defined in the rules (as the sibling comment quotes) as something someone made to be shared, ie self promotion, regardless of whether they used "I" in the title. Your definition seems more arbitrary than what Hacker News itself intends.

Re: Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun

#140

I'd like to see an analysis of the rise of self promotion on HN. I define self promotion on HN as a "Show HN: I ..." post vs "Show HN: Something ..." Examples from the top 100 right now * "Show HN: Exploring HN by mapping and analyzing 40M posts and comments for fun" * "Show HN: Browser-based knitting (pattern) software" These are not self promotional titles. The subjects are the exploration and the software respecti…

All show HN has to be created by the author, so I’m not sure what is self promoting about making the implicit explicit.

They are all “look, I made something cool, what do you think?”

Post reply on HN