Live data from Hacker News

Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

hackernewstrends.com

31–40 of 169 posts

Re: Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

#31

Hello HN, This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it. You can compare terms just like in google trends and you can also see the exact posts & comments from that time. I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackerne…

This is excellent.

A minor suggestion - I'd like to be able to render the current graph taller (full height of my browser window).

Also some sentiment analysis on the "people" graphs would be very insightful (particularly for the likes of Edward Snowdon, Julian Assange, Elon Musk and Sam Altman). Perhaps colour the area under the graph red-orange-green based on the sentiment?

Re: Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

#33
Reminds me of this side project I'm working on.

https://gitlab/here_forawhile/torum

It's a HN clone, that syncs with HN that allows you to basically establish smaller private communities who can discuss anything that's on HN without actually being on HN.

It also indexes and let's you search through the DB which I find is really useful to find things that peak my interest.

Re: Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

#36
post #23

Hello HN, This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it. You can compare terms just like in google trends and you can also see the exact posts & comments from that time. I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackerne…

Honestly the HN archive is very valuable. If you had it all on a local db with everything indexed you basically end up with a offline search engine. Where is this archive located you speak of?

It's on firebase, per https://github.com/hackernews/api

Re: Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

#38
post #20

Hug of death ` /api/hn -> 504 An error occurred with your deployment FUNCTION_INVOCATION_TIMEOUT cle1::c8vgv-1782399959042-aeba3cae05ff `

back in my day we called this a good ole' fashioned slashdotting.

Our startup (~20 people) got slashdotted in 1998 or so. I was the only one randomly awake at the time. Remember watching all the logs from our web server in realtime, ready to immediately kill anything or anyone threatening the overall availability.

512 kbps uplink, I think. Even accidental DoS was trivial. We had a self-hosted little data center at our office with the only available stupidly expensive commercial connection.

Felt some dread having to restart the main (async, single-process) web server a few times to keep things going due to bugs in our code. So many* people on dial-up patiently waiting for the page to load.

It was exhilarating though :).

*) Surely at least a hundred!

Post reply on HN