Live data from Hacker News

Show HN: Hacker News with Tags

histre.com

51–56 of 56 posts

Re: Show HN: Hacker News with Tags

#51
I made a very similar product, but you're layout is much more polished.

Using it as personal kb too, i also crawl the top HN pages instead of mirroring it separately. I consider it another source of interesting links.

https://handlr.sapico.me/ Here is HN: http://handlr.sapico.me/Home/ByTag?Name=hn

Good luck, it's a difficult market for this type of product. I still think it's the perfect use-case, but people outside of HN/reddit? don't really "get it".

How old/big is you're dataset and how is your db handling it? I've got lots of data+tags and it tends to get a bit slower ( I've optimized it a bit already, but it still needs some work)

Note : dogfooding it

Ps. I think Gpt 2 for the tags would be decent enough + much cheaper.

Re: Show HN: Hacker News with Tags

#52

Earlier quoted context omitted.

So that is how you deal with the length limit? Did you just make up a list of tags?

Yes, I played around with sending first n chars from the web page text etc, but found that sending headings is to pick the tags. I extracted the list from here as the starting point: https://lobste.rs/tags I spend a lot of time on HN haha, so I was able to expand on that list and I think the current list is pretty comprehensive. I can share the full list if you're interested.

I'd love to see the full list. Also, is there a way to filter posts using the chrome extension to exclude some tags?

Re: Show HN: Hacker News with Tags

#53
post #52

Earlier quoted context omitted.

Yes, I played around with sending first n chars from the web page text etc, but found that sending headings is to pick the tags. I extracted the list from here as the starting point: https://lobste.rs/tags I spend a lot of time on HN haha, so I was able to expand on that list and I think the current list is pretty comprehensive. I can share the full list if you're interested.

I'd love to see the full list. Also, is there a way to filter posts using the chrome extension to exclude some tags?

Excluding via browser extension is doable. We'd need to:

1. either add a ui element to each tag to let the user exclude, or create a text input perhaps at the bottom of the page where the user can enter the tags they want excluded

2. save the above in local storage

3. after the tags for the page are fetched from the backend at https://gitlab.com/histre/hn-tags/-/blob/main/tags.js#L60 loop over the stories and hide the ones that have any of the tags

PRs welcome :-)

Here is the full list of tags as of now:

  a11y, acquisition, ai, algorithm, android, announce, api, apl, art, assembly, audio, auth, bitcoin, book, browser, c, c++, clojure, cogsci, compiler, compression, compsci, cryptocurrency, cryptography, css, culture, database, debugging, design, devops, distributed, dotnet, drugs, economy, editor, education, elixir, elm, emacs, email, energy, environment, erlang, ethereum, event, exploit, finance, fortran, freebsd, games, geography, golang, graphics, hardware, haskell, health, hiring, historical, interview, investment, ios, ipv6, java, javascript, job, julia, knowledge, kotlin, language, law, layoff, legal, linux, lisp, lua, mac, math, medical, ml, mobile, music, netbsd, networking, news, nix, nodejs, nuclear, openbsd, opensource, osdev, parallel, pdf, performance, perl, person, philosophy, php, physics, plt, politics, practices, privacy, productivity, programming, prolog, psychology, python, release, research, reversing, rss, ruby, rust, scala, scaling, science, security, shell, show, slides, space, startup, swift, systemd, tesla, testing, transcript, twitter, unix, video, vim, virtualization, visualization, wasm, web, webapp, windows, zig

Re: Show HN: Hacker News with Tags

#54

I made a very similar product, but you're layout is much more polished. Using it as personal kb too, i also crawl the top HN pages instead of mirroring it separately. I consider it another source of interesting links. https://handlr.sapico.me/ Here is HN: http://handlr.sapico.me/Home/ByTag?Name=hn Good luck, it's a difficult market for this type of product. I still think it's the perfect use-case, but people outside…

Your app looks great! Re data: we just get the front page every few minutes from https://github.com/HackerNews/API The table is almost 10MB right now, so pretty small

Re: Show HN: Hacker News with Tags

#55

I made a very similar product, but you're layout is much more polished. Using it as personal kb too, i also crawl the top HN pages instead of mirroring it separately. I consider it another source of interesting links. https://handlr.sapico.me/ Here is HN: http://handlr.sapico.me/Home/ByTag?Name=hn Good luck, it's a difficult market for this type of product. I still think it's the perfect use-case, but people outside…

Your app looks great! Re data: we just get the front page every few minutes from https://github.com/HackerNews/API The table is almost 10MB right now, so pretty small

What Algo are you using for tags? I'm using nested sets on ms sql fyi

For data, there's a Cron endpoint. So it's just a matter of hitting it to import from external sources.

In the case of hacker news, I'm importing an RSS endpoint. Which is probably only 1 of the 100? Feeds I'm importing over the last 4 years.

Re: Show HN: Hacker News with Tags

#56

Earlier quoted context omitted.

Your app looks great! Re data: we just get the front page every few minutes from https://github.com/HackerNews/API The table is almost 10MB right now, so pretty small

What Algo are you using for tags? I'm using nested sets on ms sql fyi For data, there's a Cron endpoint. So it's just a matter of hitting it to import from external sources. In the case of hacker news, I'm importing an RSS endpoint. Which is probably only 1 of the 100? Feeds I'm importing over the last 4 years.

Cool, thanks for sharing.

I'm not using any hierarchy in the tags. It is just a many-to-many relationship between stories and tags.

Post reply on HN