Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Subth.ink – write something and see how many others wrote the same

subth.ink

Post reply on HN
Print view View original

1–10 of 60 posts

Show HN: Subth.ink – write something and see how many others wrote the same

#1

Post by sonnig »

Hey HN, this is a small Haskell learning project that I wanted to share. It's just a website where you can see how many people write the exact same text as you (thought it was a fun idea).

It's built using Scotty, SQLite, Redis and Caddy. Currently it's running in a small DigitalOcean droplet (1 Gb RAM).

Using Haskell for web development (specifically with Scotty) was slightly easier than I thought, but still a relatively hard task compared to other languages. One of my main friction points was Haskell's multiple string-like types: String, Text (& lazy), ByteString (& lazy), and each library choosing to consume a different one amongst these. There is also a soft requirement to learn monad transformers (e.g. to understand what liftIO is doing) which made the initial development more difficult.

Show HN: Subth.ink – write something and see how many others wrote the same
subth.ink

Re: Show HN: Subth.ink – write something and see how many others wrote the same

#3

Post by nathan_compton »

Apreche wrote: post #2

This would be more interesting if it was generalized. Using a hash, even one character difference will result in a miss. If I could have it analyze my blog and then find people who have similar ideas that would be incredibly useful.

Natural to use LM embeddings for this.

Re: Show HN: Subth.ink – write something and see how many others wrote the same

#4

Post by stogot »

Apreche wrote: post #2

This would be more interesting if it was generalized. Using a hash, even one character difference will result in a miss. If I could have it analyze my blog and then find people who have similar ideas that would be incredibly useful.

That is a problem Also a long paragraph would likely never be hashed the same because of a comma or capital letter and so the builder of this would need to cap the length of the thought and make all thoughts lower case without punctuation

Re: Show HN: Subth.ink – write something and see how many others wrote the same

#7

Post by sonnig »

Apreche wrote: post #2

This would be more interesting if it was generalized. Using a hash, even one character difference will result in a miss. If I could have it analyze my blog and then find people who have similar ideas that would be incredibly useful.

True! That would be a more powerful approach. Here I kept it quite basic since I was not very familiar with the tooling. I do apply lowercasing of text + some whitespace stripping in order to increase the number of collisions a bit.

Edit: any other "quick hacks" to increase the number of collisions are welcome :)

Post reply on HN