Live data from Hacker News

Reproducing Hacker News writing style fingerprinting

antirez.com

91–100 of 168 posts

Re: Reproducing Hacker News writing style fingerprinting

#92
post #20

The "analyze" feature works pretty well. My comments underindex on "this" - because I have drilled into my communication style never to use pronouns without clear one-word antecedents, meaning I use "this" less frequently that I would otherwise. They also underindex on "should" - a word I have drilled OUT of my communication style, since it is judgy and triggers a defensive reaction in others when used. (If required,…

Should is a commonly used word and a fine one. You should feel free to use it. If someone gets hot under the collar because you said he should do something then he is an idiot.

"Ought to" is essentially a synonym. Anyone that gets upset when you said they should do something but is fine when you say that they ought to do something is truly a moron.

Re: Reproducing Hacker News writing style fingerprinting

#93
>Well, the first problem I had, in order to do something like that, was to find an archive with Hacker News comments. Luckily there was one with apparently everything posted on HN from the start to 2023, for a huge 10GB of total data.

This is actually super easy. The data is available in BigQuery.[0] It's up to date, too. I tried the following query, and the latest comment was from yesterday.

    SELECT 
      id,
      text,
      `by` AS username,
      FORMAT_TIMESTAMP('%Y-%m-%dT%H:%M:%SZ', TIMESTAMP_SECONDS(time)) AS timestamp
    FROM 
      `bigquery-public-data.hacker_news.full`
    WHERE 
      type = 'comment'
      AND EXTRACT(YEAR FROM TIMESTAMP_SECONDS(time)) = 2025
    ORDER BY 
      time DESC
    LIMIT 
      100

https://console.cloud.google.com/bigquery?ws=!1m5!1m4!4m3!1s...

Re: Reproducing Hacker News writing style fingerprinting

#94
post #89

Maybe I talk too much on HN. :) When I ran it, it gave me 20 random users, but when I do the analyze, it says my most common words are [they because then that but their the was them had], which is basically just the most common English words. Probably would be good to exclude those most common words.

I had a similar result. 85%+ similar to a bunch of random accounts, and my perhaps most distinguishing feature is I don't use the word 'app' or 'company' a lot. The former because I dislike the word, and the latter maybe because I'm self-employed.

I figured it maybe would cluster me with other non-native speakers but it doesn't appear to. Of all the accounts where I could identify a country of origin, all were American.

Re: Reproducing Hacker News writing style fingerprinting

#98
post #20

The "analyze" feature works pretty well. My comments underindex on "this" - because I have drilled into my communication style never to use pronouns without clear one-word antecedents, meaning I use "this" less frequently that I would otherwise. They also underindex on "should" - a word I have drilled OUT of my communication style, since it is judgy and triggers a defensive reaction in others when used. (If required,…

I think “should” and “ought to” end up being equivalent.

I prefer to avoid such absolutes and portray causality instead.

For example, in place of “you should not do drugs at work” I prefer “if you take drugs at work you’ll get in trouble”.

Re: Reproducing Hacker News writing style fingerprinting

#99

Earlier quoted context omitted.

Actually, the way that these things work is usually by focusing exclusively on the usage patterns of very common (top 500) words. You get better results by ignoring content words in favor of the linking words.

Interesting, I think it also doesn't help that outside of a throw away on a blue moon, I don't really use alts...

[deleted]

Re: Reproducing Hacker News writing style fingerprinting

#100
post #20

The "analyze" feature works pretty well. My comments underindex on "this" - because I have drilled into my communication style never to use pronouns without clear one-word antecedents, meaning I use "this" less frequently that I would otherwise. They also underindex on "should" - a word I have drilled OUT of my communication style, since it is judgy and triggers a defensive reaction in others when used. (If required,…

I think “should” and “ought to” end up being equivalent. I prefer to avoid such absolutes and portray causality instead. For example, in place of “you should not do drugs at work” I prefer “if you take drugs at work you’ll get in trouble”.

They do, and your suggestion is a great alternative. I'll try to do more of that
Post reply on HN