Live data from Hacker News

The Federalist Papers: Author Identification Through K-Means Clustering

blog.jonlu.ca

1–10 of 36 posts

Re: The Federalist Papers: Author Identification Through K-Means Clustering

#3
post #2

This is my first project in unsupervised NLP, so let me know if there's anything obviously wrong with the article or methodology.

I know nothing about NLP but would a run where it predicts the authorship of the known texts be useful to get some idea of the level of accuracy?

Re: The Federalist Papers: Author Identification Through K-Means Clustering

#8
post #2

This is my first project in unsupervised NLP, so let me know if there's anything obviously wrong with the article or methodology.

Maybe consider including the results of others' analyses alongside yours? Even more interesting would be a deep-dive into why they disagree. (Adventures in interpretation)

Also maybe do a PCA and show scatter plots of the first two PCs for each doc?

I'm no expert, but these could be fun avenues to explore.

Re: The Federalist Papers: Author Identification Through K-Means Clustering

#9
post #7
post #5

Fun fact: this problem is why grep was created by Ken Thompson [1]. [1] https://youtu.be/NTfOnGZUZDk

That was on HN yesterday. https://news.ycombinator.com/item?id=17478260

Neat! Kernighan really is pleasant listening as noted on that post.

Re: The Federalist Papers: Author Identification Through K-Means Clustering

#10
post #6
post #2

This is my first project in unsupervised NLP, so let me know if there's anything obviously wrong with the article or methodology.

Why did you choose an unsupervised method to solve a classification problem?

There's no ground truth. :) They were written under a common psuedonym.
Post reply on HN