Live data from Hacker News

Rappers, Sorted by Size of Vocabulary

rappers.mdaniels.com.s3-website-us-east-1.amazonaws.com

81–90 of 276 posts

Re: Rappers, Sorted by Size of Vocabulary

#81

Earlier quoted context omitted.

Weird Al's songs are not articulate masterpieces, but cheap parodies of other rap songs and rappers. He's probably somewhere around the 5,000 mark with the other artists. A cursory google on the size of the average vocabulary [1] yields an interesting fact. I'm not sure how watertight it is. I realise it's probably unfair to compare the size of the average vocabulary to that of a series of songs. Songs being shorter…

Not sure if that's fair to Weird Al. The people he parodies wouldn't really agree either [1]. It's not like he's doing the cheap morning show tactic of swapping clean words for dirty words or bad puns but leaving the rest of the song intact. They maintain a consistent theme which is really tough. [1] http://www.weirdalforum.com/viewtopic.php?t=5673

Yeah, perhaps I was a little harsh. Don't get me wrong, I like Weird Al. I probably could have phrased my comment a little better. I should have said something along the lines of, "In my experience listening to Weird Al, it doesn't feel like he explores a lot of the English language."

Your link is cool, thanks for sharing that.

Re: Rappers, Sorted by Size of Vocabulary

#83
The estimate of vocabulary size here is based on the number of unique words used. This seems like it is strongly biased: if two artists have the same size vocabulary, but one has released more albums and thus used more words, that artist will probably have used more unique words. To underscore this point, the number of unique words used by Aesop Rock is half of the estimated vocabulary size of the average college student, although to be fair that estimate is the number of words that an individual can recognize, not the number of words they use. (Edit: the bias is somewhat mitigated by the fact that the same number of words is used to estimate the vocabulary for each artist, but the bias is not dependent on sample size alone but also upon the size of the artist's underlying vocabulary; see my comments below.)

The underlying problem is one of estimating the cardinality of a multinomial distribution given a fixed number of samples. In isolation this problem is ill-posed, since it is always possible that there is a word in a given lyricist's vocabulary that he uses with very low frequency and that is unlikely to appear in any sample, but with appropriate prior information it may be possible to obtain an accurate estimate.

This is not my field, but a brief Google Scholar search shows that there are several papers on estimating vocabulary size, or equivalently, estimating the number of species based on sampling. There is a somewhat dated review (http://cvcl.mit.edu/SUNSeminar/BungeFitzpatrick_1993.pdf) that details some methods of estimation (in this case, I believe we are in the domain of "infinite population, multinomial sample" with unequal class sizes). The paper notes that there is no unbiased estimator available without assumptions on the distribution of word use frequencies, but some of the proposed estimators may be more accurate than the naive estimate used here.

Re: Rappers, Sorted by Size of Vocabulary

#84

Earlier quoted context omitted.

I don't know man, I listened to a couple of the tracks and he definitely has lyrical skills, and I like some of the tracks, but the quotes you selected aren't very good at all, at best obvious topics with all the insight of a million college freshmen. Having said that I like "None Shall Pass" that has a really great sound. To be entirely honest, I love rap, but not for any insight rappers have in world affairs, but f…

> at best obvious topics with all the insight of a million college freshman Art is weird like that. We have to remember that it isn't all about needing to learn something new from the experience. Sometimes it's just about getting something out of it. Looking over the lists of the best songs of all time[1], we can see that there aren't a lot of incredibly insightful songs. Quite frankly, most speak of your "obvious to…

I think the term you're grasping for is "Lowest Common Denominator."

Re: Rappers, Sorted by Size of Vocabulary

#85

For those who aren't familiar with Aesop Rock, I'd invite you to give him a listen sometime. His earlier albums, in particular, have been very influential to me in many ways. Both in my artistic and professional careers. From comments on the conditions of the working man and the condition of feeling trapped in a "j-o-b"[1]: "Now we the American working population Hate the fact that eight hours a day Is wasted on chas…

Aesop is an excellent lyricist. In fact all the MCs on the Rhymesayers label are very talented: Brother Ali, Slug (of Atmosphere) etc.

One MC whose vocabulary always leaves me taken aback is RA Scion, who has been part of the group Common Market. Their song, "My Pathology" [0] is a shining example:

    "Below the terra ferma's the murmur of many men
    Resonatin' the predication of RA's eponym
    It requires a higher degree of thought to transmit
    Elevate above the base and retrace the semantics
    Incommensurately we've been held incommunicado
    From commoner to commodore – they breed bravado
    I exercise authority over the lesser ranks
    We rally and tally up at the shores of the West Bank"

[0] http://lyrics.wikia.com/Common_Market:My_Pathology

Re: Rappers, Sorted by Size of Vocabulary

#87

Is Del tha Funkee Homosapien on this list? I'd be curious, since he has pretty non-standard lyrics.

I'd never heard of Aesop Rock before and decided to check out some of his music. He sounds a lot like Del.

They are also on the same same label. Definitive Jux has some quality product.

If you're looking for expansive vocabularies you should consider exploring other dorky rappers like Scroobius Pip.

Re: Rappers, Sorted by Size of Vocabulary

#88

The estimate of vocabulary size here is based on the number of unique words used. This seems like it is strongly biased: if two artists have the same size vocabulary, but one has released more albums and thus used more words, that artist will probably have used more unique words. To underscore this point, the number of unique words used by Aesop Rock is half of the estimated vocabulary size of the average college stu…

Sample size is already controlled for. See the second paragraph, immediately before the graphic: "I used each artist’s first 35,000 lyrics. That way, prolific artists, such as Jay-Z, could be compared to newer artists, such as Drake."

Re: Rappers, Sorted by Size of Vocabulary

#89
post #6

I find it hilarious that DMX is dead last. I've now got empirical evidence of what I always thought. I think DMX rhymes words with themselves more than any rapper I've ever heard.

I think Rick Ross would give DMX a run for his money. I've heard him rhyme a word with the same word before (Atlantic).
Post reply on HN