Lyric Vocabulary - Rolling Stone Top 100 Artists

Also check out a similar analysis on Reddit's Default Subreddit comments

After seeing this analysis of the lyrics used by hip hop artists, I was curious to see how these numbers stacked up with other artist in other genres. So this is what I've got so far ...

Rolling Stone Magazine have compiled a list of their top 100 musical artists of all time. I figure that's probably a pretty good place to start, it's an interesting list with a wide range of artists and some of the entries make for good reading.

Using that list as a base I pulled in a discography for each of those artists from LyricWikia, using their API. I wasn't able to collect a discogrpahy for all the artists but I got most of them.

I then went on to collect the lyrics for those songs from Chartlyrics (I would encourage you to consider contributing to their free community). Their API appeared to be rate limited to 1 request every 20 seconds so I ended up scraping the lyrics web pages. I couldn't get all the songs for all the artist but I got enough to work from.

Below is a visualisation of the lyrics I collected. I've filtered out the artist where I collected less than 20,000 words. This left me with only 45 artist which was less than I would have liked, but still enough to make it interesting (the orignal hip hop analysis used 35,000 words). The left set of bars shows the number of different words used in each artist's first 20,000 words. Click an artist name bar on the left and a bubble chart with that artist's top N words is presented, N can be adjusted to show more or less words. There is also a set of radio buttons allowing you to filter out sets of words. "None" includes all words in the artitst top list. "Common" filters out all words in Wikipedia's 100 most common words list (just base words, not lexemes). "Pronouns" filters out pronouns. The right set of bars shows the number of times each word appears when the top 100 words for all artists are combined. The bar colour changes to match the colour of the word in the bubble chart.

So that's what I've got at the moment, it's a work in progress and I've got a few more ideas about what I can do with this set of data. I'll see where it goes next.

(Note: NOFX does not appear in Rolling Stone's list, they were used in some early test cases for the lyric collection process and I've decided to keep them in there)

Let me know what you think, notrommit -at- gmail -dot- com