Want top frequent words in english

Question

Hi,

I want most frequent words in english. Basically, I am processing wikipedia text and am stuck with lot of words even after removing stop words. I tried googling for frequent words, but got the below link.

http://en.wiktionary.org/wiki/Wiktionary:Frequency_lists#English

I have to manually scrape the data from these link. Is there a known source for these words that can be directly downloaded?

Thank you

Answer 1

As in all statistics your answer will depend on what you are sampling. Is your definition of "English" - language used in Wikipedia. As the page you have linked suggests the frequency of words differs based on different samples. Doing a Literature review on language processing work may give you a dated list.

And trust someone to make a website with the that name - wordfrequency. More specifically this.