Referencing the file docword.nytimes.txt answer the following ques-
tions. The file, along with the information about its contents can be found
at https://archive.ics.uci.edu/dataset/164/bag+of+words. Note
that you will only need the file docword.nytimes.txt.gz that is con-
tained in the download at that site. You should still visit the link to gain information about the
data. This file is compressed and you should decompress the file before
working on the questions below.
(a) How many documents contain more than 500 word?
(b) How many documents contain more than 100 unique words?
(c) How many words occur in more than 1000 documents?
(d) What is the id of the word that occurs the most times throughout
all of the documents?
(e) What is the average number of total words per document?