Question: Could you please do this in Python to run in Spark. For your second assignment I would like you to write code that does a

Could you please do this in Python to run in Spark.
For your second assignment I would like you to write code that does a word and character count on some input:
URL
Input File
The word count should not only count all occurrences of an individual word, the total number of representations of that word, and a frequency analysis of that word versus the total document.
Occurence are considered for spelling, without care of capitalization
for example -- "word Word word WoRd apple:
word 80% 4 total occurrences, 3 representations {word, Word, WoRd,}
apple 20% 1 total occurence, 1 representation {apple}
The character count similar analyzes the occurrences, representations and frequency analysis of character in the document.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!