Question: this needs to run in spark using a python script that will read a URL For your second assignment I would like you to write
this needs to run in spark using a python script that will read a URL
For your second assignment I would like you to write code that does a word and character count on some input: URL Input File The word count should not only count all occurrences of an individual word, the total number of representations of that word, and a frequency analysis of that word versus the total document. Occurence are considered for spelling, without care of capitalization for example -- "word Word word WoRd apple: word 80% 4 total occurrences, 3 representations {word, Word, WoRd,} apple 20% 1 total occurence, 1 representation {apple} The character count similar analyzes the occurrences, representations and frequency analysis of character in the document
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
