Q1

Using the list below, map the value 1 to each item in the list. Display your output as a list. Your result should be in the following form: [(a, 1), (b, 1), ...].

In [0]:

import string

import random

data = (

 [i for i in string.ascii_letters] + 

 [i for i in string.ascii_lowercase] + 

 [i for i in string.ascii_lowercase][:10] + 

 [i for i in string.ascii_uppercase][10:]

)

random.shuffle(data)

print(data)

In [0]:

Q2

Using the result of the Q1, find the count of each element in your list. Your result should be in the following form: [('A', 1), ('B', 1), ('C', 1), ..., ('z', 2)].

In [0]:

Q3

Using the Spark DataFrame below, add a new column to each letter with value 1.

In [0]:

df = spark.createDataFrame([(i,) for i in data], schema='letters string')

display(df)

In [0]:

Q4

Using the Spark DataFrame from Q3, find the count of each individual letters.