Question 5: Calculating Median and Standard Deviation of Edges for each. Vertex (48 points) read the...

Transcribed Image Text:

Question 5: Calculating Median and Standard Deviation of Edges for each. Vertex (48 points) read the edges_table.csv file Now that we have a data structure constructed to hold our lists of edges comming in and going out of a vertx, we want to know the median and standard deviation of the counts on each of these. To accomplish this, you will likely want to produce a generic map function to map the list of the property of interest to a count. You are to use the methods we discussed in class to perform the necessary calculations in a memory concious way using the combineByKey method. Since we are only interested in one key per calculation, you can do the final Median and Standard Deviation calculation in your driver program after performing the reduce operation. Question 5: Calculating Median and Standard Deviation of Edges for each. Vertex (48 points) read the edges_table.csv file Now that we have a data structure constructed to hold our lists of edges comming in and going out of a vertx, we want to know the median and standard deviation of the counts on each of these. To accomplish this, you will likely want to produce a generic map function to map the list of the property of interest to a count. You are to use the methods we discussed in class to perform the necessary calculations in a memory concious way using the combineByKey method. Since we are only interested in one key per calculation, you can do the final Median and Standard Deviation calculation in your driver program after performing the reduce operation.

Answer rating: 100% (QA)

Calculate Median Deviation CMD Default GPT35 User Question 3 Calculating Median and Standard Deviation of Edges for each vertex 40 points read the edgestablecsv file Now that we have a data structure ... View the full answer