Question: 4 Power Iteration Clustering| 15 points] Power iteration clustering ( PIC ) is a scalable and efficient algorithm for clustering vertices of a graph given

 4 Power Iteration Clustering| 15 points] Power iteration clustering ( PIC

4 Power Iteration Clustering| 15 points] Power iteration clustering ( PIC ) is a scalable and efficient algorithm for clustering vertices of a graph given pairwise similarties as edge properties . MIL lib includes an implementation of PIC, which takes an RDD of ( scold , distId , similarity ) tuples and outputs a model with the clustering assignments . The similarities must be nonnegative . PIC assumes that the similarity measure is symmetric . A pair ( areld , datId ) regardless of the ordering should appear at most once in the input data . You may use print statements for debugging bait. comment any print statements voll added before submitting . . For this question , your task is computing pairwise similarities between all patients . Please implement your code in Jaccard . jaccard Similarity All Patients ( ] . DO NOT change the method signature and you are allowed to add any other secondary methods* that you can call from this method . In Main . main you will see how this method is invoked [ 10 points\\ . Please complete Poweriteration Clustering . run PIC ( ) . It is just a kind of wrapper to call Spark's built - in PIC implementation . You need to pass all pair similarities voll* get from the previous question as input for this function . Then , you can pass it. though Spark's PIC implementation with the proper configuration . Please refer to PIC doc in spark . Use three clusters and 100 for maximum iterations . You have to return the clustering result as RDD ( patient ID , cluster Label ; ] where the type of variables are patient ID : Long and cluster Label : Int .\\} points ]

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!