Problem 6. Basics for Spark Streaming and GraphX

(Spark Streaming) Suppose we create a Spark Streaming Context streamingContext in Python Spark.

streamingContext = StreamingContext(sc, 3)

where sc is the SparkContext instance. What does the second parameter 3 represent here?

Answer:

We want to stream the data from TCP source with IP Address 123.45.67.89 and port number 4321. Please provide the function for streaming data from that TCP source.

Answer:

The return variable is a .

(Spark GraphX) Suppose we have a graph in the following.

1 2

2 3

2 4

3 4

4 1

4 5

5 3

The left figure shows the graph, and the right column shows the edge list file. Suppose the full directory of the file is "/home/rob/data/ToyGraph01.txt". sc is the Spark Context. Please provide the command to load the graph edge list file in Scala.

Answer:

1:

If we want to get the number of vertices, we should use the following command in Scala.

Answer:

1: