Question: Create a text or csv file using following tranning data, make up names assuming the first column is the predictor and the second column is
Create a text or csv file using following tranning data, make up names assuming the first column is the predictor and the second column is the target.
| 1 | 4 |
| 1 | 7 |
| 3 | 9 |
| 3 | 12 |
| 4 | 11 |
| 4 | 12 |
| 5 | 17 |
| 6 | 13 |
| 6 | 18 |
| 7 | 17 |
then perform a Spark linear regression using a 'case class' to hold the data read in the case class, make the feature argument a Spark vector, and the label as a Double thus construct a Dataset ( not just a DataFrame) suitable for Spark Linear regression Invoke the Spark Lin regression on your Dataset. Capture the usual parameters for a regression task: SST, SSR, SSE, intercept, regression coeff correlation coef, & r2
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
