Question: In your local Git Repo, create a folder named assignment-01 under the itmd-521 folder. Create a sub-folder named exmaple-data and an application named assignment-01.py Create

In your local Git Repo, create a folder namedassignment-01under the itmd-521 folder. Create a sub-folder named exmaple-data and an application named assignment-01.py
  • Create three data frames reading the Divvy_Trips_2015-Q1.csv from your local system
  • Firstinfer the schema
  • Second programmatically useStructFieldsto create and attach a schema
  • Third attach a schema via a DDL
  • After each read operation include the function printSchema()
  • From the first DataFrame, save the data back to disk in the folder example-data and name the parquet filedivy-2015
  • Now create another DataFrame in your application and read the Parquet file just created into a DataFrame
  • Step by Step Solution

    There are 3 Steps involved in it

    1 Expert Approved Answer
    Step: 1 Unlock blur-text-image
    Question Has Been Solved by an Expert!

    Get step-by-step solutions from verified subject matter experts

    Step: 2 Unlock
    Step: 3 Unlock

    Students Have Also Explored These Related Programming Questions!