DATA$-51100$: Statistical Programming

Programming Assignment $5$ Data Preparations and Statistics

Introduction

The file cps$.$csv $($attached$)$ contains school profile information for Chicago Public Schools. Your program will

derive some data from it and then generate some statistical information.

Requirements

You are to create a program in Python that performs the following:

$1.$ Loads the cps$.$csv file $($assume it's in the current directory$)$ and create a DataFrame object fromit.

$2.$ Based on the data contained in the cps$.$csv file, generates a dataframe with the following information:

a$.$ School$\_$ID

b$.$ Short$\_$Name

c$.$ Is$\_$High$\_$School

d$.$ Zip

e$.$ Student$\_$Count$\_$Total

f$.$ College$\_$Enrollment$\_$Rate$\_$School

g$.$ Lowest Grade Offered $($derived from Grades$\_$Offered$\_$All column$)$

h$.$ Highest Grade Offered $($derived from Grades$\_$Offered$\_$All column$)$

i$.$ Starting Hour $($derived from School$\_$Hours column$)$

The values for a$-$f are based on existing columns in the data. For g$-$i$,$ you will need to generate new

columns which derives information from existing ones.

Replace the missing numeric values with the mean for that column.

Display the first $10$ rows of this dataframe.

$3.$ Displays the following information:

a$.$ Mean and standard deviation of College Enrollment Rate for High Schools

b$.$ Mean and standard deviation of Student$\_$Count$\_$Total for non$-$High Schools

c$.$ Distribution of starting hours for all schools

d$.$ Number of schools outside of the Loop Neighborhood $($i$.$e$.,$ outside of zip codes $60601,60602,$

$60603,60604,60605,60606,60607,$ and $60616)$

Additional Requirements

$1.$ The name of your source code file should be DataStats.py$.$ All your code should be within a single

file.

$2.$ You need to use the pandas DataFrame object for storing data.

$3.$ Your code should follow good coding practices, including good use of whitespace and use of both inline

and block comments.

$4.$ You need to use meaningful identifier names that conform to standard naming conventions.

$5.$ At the top of each file, you need to put in a block comment with the following information: your name,

date, course name, semester, and assignment name.

What to Turn In

You will turn in the single DataStats.py file as well as a screenshot of your output$($s$)$ using BlackBoard.

Sample Program Output