1. Dataset and task description

Describe the data analytics task for the chosen dataset. How does the dataset used to solve a business problem? Show the dataset characteristics, namely the number of instances, the number of numerical and categorical variables.

2. Descriptive statistics
   1. Categorical variables
      1. Consider each of the categorical variables and create a frequency table including frequency, relative frequency, cumulative frequency and relative cumulative frequency.

• Provide a summative interpretation of the values in the frequency table. What is the most frequent category and the least frequent ones with their percentages?
• Report any invalid values or errors in the data and explain how to correct them.
• Correct the errors in the data and show the frequency table for each categorical variable after the corrections.

2. Create a pivot table with one categorical variable selected in the ROWS, one numerical variable in the COLUMNS (apply grouping), and the average of the target variable in the VALUES. When a column contains a missing value, it is represented with ?, grouping does not work. You will have to replace those missing values with the mean, save the worksheet and recreate the pivot table.

3. Show the pivot chart and interpret.

2. Numerical variables
   1. Provide a table with the list of all numerical variables, their min, max, average, Q1, Q2 and Q3 and Q4. Provide an interpretation of the quartiles.

2. Create a histogram for each of the numerical variables. What is the shape of the distribution? Interpret? If it is right or left skewed, relate this to a meaningful sentence explaining what most range most of the values fall in.

3. Create a box plot for each of the numerical variables. You may try many numerical variables and keep only the one that exhibits outliers. Interpret the results (how is the variability of the distribution (high/low), are there outliers?

4. Study the relationship between two numerical variables. Consider the target variable and any of the other numerical variables to study. Create a scatter chart and add the trendline. Interpret the charts. In other terms, is there a linear relationship between each of the numerical variables and the target variable? What is the correlation coefficient. What does the correlation coefficient indicate about the relationship between the two variables in question?

A 1 grain_name 2 100% Bran 3 100% Natural Bran 4 All-Bran 5 All-Bran with Extra Fiber 6 Almond Delight 7 Apple Cinnamon Cheerios 8 Apple Jacks 9 Basic 4 10 Bran Chex 11 Bran Flakes 12 Cap'n'Crunch 13 Cheerios 14 Cinnamon Toast Crunch 15 Clusters 16 Cocoa Puffs 17 Corn Chex 18 Corn Flakes 19 Corn Pops 20 Count Chocula 21 Cracklin' Oat Bran 22 Cream of Wheat (Quick) 23 Crispix 24 Crispy Wheat & Raisins 25 Double Chex 26 Froot Loops 27 Frosted Flakes grains B C D E F G H 1 J L M N 0 P Producer Variety calories_content protein_content fat_content sodium_content fiber_content hydrated_carbon sugars_content potassium_content vit_&_min shelf weight cups ratings N 70 4 1 130 10 5 6 280 25 3 1 0.33 68.403 Q C 120 3 5 15 2 8 8 135 0 3 1 1 33.9837 K 70 4 1 260 9 9 7 5 320 25 3 1 0.33 59.4255 K K 50 4 0 140 14 8 0 330 25 3 1 0.5 93.7049 R 110 2 2 200 1 14 8 -1 25 3 1 0.75 34.3848 G G C 110 2 2 180 1.5 10.5 10 70 25 1 1 0.75 29.5095 K 110 2 0 125 1 11 14 30 25 2 1 1 33.1741 G 130 3 2 210 2 18 8 100 25 3 1.33 0.75 37.0386 R 90 2 1 200 4 15 6 125 25 1 1 0.67 49.1203 P 90 3 0 210 5 13 5 190 25 3 1 0.67 53.3138 Q 120 1 2 220 0 12 12 35 25 2 1 0.75 18.0429 G 110 6 2 290 2 17 1 105 25 1 1 1.25 50.765 G 120 1 3 210 0 13 9 45 25 2 1 0.75 19.8236 G 110 3 2 140 2 13 7 105 25 3 1 0.5 40.4002 G 110 1 1 180 0 12 13 55 25 2 1 1 22.7364 R 110 2 o 280 0 22 3 25 1 1 1 41.445 K 100 2 2 0 290 1 21 2 35 25 1 1 1 45.8633 K 110 1 0 90 1 13 12 20 25 2 1 1 35.7828 G G 110 1 1 180 0 12 13 65 25 2 1 1 22.3965 110 3 3 140 4 10 7 160 25 3 1 0.5 40.4488 N H 100 3 0 80 1 21 0 -1 0 2 1 1 64.5338 110 2 0 220 1 21 3 30 25 3 1 1 46.8956 G 100 2 1 1 140 2 11 10 120 25 3 1 0.75 36.1762 R C 100 2 0 190 1 18 5 80 25 3 1 0.75 44.3309 K 110 2 1 125 1 11 13 30 25 2 1 1 32.2076 1 0 200 1 14 11 25 1 1075 31 436 25 + Ready W + 86% B D E F G H 1 J K L M N 0 200 K K K 110 100 120 0 0 1 3 3 3 1 2 1 3 5 5 2 0 1 0 0 11 7 10 12 12 15 9 14 14 12 14 13 11 15 15 17 25 100 200 190 25 25 25 25 25 25 25 1 2 3 3 2 1 2 40 45 1 P G G P P P 120 110 100 110 100 110 120 120 110 110 110 85 3 3 3 1 1 1 0 3 2 1 0 160 240 135 45 280 140 170 75 220 250 180 170 170 260 150 180 5 3 4 3 3 3 2 Q G 1 P 27 Frosted Flakes 28 Frosted Mini-Wheats 29 Fruit & Fibre Dates; Walnuts; and Oats 30 Fruitful Bran 31 Fruity Pebbles 32 Golden Crisp 33 Golden Grahams 34 Grape Nuts Flakes 35 Grape-Nuts 36 Great Grains Pecan 37 Honey Graham Ohs 38 Honey Nut Cheerios 39 Honey-comb 40 Just Right Crunchy Nuggets 41 Just Right Fruit & Nut 42 Kix 43 Life 44 Lucky Charms 45 Maypo 46 Muesli Raisins, Dates; & Almonds 47 Muesli Raisins; Peaches; & Pecans 48 Mueslix Crispy Blend 49 Multi-Grain Cheerios 50 Nut&Honey Crunch 51 Nutri-Grain Almond-Raisin 52 Nutri-grain Wheat 53. Oatmeal Raisin Crisn grains # 11 10 11 6 9 1 13 12 11.5 14 17 20 21 12 K K G Q G 3 1 2 3 2 2 4 2 4 90 100 45 90 35 60 95 40 95 C H C 0 1 1 1 2 1 1 3 3 0 0 0 3 3 3 1 1.5 0 1 2 2 0 2 0 0 3 3 3 2 0 3 3 15 1 0.75 31.436 1 0.8 58.3451 1.25 0.67 40.917 1.33 0.67 41.0155 1 0.75 28.0258 1 0.88 35.2524 1 0.75 23.804 1 0.88 52.0769 1 0.25 53.371 1 0.33 45.8117 1 1 21.8713 1 0.75 31.0722 1 1.33 28.7424 1 1 36.5237 1.3 0.75 36.4715 1 1.5 39.2411 1 0.67 45.3281 1 1 26.7345 1 1 54.8509 1 1 37.1369 1 1 34.1398 1.5 0.67 30.3134 1 1 40.106 1 0.67 29.9243 1.33 0.67 40.6923 1 1 59.6428 125 05 30.4508 > 25 25 100 100 25 25 25 25 25 25 3 3 2 2 2 2 3 12 55 140 110 100 110 100 150 150 160 100 120 140 90 130 A A R 4 3 6 12 3 11 11 13 6 9 16 16 16 4 95 170 170 160 90 3 3 3 R K G G K K K G 17 0 95 150 150 220 190 220 170 2 2 3 3 3 2 1 1 2 0 15 15 21 18 135 1 2 3 25 25 25 25 25 25 7 40 130 90 120 2 3 2 170 10 3 Ready + 86% B C D E F G H H 1 J L M G 3 2 P 1 170 200 320 10 14 3 120 260 45 3 3 3 0 0 0 3 Q Q Q Q K 3 3 1 2 4 5 0 0 6 -1 1.5 6 1 0 1 2 2.7 5 2.5 2 0 0 130 120 100 50 50 100 100 120 100 90 110 110 80 90 3 3 2 G 0 1 2 1 2 0 0 0 0 0 0 12 8 6 13.5 11 20 13 10 14 -1 14 10.5 15 23 22 16 19 20 9 3 3 1 2 3 3 1 K R R c H C c C c 1 53 Oatmeal Raisin Crisp 54 Post Nat. Raisin Bran 55 Product 19 56 Puffed Rice 57 Puffed Wheat 58 Quaker Oat Squares 59 Quaker Oatmeal 60 Raisin Bran 61 Raisin Nut Bran 62 Raisin Squares 63 Rice Chex 64 Rice Krispies 65 Shredded Wheat 66 Shredded Wheat 'n'Bran 67 Shredded Wheat spoon size 68 Smacks 69 Special K 70 Strawberry Fruit Wheats 71 Total Corn Flakes 72 Total Raisin Bran 73 Total Whole Grain 74 Triples 75 Trix 76 Wheat Chex 77 Wheaties 78 Wheaties Honey Gold 79 grains 2 3 0 0 15 50 110 110 240 140 110 30 35 95 140 120 40 55 90 N N N K K 25 25 100 0 0 25 o 25 25 25 25 25 0 0 0 25 25 25 100 100 100 25 2 2 3 3 0 135 0 210 140 0 240 290 0 0 0 70 230 15 200 190 200 250 140 230 200 200 1 1 1 1 2 90 N 0 P 1.25 0.5 30.4508 1.33 0.67 37.8406 1 1 41.5035 0.5 1 60.7561 0.5 1 63.0056 1 0.5 49.5119 1 0.67 50.8284 1.33 0.75 39.2592 1 0.5 39.7034 1 0.5 55.3331 1 1.13 41.9989 1 1 40.5602 0.83 1 68.2359 1 0.67 74.4729 1 0.67 72.8018 1 0.75 31.2301 1 1 53.1313 1 1 59.364 1 1 38.8397 1.5 1 28.5928 1 1 46.6588 1 0.75 39.1062 1 1 27.7533 1 0.67 49.7874 1 1 51.5922 1 0.75 36.1876 0 3 4 4 3 1 1 3 0 1 0 1 2 3 K K N G G G G 4 110 110 90 110 140 100 110 110 100 100 110 2 6 2 2 3 3 2 1 3 3 0 1 1 1 1 1 1 0 15 3 3 5 3 14 3 3 12 3 3 8 16 15 21 15 16 21 13 17 17 16 35 230 110 60 3 3 3 2 1 3 0 0 3 3 1 25 G R 25 25 115 110 60 G 1 1 25 25 G 2 1 1 + Ready + 86% A 1 grain_name 2 100% Bran 3 100% Natural Bran 4 All-Bran 5 All-Bran with Extra Fiber 6 Almond Delight 7 Apple Cinnamon Cheerios 8 Apple Jacks 9 Basic 4 10 Bran Chex 11 Bran Flakes 12 Cap'n'Crunch 13 Cheerios 14 Cinnamon Toast Crunch 15 Clusters 16 Cocoa Puffs 17 Corn Chex 18 Corn Flakes 19 Corn Pops 20 Count Chocula 21 Cracklin' Oat Bran 22 Cream of Wheat (Quick) 23 Crispix 24 Crispy Wheat & Raisins 25 Double Chex 26 Froot Loops 27 Frosted Flakes grains B C D E F G H 1 J L M N 0 P Producer Variety calories_content protein_content fat_content sodium_content fiber_content hydrated_carbon sugars_content potassium_content vit_&_min shelf weight cups ratings N 70 4 1 130 10 5 6 280 25 3 1 0.33 68.403 Q C 120 3 5 15 2 8 8 135 0 3 1 1 33.9837 K 70 4 1 260 9 9 7 5 320 25 3 1 0.33 59.4255 K K 50 4 0 140 14 8 0 330 25 3 1 0.5 93.7049 R 110 2 2 200 1 14 8 -1 25 3 1 0.75 34.3848 G G C 110 2 2 180 1.5 10.5 10 70 25 1 1 0.75 29.5095 K 110 2 0 125 1 11 14 30 25 2 1 1 33.1741 G 130 3 2 210 2 18 8 100 25 3 1.33 0.75 37.0386 R 90 2 1 200 4 15 6 125 25 1 1 0.67 49.1203 P 90 3 0 210 5 13 5 190 25 3 1 0.67 53.3138 Q 120 1 2 220 0 12 12 35 25 2 1 0.75 18.0429 G 110 6 2 290 2 17 1 105 25 1 1 1.25 50.765 G 120 1 3 210 0 13 9 45 25 2 1 0.75 19.8236 G 110 3 2 140 2 13 7 105 25 3 1 0.5 40.4002 G 110 1 1 180 0 12 13 55 25 2 1 1 22.7364 R 110 2 o 280 0 22 3 25 1 1 1 41.445 K 100 2 2 0 290 1 21 2 35 25 1 1 1 45.8633 K 110 1 0 90 1 13 12 20 25 2 1 1 35.7828 G G 110 1 1 180 0 12 13 65 25 2 1 1 22.3965 110 3 3 140 4 10 7 160 25 3 1 0.5 40.4488 N H 100 3 0 80 1 21 0 -1 0 2 1 1 64.5338 110 2 0 220 1 21 3 30 25 3 1 1 46.8956 G 100 2 1 1 140 2 11 10 120 25 3 1 0.75 36.1762 R C 100 2 0 190 1 18 5 80 25 3 1 0.75 44.3309 K 110 2 1 125 1 11 13 30 25 2 1 1 32.2076 1 0 200 1 14 11 25 1 1075 31 436 25 + Ready W + 86% B D E F G H 1 J K L M N 0 200 K K K 110 100 120 0 0 1 3 3 3 1 2 1 3 5 5 2 0 1 0 0 11 7 10 12 12 15 9 14 14 12 14 13 11 15 15 17 25 100 200 190 25 25 25 25 25 25 25 1 2 3 3 2 1 2 40 45 1 P G G P P P 120 110 100 110 100 110 120 120 110 110 110 85 3 3 3 1 1 1 0 3 2 1 0 160 240 135 45 280 140 170 75 220 250 180 170 170 260 150 180 5 3 4 3 3 3 2 Q G 1 P 27 Frosted Flakes 28 Frosted Mini-Wheats 29 Fruit & Fibre Dates; Walnuts; and Oats 30 Fruitful Bran 31 Fruity Pebbles 32 Golden Crisp 33 Golden Grahams 34 Grape Nuts Flakes 35 Grape-Nuts 36 Great Grains Pecan 37 Honey Graham Ohs 38 Honey Nut Cheerios 39 Honey-comb 40 Just Right Crunchy Nuggets 41 Just Right Fruit & Nut 42 Kix 43 Life 44 Lucky Charms 45 Maypo 46 Muesli Raisins, Dates; & Almonds 47 Muesli Raisins; Peaches; & Pecans 48 Mueslix Crispy Blend 49 Multi-Grain Cheerios 50 Nut&Honey Crunch 51 Nutri-Grain Almond-Raisin 52 Nutri-grain Wheat 53. Oatmeal Raisin Crisn grains # 11 10 11 6 9 1 13 12 11.5 14 17 20 21 12 K K G Q G 3 1 2 3 2 2 4 2 4 90 100 45 90 35 60 95 40 95 C H C 0 1 1 1 2 1 1 3 3 0 0 0 3 3 3 1 1.5 0 1 2 2 0 2 0 0 3 3 3 2 0 3 3 15 1 0.75 31.436 1 0.8 58.3451 1.25 0.67 40.917 1.33 0.67 41.0155 1 0.75 28.0258 1 0.88 35.2524 1 0.75 23.804 1 0.88 52.0769 1 0.25 53.371 1 0.33 45.8117 1 1 21.8713 1 0.75 31.0722 1 1.33 28.7424 1 1 36.5237 1.3 0.75 36.4715 1 1.5 39.2411 1 0.67 45.3281 1 1 26.7345 1 1 54.8509 1 1 37.1369 1 1 34.1398 1.5 0.67 30.3134 1 1 40.106 1 0.67 29.9243 1.33 0.67 40.6923 1 1 59.6428 125 05 30.4508 > 25 25 100 100 25 25 25 25 25 25 3 3 2 2 2 2 3 12 55 140 110 100 110 100 150 150 160 100 120 140 90 130 A A R 4 3 6 12 3 11 11 13 6 9 16 16 16 4 95 170 170 160 90 3 3 3 R K G G K K K G 17 0 95 150 150 220 190 220 170 2 2 3 3 3 2 1 1 2 0 15 15 21 18 135 1 2 3 25 25 25 25 25 25 7 40 130 90 120 2 3 2 170 10 3 Ready + 86% B C D E F G H H 1 J L M G 3 2 P 1 170 200 320 10 14 3 120 260 45 3 3 3 0 0 0 3 Q Q Q Q K 3 3 1 2 4 5 0 0 6 -1 1.5 6 1 0 1 2 2.7 5 2.5 2 0 0 130 120 100 50 50 100 100 120 100 90 110 110 80 90 3 3 2 G 0 1 2 1 2 0 0 0 0 0 0 12 8 6 13.5 11 20 13 10 14 -1 14 10.5 15 23 22 16 19 20 9 3 3 1 2 3 3 1 K R R c H C c C c 1 53 Oatmeal Raisin Crisp 54 Post Nat. Raisin Bran 55 Product 19 56 Puffed Rice 57 Puffed Wheat 58 Quaker Oat Squares 59 Quaker Oatmeal 60 Raisin Bran 61 Raisin Nut Bran 62 Raisin Squares 63 Rice Chex 64 Rice Krispies 65 Shredded Wheat 66 Shredded Wheat 'n'Bran 67 Shredded Wheat spoon size 68 Smacks 69 Special K 70 Strawberry Fruit Wheats 71 Total Corn Flakes 72 Total Raisin Bran 73 Total Whole Grain 74 Triples 75 Trix 76 Wheat Chex 77 Wheaties 78 Wheaties Honey Gold 79 grains 2 3 0 0 15 50 110 110 240 140 110 30 35 95 140 120 40 55 90 N N N K K 25 25 100 0 0 25 o 25 25 25 25 25 0 0 0 25 25 25 100 100 100 25 2 2 3 3 0 135 0 210 140 0 240 290 0 0 0 70 230 15 200 190 200 250 140 230 200 200 1 1 1 1 2 90 N 0 P 1.25 0.5 30.4508 1.33 0.67 37.8406 1 1 41.5035 0.5 1 60.7561 0.5 1 63.0056 1 0.5 49.5119 1 0.67 50.8284 1.33 0.75 39.2592 1 0.5 39.7034 1 0.5 55.3331 1 1.13 41.9989 1 1 40.5602 0.83 1 68.2359 1 0.67 74.4729 1 0.67 72.8018 1 0.75 31.2301 1 1 53.1313 1 1 59.364 1 1 38.8397 1.5 1 28.5928 1 1 46.6588 1 0.75 39.1062 1 1 27.7533 1 0.67 49.7874 1 1 51.5922 1 0.75 36.1876 0 3 4 4 3 1 1 3 0 1 0 1 2 3 K K N G G G G 4 110 110 90 110 140 100 110 110 100 100 110 2 6 2 2 3 3 2 1 3 3 0 1 1 1 1 1 1 0 15 3 3 5 3 14 3 3 12 3 3 8 16 15 21 15 16 21 13 17 17 16 35 230 110 60 3 3 3 2 1 3 0 0 3 3 1 25 G R 25 25 115 110 60 G 1 1 25 25 G 2 1 1 + Ready + 86%