Question: You are tasked with improving the data quality and observability of a dataset containing customer orders for an e - commerce website. The dataset contains

You are tasked with improving the data quality and observability of a dataset containing customer
orders for an e-commerce website. The dataset contains 1,000 records, and you've identified several data
quality issues:
Duplicate Orders: There are 50 duplicate orders in the dataset.
Missing Values: In the "Shipping Address" field, 100 records have missing or incomplete addresses
Inconsistent Date Formats: The "Order Date" field contains dates in both "MM/DD/YYYY" and
"YYYY-MM-DD" formats. There are 30 records with inconsistent date formats.
Outliers in Order Amount: There are 10 orders with an unusually high order amount that seems like
outliers.
a) Explain why data quality and observability are essential in this context.
b) Design and compute four data quality metrics based on the given data.
c) Propose a step-by-step plan to address these data quality issues and enhance data observability.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!