Task:

In the preprocessing step, you may need to merge some datasets to associate products with

their corresponding order details. It is a very raw dataset. Complete all the data preprocessing

steps needed. You may also need to sort and group the merged data to ensure that you process

the orders in the correct sequence for each user.

Depending on your analysis goals, filter out users with very few transactions or items that

appear infrequently. Ensure that each transaction is unique for each user by removing

duplicates, if applicable. Check for and handle any missing values in the dataset to prevent

issues during analysis. $-15$ points

Implement the SPADE algorithm to discover all sequential patterns that appear in the dataset

with a support greater than or equal to a specified minimum support threshold.

Minimum Support Threshold: A float value representing the minimum support

required to consider a pattern as frequent. For example, min$\_$support $=0\mathrm{.}2$

$-15$ points

Output:

Return a list of itemsets, where each tuple consists of a frequent sequential pattern and its

support count, sorted by support count in descending orde