$1.$ Each group is expected to submit jupyter notebook $(.$ipynb$)$ with output for each cell.

$2.$ No extension on the deadline

$3.$ Submissions using other Python IDEs will not be considered for grading.

Question: Inverted Index with Term and Document Frequency

A$)$ Search for an open$-$source dataset or document collection suitable for calculating term and document frequency in the construction of an inverted index. $(2$ marks$)$

B$)$

a$)$ Write a Python function to calculate term frequency and document frequency during the construction of an inverted index using the identified dataset. Explain the implications of using these metrics in ranking and relevance measurement. $(4$ marks$)$

b$)$ Discuss how the inclusion of both term frequency and document frequency enhances the effectiveness of information retrieval. $(4$ marks$)$