Question: Task 1: Vector Space Model over tf-idf Given the following corpus: Doc 1: fast car highway road car Doc 2: car car bike fast fast

 Task 1: Vector Space Model over tf-idf Given the following corpus:

Task 1: Vector Space Model over tf-idf Given the following corpus: Doc 1: "fast car highway road car" Doc 2: "car car bike fast fast" Doc 3: "road road highway fast wheel" Doc 4: "bike wheel car wheel" Calculate a vector space model over tf-idf weights for this corpus. In particular, calculate the following: 1. The document frequency df (t) of all terms, i.e. in how many documents each term occurs. 2. The inverse document frequency defined as ()- og0 whee df(t) is the df(t) document frequency of that term and N is the corpus size, i.e. the number of documents in the corpus. 3. The term frequency per document, i.e. which terms occur how many times in each document. 4. The tf-idf vectors for each document. Now, the retrieval system is faced with the query "fast fast car bike". 1. Calculate the tf-idf vector of that query 2. Calculate the cosine similarities between the query vector and all document vectors. 3. Specify the ranked document set that would be the result of the query

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!