Question: Normalized Discounted Cumulative Gain (NDCG): a benchmark for information retrieval system evaluation contains 6 documents {d1,d2,d3,d4,d5,d6} and 2 queries {q1,q2}, assume the relevance scores of

Normalized Discounted Cumulative Gain (NDCG): a benchmark for information retrieval system

Normalized Discounted Cumulative Gain (NDCG): a benchmark for information retrieval system evaluation contains 6 documents {d1,d2,d3,d4,d5,d6} and 2 queries {q1,q2}, assume the relevance scores of the six documents to q1 is {3,4,2,1,5,0} and to q2 is {6,3,2,1,0,0}. Given two information retrieval algorithms, if their rankings of the six documents based on the queries are as follows (left for q1 and right for q2 ): Calculate their NDCG using the formula below to measure which IR algorithm is more effectives (check slides 44-47 of chapter 8; note that the formula used in the example is different) NDCG(Q,k)=Q1j=1QZkjm=1klog2(1+m)2R(j,m)1

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock blur-text-image

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!

After reading an article about activity-based costing in a trade journal for the furniture industry, Adriana Lopez wondered if it was time to critically analyze overhead costs at Success Systems. In...

4. Normalized Discounted Cumulative Gain (NDCG): a benchmark for information retrieval system evaluation contains 6 documents {d1,d2,d3,d4,d5,d6} and 2 queries {q1,q2}, assume the relevance scores of...

Consider a ranked list of 5 documents for a search query. The relevance grades for each document are as follows: Relevance grades: 3 , 2 , 0 , 1 , 3 1 . Calculate the Discounted Cumulative Gain ( DCG...

You have the following Normalized Discounted Cumulative Gain ( NDCG ) values in several Evaluate Recommender Modules in Azure Machine Learning. Which NDCG score is the best? Group of answer choices 0...

Select the statement(s) about information retrieval that are incorrect. In information retrieval (IR), rare words are the same informative as common words. Assuming given a query, your IR system will...

Practical data Science with Python Assignment Assessment : Recommender Systems This assignment focuses on recommender systems, a data science application widely used in the real world. You will need...

How to calculate the average precision (AP) for each adopted query and the mean average precision (MAP), based on both arithmetic and geometric means, must be calculated in terms of interpolated...

column 'rank' gives the rank of the document. The column 'docID' gives the document ID associated with the document at that rank. The column 'graded relevance' gives the relevance grade associated...

Question 3 (25 marks) Suppose we have a collection of 20 documents, d, d2, ..., d20, which have been judged for relevance to a query. A 3-point relevance scale was used, so relevant documents have...

Suppose we have a collection of 20 documents, d, d2,..., d20, which have been judged for relevance to a query. A 3-point relevance scale was used, so relevant documents have been divided into...

please give me asnwer dont give me method i want solution homework , i need just g , h , i , j , k , i , i , ii , iii ( a ) Compute P@ 5 and P@ 1 0 . [ 1 0 points ] ( b ) Compute R@ 5 and R@ 1 0 . [...

Consider the regression of mileage for certain automobiles, measured in miles per gallon (mpg) on their weight in pounds (wt). The data are from Consumer Reports (April 1997). Part of the SAS output...

Rembrandt Frame Company prepared the following sales budget for the current year: At the end of December 2008, the following unit sales data were reported for the year: For the year ending December...

Question 6 1 pts A bond has a $ 1 , 0 0 0 par value, makes anenal interest payments of $ 1 0 0 , has $ years to maturity, cannot be called, and is not expected to defelel. The bond should sell at a...

Hey there I need some help with this Python Program, thank you in advance!! COMSC-122 Problem Set 5 Spring 2016 pl ppl p E p t ll d t k f Th foll g d d f Vehicle manufacturer engine Size desired...

2. Many employees desire flexible work arrangements so that they can work in ways that accommodate their individual preferences, obligations, and schedules. Companies can offer a wide array of...

LO3 Show how women are affected by pay, job assignments, and career issues.

3. Providing reasonable accommodations for pregnant employees, workers with disabilities, and individuals with military backgrounds are important EEO issues today. HR professionals should understand...