Question: Your solution can be submitted as a plain-text, PDF, or image JPG file. The parts b) and c) require drawing of the curves, which you

 Your solution can be submitted as a plain-text, PDF, or image

Your solution can be submitted as a plain-text, PDF, or image JPG file. The parts b) and c) require drawing of the curves, which you can create in any software that you like, or even draw it by hand using a ruler and take picture of it. It should be clear to read and verify that it is correct. Suppose that a search engine returned 16 ranked results to our query, and when we checked them, the following are our judgements on their relevance: 1. relevant 2. relevant 3. relevant 4. not relevant 5. relevant 6. relevant 7. not relevant 8. not relevant 9. relevant 10. relevant 11. not relevant 12. not relevant 13. relevant 14. not relevant 15. not relevant 16. not relevant Assuming that the total number of relevant documents in the collection is 25, do the following tasks: a) (5 marks) Calculate precision, recall, and F-measure for the returned results. b) (10 marks) Draw the Precision-Recall curve for these results. Show how the appropri- ate coordinates were calculated. c) (10 marks) Draw the interpolated precision curve. Show how the appropriate coordi- nates were calculated. Your solution can be submitted as a plain-text, PDF, or image JPG file. The parts b) and c) require drawing of the curves, which you can create in any software that you like, or even draw it by hand using a ruler and take picture of it. It should be clear to read and verify that it is correct. Suppose that a search engine returned 16 ranked results to our query, and when we checked them, the following are our judgements on their relevance: 1. relevant 2. relevant 3. relevant 4. not relevant 5. relevant 6. relevant 7. not relevant 8. not relevant 9. relevant 10. relevant 11. not relevant 12. not relevant 13. relevant 14. not relevant 15. not relevant 16. not relevant Assuming that the total number of relevant documents in the collection is 25, do the following tasks: a) (5 marks) Calculate precision, recall, and F-measure for the returned results. b) (10 marks) Draw the Precision-Recall curve for these results. Show how the appropri- ate coordinates were calculated. c) (10 marks) Draw the interpolated precision curve. Show how the appropriate coordi- nates were calculated

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!