Question: Your solution can be submitted as a plain-text, PDF, or image JPG file. The parts b) and c) require drawing of the curves, which you

Your solution can be submitted as a plain-text, PDF, or image JPG file. The parts b) and c) require drawing of the curves, which you can create in any software that you like, or even draw it by hand using a ruler and take picture of it. It should be clear to read and verify that it is correct. Suppose that a search engine returned 16 ranked results to our query, and when we checked them, the following are our judgements on their relevance: 1. relevant 2. relevant 3. relevant 4. not relevant 5. relevant 6. relevant 7. not relevant 8. not relevant 9. relevant 10. relevant 11. not relevant 12. not relevant 13. relevant 14. not relevant 15. not relevant 16. not relevant Assuming that the total number of relevant documents in the collection is 25, do the following tasks: a) (5 marks) Calculate precision, recall, and F-measure for the returned results. b) (10 marks) Draw the Precision-Recall curve for these results. Show how the appropri- ate coordinates were calculated. c) (10 marks) Draw the interpolated precision curve. Show how the appropriate coordi- nates were calculated. Your solution can be submitted as a plain-text, PDF, or image JPG file. The parts b) and c) require drawing of the curves, which you can create in any software that you like, or even draw it by hand using a ruler and take picture of it. It should be clear to read and verify that it is correct. Suppose that a search engine returned 16 ranked results to our query, and when we checked them, the following are our judgements on their relevance: 1. relevant 2. relevant 3. relevant 4. not relevant 5. relevant 6. relevant 7. not relevant 8. not relevant 9. relevant 10. relevant 11. not relevant 12. not relevant 13. relevant 14. not relevant 15. not relevant 16. not relevant Assuming that the total number of relevant documents in the collection is 25, do the following tasks: a) (5 marks) Calculate precision, recall, and F-measure for the returned results. b) (10 marks) Draw the Precision-Recall curve for these results. Show how the appropri- ate coordinates were calculated. c) (10 marks) Draw the interpolated precision curve. Show how the appropriate coordi- nates were calculated
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
