In this question, you are required to evaluate the performance of different search engines.

• First, please select two of the three search engines (Google, Yahoo and/or Bing)
• Second, you are required to constrain your query to www dot reuters dot com (can't put URL) by specifying: e.g., Given a keyword query high-tech global, you need to write into the search box with high-tech global site:www dot reuters dot com at your selected search engine website. Below is the example provided for you to use google, shown in Figure 2 and Figure 3. [Penalty is applied if your results do not follow the instruction.]
• Third, please choose one target from the following list, and design two queries to search in both search engines. So both query 1 and query 2 have to be tested in both search engines.
  • Target 1: Online t u t o r s have more incomes in worldwide education marketing.
  • Target 2: Online education expanding, awaits innovation.
  • Target 3: Innovations in online learning for regional people.
• Finally, select the first 20 results in both search engines, if they return the target news, then mark them as relevant documents, otherwise, they are irrelevant. Note: assume there are 12 relevant documents in total (retrieved and not-retrieved). If you search more than 12 relevant documents, you can simply regard some to be irrelevant for practice.

The following questions are based on your search results. Please answer these questions

Question 2.1: List your target, results and designed search queries (You can use any keywords you think are related to the target news, even if the keywords are not contained the news text). For each result, you can click the link and go to the page, and write down a summary with 200 words for any 3 results if you think this result is relevant. At your report, you are required to provide the URL address and the summary to explain why they are relevant to the queries.

Question 2.2: Get the precision and recall values for 20 documents for query 1 in search engine 1. Interpolate them to 11 standard recall levels. Then plot them into a chart. Get the precision and recall values for 20 documents for query 1 in search engine 2. Interpolate them to 11 standard recall levels. Then plot them into the same chart.

Question 2.3: Get the precision and recall values for 20 documents for query 2 in search engine 1. Interpolate them to 11 standard recall levels. Then plot them into a chart. Get the precision and recall values for 20 documents for query 2 in search engine 2. Interpolate them to 11 standard recall levels. Then plot them into the same chart.

Question 2.4: Now find the average interpolated precision of query 1 and query 2 for search engine 1 and plot it into a chart. So you will have total of 3 interpolated curves in one single chart. Now find the average interpolated precision of query 1 and query 2 for search engine 2 and plot it into the same chart. So, you will have total of 3 interpolated curves in one single chart.

Question 2.5: Plot the average interpolated values for Search Engine 1 and Search Engine 2 on one single chart, and compare the algorithms in terms of precision and recall. Which search engine do you think is superior? Why?