Question: 10. Figure below shows an execution of a practical MapReduce programme called WebVisCounter. The program counts the number of times users connect to or visit
10. Figure below shows an execution of a practical MapReduce programme called WebVisCounter. The program counts the number of times users connect to or visit a given website using a particular operating system (e.g. Windows or Mac). A single line of a typical web server log file is fed into the MapReduce framework, which is shown in the Line offset column. Here, you are required to demonstrate your understanding of MapReduce execution by working out the outcome of each task/box figure shown below (e.g. MAP1, MAP2, PAR1, PAR2, etc.) where the final outcome should match the expected result at the Output stage.
Map Partitioning Line offset M1 M1 M1 Sort & group (0, 77.241.136.xx- [12/Jan/2010...]... Macintosh; U) (207, 58.87.64.xx - ([12/Jan/2010...]... WinXP; U) (290, 78.41.226.xx [10/Jan/2010...]... Win98; U) (310,213.163.90.xx-[29/Dec/2009..]... WinXP; U) R1 MAP1 PAR1 Output (Macintosh, 4) Reduce SOR1 M2 M2 M2 RED1 (320,110.5.116.xx- [20/Nov2009..]... WinXP: U) (380, 62.106.0.xx-- [20/Nov/2009...] Macintosh; U) (420, 116.212.64.xx [20/Nov/2009...] .. Win98; U) (540, 1212.80.0.xx-[19/Nov/2009....Macintosh; U) (459, 80.82.96.xx --[19/Nov/2009...] MAP2 PAR2 (Win98, 3) (WinXP, 5) WinXP; U) RED2 SOR2 M3 M3 M3 (612, 77.236.192.xx- [18/Nov/2009...]... WinXP; U) (682,77.230.60.xx--[17/Nov/2009...]...Macintosh; U) (710, 216.55.163.xx--[17/Nov/2009...]... Win98; U) MAP3 PAR3 R2 Local disk of map wo rkers Local disk of redu ce workers
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
