8. Consider the all-reduce operation in which each processor starts with an array of m words,...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
8. Consider the all-reduce operation in which each processor starts with an array of m words, and needs to get the global sum of the respective words in the array at each processor. This operation can be implemented on a ring using one of the followings. Note that log function in this chapter has base of 2, not 10. (i.e., log p is actually log2 p) a. All-to-all broadcast of all the arrays followed by a local computation of the sum of the respective elements of the array b. Single node accumulation of the elements of the array, followed by a one-to-all broadcast of the result array. (a) What is the time cost for each case in terms of m, t, and t? (5 points) (b) Assume that = 100, x = 1, and m is very large (i.e., 100). Which one is better? Justify your answer by comparing them in the plot with the number of processors (i.e., 2, 4, 6, ..., and 20). (10 points) (c) Assume that t=100, 1, and m is very small (i.e., 1). Which one is better? Justify your answer by comparing them in the plot with the number of processors (i.e., 2, 4, 6, ..., and 20). (10 points) 8. Consider the all-reduce operation in which each processor starts with an array of m words, and needs to get the global sum of the respective words in the array at each processor. This operation can be implemented on a ring using one of the followings. Note that log function in this chapter has base of 2, not 10. (i.e., log p is actually log2 p) a. All-to-all broadcast of all the arrays followed by a local computation of the sum of the respective elements of the array b. Single node accumulation of the elements of the array, followed by a one-to-all broadcast of the result array. (a) What is the time cost for each case in terms of m, t, and t? (5 points) (b) Assume that = 100, x = 1, and m is very large (i.e., 100). Which one is better? Justify your answer by comparing them in the plot with the number of processors (i.e., 2, 4, 6, ..., and 20). (10 points) (c) Assume that t=100, 1, and m is very small (i.e., 1). Which one is better? Justify your answer by comparing them in the plot with the number of processors (i.e., 2, 4, 6, ..., and 20). (10 points)
Expert Answer:
Answer rating: 100% (QA)
a For case a Alltoall broadcast requires communication between all processors which would take time ... View the full answer
Related Book For
Engineering Economy
ISBN: 978-0132554909
15th edition
Authors: William G. Sullivan, Elin M. Wicks, C. Patrick Koelling
Posted Date:
Students also viewed these programming questions
-
Note: All ML code must be explained clearly (INJAVAXX)and should be free of needless complexity. 2 CST.2016.1.3 2 Foundations of Computer Science Please help. (2c) (a) A prime number sieve is an...
-
"internet radios" for streaming audio, and personal video recorders and players. Describe design and evaluation processes that could be used by a start-up company to improve the usability of such...
-
Consider the following independent situations found during audit testing of Faran Ltd, which has a balance date of 30 June 2019. Assume that all the situations are material. (i)Recent industrial...
-
In Fig. 33-78, where n1 = 1.70, n2 = 1.50, and n3 = 1.30, light refracts from material 1 into material 2. If it is incident at point A at the critical angle for the interface between materials 2 and...
-
Anita Vasquez received $190,000 from her mother's estate. She placed the funds into the hands of a broker, who purchased the following securities on Anita's behalf: a. Common stock was purchased at a...
-
The stretchy sac where urine is temporarily stored is the (a) renal pelvis. (b) bladder. (c) ureter. (d) urethra.
-
Nationwide Auto Parts uses a periodic review inventory control system for one of its stock items. The review interval is six weeks, and the lead time for receiving the materials ordered from its...
-
On July 23 of the current year, Dakota Mining Company pays $8,131,200 for land estimated to contain 9,240,000 tons of recoverable ore. It installs and pays for machinery costing $831,600 on July 25....
-
Peter, an accountant has to file a Form W-4 with his new employer today. Rosie, Peter's spouse, also works as an accountant at a different company. Can Peter claim personal allowance as a withholding...
-
Create a Tablet class to model an Android tablet containing the following: Fields: weight(int) screenSize(float) and wifiOnly(boolean) Access to the fields must be through getters and setters only!...
-
A lab test is 9 5 percent effective at detecting a certain disease when it is present. When the disease is not present, the test is 9 9 percent effective at declaring the subject negative. If 8...
-
A 6.5 kg object undergoes an acceleration of 3.6 m/s? What is the magnitude of the resultant force acting on it? If this same force is applied to a 3.9 kg object, what acceleration is produced?
-
Looking for help with the Minimum and Maximum part of this code... .js file with the following functions: average, minimum, maximum. All functions will take an array as an input and the calculated...
-
Part 2: Complete the following calculations Quantity Price Total Revenue Marginal Revenue 0 $22 1 $20 2 $18 3 $16 4 $14 5 $12 6 $10 7 $8 8 $6
-
1) What is your view on the role IT in a business environment? 2) What metrics are important to measure the effectiveness of IT on business? 3) How can IT leaders establish an effective relationship...
-
The value of a share of common stock depends on the cash flows it is expected to provide, and those flows consist of the dividends the investor receives each year while holding the stock and the...
-
In clinical trials of Nasonex, 3774 adult and adolescent allergy patients (patients 12 years and older) were randomly divided into two groups. The patients in group 1 (experimental group) received...
-
Construct a 95% confidence interval for \(\mu_{1}-\mu_{2}\) using the data presented in Table 3. Approach The normal probability plots and boxplot (Figure 10) indicate that the data are approximately...
-
A researcher wishes to compare IQ scores of patients with and without cysts. She obtains a random sample of 708 patients of each category who take an IQ test and determines each patient's IQ....
Study smarter with the SolutionInn App