Consider the following neural network with weights w for the edges and offset b for the...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Consider the following neural network with weights w for the edges and offset b for the nodes: 1 W = 0.4 1,3 W = 0.6 1,4 b= -0.3 3,5 Y3 W = 2.0 b = 0.0 Y_ b = 0.4 5 W23=-0.7 W2=-0.5 Y W4.5 1.0 4 Assume that the outputs of nodes Y3, Y4, and Y are based on rectified linear functions: Y3 = max(0,W,3 b3 Y5 = max (0, 2,40% a + b) or Y = max (0. + D). For the following problems, consider input values X = 1 and X2 = 1: (a) What is the value of Y3 for this input? (6 points) (b) What is the value of Y4 for this input? (6 points) (c) What is the value of Y5 for this input? (6 points) Assuming the desired output is 0.6 and the squared loss function, loss (Y5, 0.6) = (Y5 -0.6), is used: (d) What is the gradient of this loss for this example with respect to b5? (10 points) (e) What is the gradient of this loss for this example with respect to w,3? (10 points) (f) What is the gradient of this loss for this example with respect to w2,4? (10 points) Consider the following neural network with weights w for the edges and offset b for the nodes: 1 W = 0.4 1,3 W = 0.6 1,4 b= -0.3 3,5 Y3 W = 2.0 b = 0.0 Y_ b = 0.4 5 W23=-0.7 W2=-0.5 Y W4.5 1.0 4 Assume that the outputs of nodes Y3, Y4, and Y are based on rectified linear functions: Y3 = max(0,W,3 b3 Y5 = max (0, 2,40% a + b) or Y = max (0. + D). For the following problems, consider input values X = 1 and X2 = 1: (a) What is the value of Y3 for this input? (6 points) (b) What is the value of Y4 for this input? (6 points) (c) What is the value of Y5 for this input? (6 points) Assuming the desired output is 0.6 and the squared loss function, loss (Y5, 0.6) = (Y5 -0.6), is used: (d) What is the gradient of this loss for this example with respect to b5? (10 points) (e) What is the gradient of this loss for this example with respect to w,3? (10 points) (f) What is the gradient of this loss for this example with respect to w2,4? (10 points)
Expert Answer:
Related Book For
Posted Date:
Students also viewed these programming questions
-
Q1. You have identified a market opportunity for home media players that would cater for older members of the population. Many older people have difficulty in understanding the operating principles...
-
Give Correct ANSWERS Human-Computer Interaction (a) If you had been one of the original inventors of the WIMP interface, and engineers on the technical team had been sceptical about the advantages...
-
Let B > 0. Show that the maximum of (x 1 , . . . , x n ) = x 1 + + x n subject to x 2 1 + + x 2 n = B 2 is nB. Conclude that for all numbers a,..., an lal++lanl n(a + + a) / 1/2
-
Real Estate Investment Trust (RE) was created to hold hotel properties. RE currently holds 15 luxury and first-class hotels in Europe. The entity is structured as an investment trust, which means...
-
The following is from the governmental funds balance sheet section of the Town of Libertyville's Comprehensive Annual Financial Report. 1. What is the most likely reason that there are no unassigned...
-
What is the primary source document for an auditor's tests of billing?
-
On January 2, Year 1, Poplar Ltd. purchased 80% of the outstanding shares of Spruce Ltd. for $2,000,000. At that date, Spruce had common shares of $500,000 and retained earnings of $1,250,000 and...
-
Huron Company produces a commercial cleaning compound known as Zoom. The direct materials and direct labor standards for one unit of Zoom are given below: Standard Quantity or Standard Price or Rate...
-
(a) Consider the sequence 011 101 010 111. Deferentially encode it and assume that the deferentially encoded sequence is used to biphase modulate a sinusoidal carrier of arbitrary phase. Prove that...
-
Given the graph: total income? for which team does the top 25% of the population earn a higher share of
-
Find (fof)(2). Simplify. f(x)=2x-5
-
Harlow has been saving for seven months and has $477.75 saved for accommodations, which is 35% of her total vacation savings. Determine what percent of Harlow's $1,950.00 monthly retirement income...
-
What role does hegemony play in shaping cultural norms and values, and how does it influence power dynamics within social structures ?
-
Lana just retired from her company after 15 years of service. Determine what her approximate monthly pension plan payment will be if her average annual pay was $98,160.00 and the company offers 1.2%...
-
What are the implications of globalization on social identities, cultural practices, and economic structures, and how do individuals negotiate their sense of belonging in an increasingly...
-
Suppose a company is expected to pay a $4 dividend in one year. If the dividend is expected to grow at 2% per year and the required return is 12%, what is the price? A. $40 B. $40.8 C. $33.33 D. $34
-
What recommendations would you make to Big Four firms to help them (1) avoid confrontations with governmental officials in an authoritarian society and (2) deal effectively with such confrontations...
-
Look up the curves called hypocycloid and epicycloid. Write a report on what you find. Be sure to draw comparisons with the cycloid.
-
True or False. may be described by saying that the value of gets closer to N as x gets closer to c but remains unequal to c. lim f(x) = N
-
Use the accompanying graph of y = f(x). Does exist? If it does, what is it? lim f(x) x4
-
What is the pro forma statement, and how important is it for a business?
-
Briefly compare replacement value to liquidation value of an asset.
-
What do we mean by budgeting, and how would this process serve the firm?
Study smarter with the SolutionInn App