(Q4) Let X = (X X) be an n p random matrix such that Var((X);)...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
(Q4) Let X = (X₁ X₂) be an n × p random matrix such that Var((X¹);) = Σ, Vi, i.e. the Σ is the covariance matrix for row i of X (the ith column of XT). Assume that is a positive definite matrix with normed eigenvalue decomposition Σ = WAWI i) (10 points) Let Y; W(XT); be the vector of p scores for the i-th row of X. Show that the PCA representation preserves distance between the two vectors (XT); and (XT);, Vi, j € {1,..., n}, i.e. that i = ||XT — (x)} || = ||Y₁ – Yj|| - (1) - where ||u – v|| = (u − v)¹(u − v). [Hint: Use the properties of the various pieces of the eigenvalue decomposition.] ii) (10 points) Using the properties of traces of products of matrices and the defi- nition of E, show that: tr(Σ) = tr(A) showing that the sum of the eigenvalues is equal to the sum of the marginal variances. iii) (10 points) Suppose the random variables X₁, X₂ and X3 have the covariance matrix Σ = -2 0 5 0 00 2 1 -2 The eigenvalue-eigenvector pairs are shown for this covariance matrix in class. a) Calculate the variances of each of the principal components by calculating the variance of the linear combinations. Also calculate the covariance of all possible pairs of the principal components using the linear combinations. b) Calculate the proportion of total variance accounted for by the first, second and the third principal components, respectively. c) Verify the result shown in part (ii), i.e., sum of the eigenvalues is equal to the sum of the marginal variances. (Q4) Let X = (X₁ X₂) be an n × p random matrix such that Var((X¹);) = Σ, Vi, i.e. the Σ is the covariance matrix for row i of X (the ith column of XT). Assume that is a positive definite matrix with normed eigenvalue decomposition Σ = WAWI i) (10 points) Let Y; W(XT); be the vector of p scores for the i-th row of X. Show that the PCA representation preserves distance between the two vectors (XT); and (XT);, Vi, j € {1,..., n}, i.e. that i = ||XT — (x)} || = ||Y₁ – Yj|| - (1) - where ||u – v|| = (u − v)¹(u − v). [Hint: Use the properties of the various pieces of the eigenvalue decomposition.] ii) (10 points) Using the properties of traces of products of matrices and the defi- nition of E, show that: tr(Σ) = tr(A) showing that the sum of the eigenvalues is equal to the sum of the marginal variances. iii) (10 points) Suppose the random variables X₁, X₂ and X3 have the covariance matrix Σ = -2 0 5 0 00 2 1 -2 The eigenvalue-eigenvector pairs are shown for this covariance matrix in class. a) Calculate the variances of each of the principal components by calculating the variance of the linear combinations. Also calculate the covariance of all possible pairs of the principal components using the linear combinations. b) Calculate the proportion of total variance accounted for by the first, second and the third principal components, respectively. c) Verify the result shown in part (ii), i.e., sum of the eigenvalues is equal to the sum of the marginal variances.
Expert Answer:
Answer rating: 100% (QA)
Q4 i Let Yi WXi and Yj WXj be the vectors of principal component scores ... View the full answer
Related Book For
Posted Date:
Students also viewed these accounting questions
-
Prove that if A is a positive definite matrix with SVD A = U V T , then U = V.
-
Let W be an m 1 vector with covariance matrix W, where W is finite and positive definite. Let c be a nonrandom m 1 vector, and let Q = cW. a. Show that var(Q) = cWc. b. Suppose that c 0m. Show...
-
Let W be an n 1 matrix such that WT W = 1. The n n matrix H = In - 2WWT is called a Householder* matrix. (a) Show that H is symmetric. (b) Show that H-1 = HT.
-
Amrito Corporation is under financial distress and raises debt because it has several projects that are expected to generate profit in the future. When calculating its weighted average cost of...
-
Big Boy Toys Inc. retails racing products for BMWs, Porsches, and Ferraris. The following accounts and their balances appear in the ledger of Big Boy Toys Inc. on October 31, the end of the current...
-
Question 3 t The figure provided demonstrates two masses at rest. If the mass of each block is 9.70 kg, what does the scale read? Assume the string and pulley to be massless. The scale reads 4.85 kg....
-
True or false: Zero to peak and peak readings are the same thing.
-
Western Company wants to raise additional equity capital. After analysis of the available options, the company decides to issue 1,000 shares of $20 par preferred stock with detachable warrants. The...
-
12. Re-write the following switch statement as an if statement. switch (letter) { case 'c': case 'C': cout < < " Bobo " < < endl; case 'y': case 'N': cout < < " Is a Dog " < < endl; break; case 'x':...
-
You are employed by FishWrap Ltd., a local newspaper distribution company, and are attempting to determine the average level of customer satisfaction with the newspapers delivery service. All...
-
Jackson Company purchased $5,000 of office furniture on credit. What journal entry should be made? a. no entry should be made until the furniture is paid for b. Debit Furniture and credit Cash for...
-
Consider the following code snippet for adding elements to a Linked List: public void add(int data) { LinkedList newNode = new LinkedList(data); if (this.node == null) // if the LL is empty node =...
-
Consider the following 16-bit bit fields structure: 14 13 Gender 11 9 7 0 Hair Color Age (f) (g) (h) Assume that the variable is declared as an unsigned integer (16 bits), Write code using only shift...
-
Company X's stock currently sells for $15 a share. It just paid a dividend of $2 a share (that is, DO $2). The dividend is expected to grow at a constant rate of 4% a year. What stock price is...
-
Let A and B be 6 x 6 matrices, with det A = -10 and det B = 5. Use properties of determinants to compute: a) det(3A) b) det (ATB) Part II. Indicate whether the statements are true or false. (To be...
-
Problem 14-11 (Algo) (LO 14-4, 14-5, 14-6) A partnership begins its first year of operations with the following capital balances: Allegan, Capital Berrien, Capital Kent, Capital $ 72,000 62,000...
-
You bought a 4 percent preferred stock for $95.90 last year. The market price of your shares is now $97.38 What was your total return last year? (Do not round intermediate calculations and round your...
-
(a) Explain why the concentration of dissolved oxygen in freshwater is an important indicator of the quality of the water. (b) How is the solubility of oxygen in water affected by increasing...
-
(a) Use the formula e2i = (ei)2 to deduce the well-known trigonometric identities for cos 2 and sin 2. (b) Derive the corresponding identities for cos 3 and sin 3. (c) Write down the explicit...
-
Show that log(x2 + y2) and x/x2 + y2 are harmonic functions, that is, solutions of the two-dimensional Laplace equation.
-
Do the conclusions of Exercise 7.1.49(a-b) hold for the space D(2) of second order differential operators L = p(x) D2 + q(x) D + r(x) where p, q, r are polynomials?
-
What is the difference between a firm's gross profit margin, operating profit margin, and net profit margin?
-
Last year, Token Corporation reported \($1,230,000\) in sales with a cost of goods sold of \($520,000,\) and operating expenses of \($440,000.\) The increase in the firms retained earnings was...
-
In 2019, Italia Mining Corporation had sales of \($69\) million, total assets of \($45\) million, and total liabilities of \($23\) million. The interest rate on the debt is 6.5 percent, and its tax...
Study smarter with the SolutionInn App