Question: Recall that when training VAEs, we minimize the negative ELBO, an upper bound to the negative log likelihood. Show that the negative log likelihood, Ex
Recall that when training VAEs, we minimize the negative ELBO, an upper bound tothe negative log likelihood. Show that the negative log likelihood, Expdataxlog ptheta x can be written as aKL divergence plus an additional term that is constant with respect to theta We are asking if the KL divergenceis equal to LG so after finding the expression, you will be able to deduce that. Note that the constant termis constant with respect to theta so it can be another expectation.Does this mean that a VAE decoder trained with ELBO and a GAN generator trained with the LG definedin the previous part c are implicitly learning the same objective? Explain.
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
