Question: 8 . In CBOW, 1 ) [ 3 pts ] Can we use a vocabulary index method ( instead of a one - hot vector

8. In CBOW,
1)[3 pts] Can we use a vocabulary index method (instead of a one-hot vector) as an input to CBOW
2)[2 pts] The activation function of the output layer should be softmax. Explain the reason.
3)[3 pts] After training is done in CBOW, how do we extract the word embedding vector for a certain word.
9.[3 pts] In Skip-Gram, show that F=exp(X) satisfies the following:
F((w_i-w_j)w _k )=F(w_i w _k )/F(w_j w _k )

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!