Question: In Transformers, what is the purpose of the positional encoding? Question 3 Answer a . To increase the model's capacity b . To capture sequence
In Transformers, what is the purpose of the positional encoding?
Question Answer
a
To increase the model's capacity
b
To capture sequence information since Transformers lack recurrence
c
To reduce overfitting during finetuning
d
To improve the training efficiency
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
