Which technique is commonly used to pre$-$train$$Large Language Models like GPT$-3?$

Answer choices

Select an option

Reinforcement Learning with reward signals

Self$-$Supervised Learning on vast amounts of text data

Supervised Learning with labels such as sentiment for text data

Semi$-$Supervised Learning with limited amounts of labeled data