$[$ From in$-$class discussion: weeks $6,7]$ Which statement is FALSE regarding Transformer$-$based language models $($Transformers$)$:

At the heart of every Transformer is a mechanism known as "self$-$attention".

The Transformer was first proposed in the $1980$s$,$ but has only recently become popular due to high$-$performance computing.

Transformers don't use memory states to capture the interdependencies of data sequences.

Transformers process all words in a sentence in parallel rather than sequentially.