Questions:

$1.$Explain intuitively:

a$.$What is the tokenization? $(10$points$)$

b$.$What is the different between stemming and lemmatization? Give an example!

points$)$

$2.$Let we have corpus: $5$low$,6$newer$,3$wider$,2$new$.$

a$.$Do subword tokenization using wordpiece tokenization in three iterations. $(15$points$)$

b$.$What is the tokenization of word "lower" according to wordpiece? $(5$points$)$