Question$-1$:

Take our CIFAR classification example:

a$)$ Measure train speed when running in CPU and GPU. HINT: Measure how long does it take

to train one iteration?

b$)$ Change the classification head as follows:

Use a linear transformation that transforms features to $200$

Use RELU

Use a linear transformation that transforms features to $100$

Use Softmax

Run training for $5$ epochs with two different learning rates. Measure the accuracy for each.

Solve this question in python. Also use pytorch not keras