Question: Q 2 . Abstractive Summarization using T 5 : Code [ 5 ] In this question, you will implement the summarization task using the pre
Q Abstractive Summarization using T: Code
In this question, you will implement the summarization task using the pretrained model T
Load the dataset cnndailymail with version. Use test set for testing purposes. Since the model is pretrained. vou do not need the train set.
Using transformers library from Huggingface load the tsmall model. Note that this will take around MB of space.
Preprocess the test set articles column as per step of Q You do not need to add start and end tokens for this question. Generate the summary of each row using the T model. You may use TForConditionalGeneration for this task.
Evaluate the model using average ROUGE ROUGE and ROUGEL scores on the test set.
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
