Question: Q 2 . Abstractive Summarization using T 5 : Code [ 5 ] In this question, you will implement the summarization task using the pre

Q2. Abstractive Summarization using T5: Code [5]
In this question, you will implement the summarization task using the pre-trained model T5.
1. Load the dataset cnn-dailymail with 3.0.0 version. Use test set for testing purposes. Since the model is pre-trained. vou do not need the train set.
2. Using transformers library from Huggingface \({}^{3}\), load the t5-small \({}^{4}\) model. Note that this will take around 240 MB of space.
3. Pre-process the test set articles column as per step 2 of Q1. You do not need to add start and end tokens for this question. Generate the summary of each row using the T5 model. You may use T5ForConditionalGeneration \({}^{5}\) for this task.
4. Evaluate the model using average ROUGE-1, ROUGE-2 and ROUGE-L scores on the test set.
Q 2 . Abstractive Summarization using T 5 : Code

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!