Example:

Document ordering and ordering distance from the ordering of the original documents for a variety of summarization algorithms. The distance is the place difference between the order of the document for the Summarizer for each of the 10 documents. This sum of place distances is minimal for Summarizer 4, where E is 1 place different, F is 1 place different, D is 2 places different, I is 1 place different, and J is 1 place different from the Original document ordered for the non-summarized documents. This is the best Summarizer among the five for retaining document sequencing for learning.

Problem, for reading order as a functional test for summarization fill in the rightmost two columns of the table below. Which Summarizer do you feel is the best of the 5 shown, and why?

Document Set	Document Order	Distance to Original	Ranked Order
Original	ABCDEFGHIJ	N/A	N/A
Summarizer 1	ACEDFBHJIG
Summarizer 2	ABCEDGFIHJ
Summarizer 3	ABDCEFHGIJ
Summarizer 4	BADCFEGHIJ
Summarizer 5	ADCBFEGIHJ

Document Set Document Order Distance to Original Ranked Order Original ABCDEFGHIJ N/A o 00 Summarizer 1 ABEDCGHEIJ 2 Summarizer 2 BACDFEHJIG 10 3 Summarizer 3 CDABFGHEIJ 14 4 Summarizer 4 ABCEFDGHJI 6 1 Summarizer 5 DEAGCFBJHI 22 5 Document Set Document Order Distance to Original Ranked Order Original ABCDEFGHIJ N/A o 00 Summarizer 1 ABEDCGHEIJ 2 Summarizer 2 BACDFEHJIG 10 3 Summarizer 3 CDABFGHEIJ 14 4 Summarizer 4 ABCEFDGHJI 6 1 Summarizer 5 DEAGCFBJHI 22 5