AI Content Chat (Beta) logo

Straight Through Processing - Document Automation StepFive: Analyzing theResults Analysis of the results is the big focus since the true value of an intelligent capture system is delivering the mostdatawiththehighestlevelsofaccuracy.Becauseyouhaveyourgroundtruthdataforyourtestdeck,you haveaveryeasywayofcomparingeachsystem’soutputinanapples-to-applesmanner.Askfortheresultsto bedeliveredinasimplestructuredformatsuchas: File Name Field 1 - Date Field 2 - Invoice Field 3 - Amount Invoice123.pdf 01/10/2020 12345 $34.56 Invoice345.pdf 03/15/2020 ABCDE $123.45 --- --- --- --- Each cell of the table is the actual value of the file name and corresponding field. From here you can directly compare each system’s structured results with your answer key to identify the total accuracy of the system. The total system accuracy is the number of total data fields divided by the number of accurate data fields outputor: # of Accurate OutputFields —————————————————-= System Accuracy Total # of all Fields For instance, if your sample set of 500 invoices has 1500 total fields (one each for date, invoice number and amount), and System A outputs 800 accurate fields, then System A Accuracy = 800/1500 or 53%. Once you have compared each system’s output to the answer key, youhave a solid understanding of accuracy for each system. If some data fields are more important than others, using the same comparisonmethod,you can understand accuracy at a field level calculating, for instance, the accuracy of Invoice Amount by dividing the total number of accurateoutput for Amount by the total of amount fields. 39

Straight Through Processing for Document Automation - Page 39 Straight Through Processing for Document Automation Page 38 Page 40