AI Content Chat (Beta) logo

Straight Through Processing - Document Automation Confidence Scores are not Probabilistic Whyis displaying a confidence score not useful? Because a score by itself has no specific ability to communicate whether the associated data output is accurate or not. A confidence score of 80 does not mean that it “has an 80% probability of being correct.” So if this is the case, what good are they? First, let’s use an analogy. Suppose there was a test for which a student got 30questions correct and they come to you to ask what the resulting grade is. Could you give them a grade? No, you’d likely ask how many total questions there were on the exam. Confidence scores are similar in that you need more context in order to make them useful. Instead of knowing the total number of questions on the exam, you need to understand the full range of confidence scores for any particular answer value. 28

Straight Through Processing for Document Automation - Page 28 Straight Through Processing for Document Automation Page 27 Page 29