Extraction quality
How often a machine-read answer survived review without an edit. A field people keep correcting is a field that should not be pre-filled.
- Accuracy, all forms
- 92%Target 95%
- Forms below target
- 2Of 3 forms measured
- Answers proposed
- 4,152Every one reviewed by a person before submission
What this measures, and what it does not
Accuracy here means the reader transcribed the document correctly. It says nothing about whether a claim should be granted. Confidence and accuracy never feed an eligibility decision or a payment amount.
Accuracy by form
| Against target | ||||
|---|---|---|---|---|
| 148 | 1,632 | 91%target 95% | 4 points below | |
| 212 | 1,908 | 88%target 95% | 7 points below | |
| 74 | 612 | 96%target 95% | At target |
Extraction accuracy for each form, measured against the target.
- Form
- Documents read
- 148
- Answers proposed
- 1,632
- Confirmed without an edit
- 91%target 95%
- Against target
- 4 points below
- Form
- Documents read
- 212
- Answers proposed
- 1,908
- Confirmed without an edit
- 88%target 95%
- Against target
- 7 points below
- Form
- Documents read
- 74
- Answers proposed
- 612
- Confirmed without an edit
- 96%target 95%
- Against target
- At target
Fields in 21P-534EZ
Survivor benefits application. Sorted worst first, so the fields staff keep correcting are at the top.
- Low confidence
Cause of death
veteran.causeOfDeath
Confirmed without an edit54%148 reads - corrected 46% of the time.
Handwritten on most death certificates. The worst performer on this form.
- Medium confidence
Burial expenses paid
burial.expensesPaid
Confirmed without an edit71%96 reads - corrected 29% of the time.
Funeral invoices vary in layout. Totals are often split across lines.
- High confidence
Date of marriage
relationship.marriedOn
Confirmed without an edit93%148 reads - corrected 7% of the time.
Reads cleanly from the marriage certificate.
- High confidence
Claimant's full name
claimant.fullName
Confirmed without an edit96%148 reads - corrected 4% of the time.
Corrections are mostly suffixes and middle initials.
- High confidence
Date of death
veteran.dateOfDeath
Confirmed without an edit98%148 reads - corrected 2% of the time.
Printed field in a fixed position.
Worst performing fields across all forms
- Cause of death (21P-534EZ)Corrected 46% of the time. Handwritten on most death certificates. The worst performer on this form.
- Monthly household income (21P-527EZ)Corrected 38% of the time. Statement totals include transfers the Veteran does not count as income.
- Burial expenses paid (21P-534EZ)Corrected 29% of the time. Funeral invoices vary in layout. Totals are often split across lines.
Tightening a rule or dropping a field from pre-fill is an intake change. Open the forms inventory.