Extraction Eval
Fast Extractor — field-level quality by priority
Priority Tiles
Each tile shows the average quality score for fields at that priority level. Priority 1 fields are the most business-critical (e.g. Invoice Number, Total, Tax). Click a tile to filter the table below to just that priority.
- Passing
- F1 score of 70% or higher — the extractor reliably gets this field right.
- Needs Work
- F1 score between 40-70% — partially working but not reliable enough.
- Failing
- F1 score below 40% — the extractor struggles significantly with this field.
- Not Covered
- The field exists in test invoices but the extractor never produced any value for it.
- N/A
- The field was neither present in the test invoices nor attempted by the extractor — no data to evaluate.
Key Metrics
- F1 Score
- The harmonic mean of precision and recall. Balances both types of errors into a single 0-100% quality score. Higher is better.
- Precision
- Of all the values the extractor produced, what percentage were correct? Low precision means lots of wrong values — bad for fields like invoice amounts where a wrong value is worse than no value.
- Recall
- Of all the values that actually existed, what percentage did the extractor find? Low recall means the extractor is missing values — bad for fields like invoice number where a missing value blocks downstream processing.
Detail Panel
Click any field row to expand its detail panel. This shows the raw confusion matrix:
- True Positive (TP)
- Field was present and the extractor got it right.
- False Positive (FP)
- Field was not present (or had a different value) but the extractor produced a value anyway — a hallucination or mismatch.
- False Negative (FN)
- Field was present but the extractor missed it entirely.
- True Negative (TN)
- Field was not present and the extractor correctly didn't produce a value.
Invoice Sections
Fields are grouped by where they appear on the invoice:
- Header
- Top-level invoice fields — invoice number, dates, totals, tax, currency, payment terms, etc.
- Party
- People and companies involved — seller, buyer, shipper, receiver, payee, and payer names, addresses, and contact info.
- Line Item
- Individual line items on the invoice — descriptions, quantities, unit prices, line-level taxes, and amounts.