Methodology v1 · July 17, 2026
“The PDF looks right” is not a reliability test.
A production PDF workflow must make the source values, field positions, missing records, layout changes, and repeat behavior inspectable. This page publishes the exact checklist and small public fixture we use to evaluate that workflow.
Scope: this is a reproducible product fixture, not an independent multi-vendor benchmark and not a claim of universal accuracy. It intentionally avoids fabricated success rates. Use the files below to inspect the workflow or repeat the test yourself.
Acceptance criteria
Five things every claim should let you verify.
A public five-row CSV is downloadable.
A result cannot be audited if the expected values are hidden.
The public fixture uses the original W-9 PDF.
Rebuilding a form can change layout, fonts, pagination, or legal text.
Detected fields and spreadsheet mapping are shown before export.
A plausible-looking value in the wrong box is still a failed fill.
One selected spreadsheet row produces one PDF in the ZIP.
Batch completeness matters as much as the accuracy of one document.
Reviewed field layouts can be saved as exact templates.
A production workflow should not ask a model to rediscover stable geometry every time.
How to repeat the test
Use the same acceptance criteria with any tool. Record observable errors rather than compressing everything into a single vague “accuracy” number.
- 1
Download the blank PDF and source CSV before opening the product.
- 2
Write down the expected value and target field for every populated cell.
- 3
Run detection and preserve screenshots of the field boxes and mapping.
- 4
Export all five outputs and check missing, duplicate, misplaced, clipped, and altered values.
- 5
Repeat one record using a saved template and verify that field geometry is reused rather than rediscovered.
Discovery needs review
ML field detection is probabilistic. Confidence and previews must remain visible.
Repetition should be exact
After review, stable forms should use stored geometry instead of repeated interpretation.
Business meaning stays human
Correct placement does not validate tax, legal, medical, or operational decisions.
Use the fixture, not our adjectives.
The input files and workflow recording are public.