Contract-review judge test
Source: james-tn/decision-model-contract-judge-eval ↗Tests Microsoft-Decision-1 and a frontier reasoning model as contract-review judges on 2,091 ContractNLI and 1,224 CUAD judgments. Decision-1 with rules scores 82.9% and 90.0% accuracy. It reads overlapping chunks while the frontier model reads whole documents; added rules and confidence definitions differ. This is one author’s field test.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →