Skip to content

Illustrative scenario · Synthetic data · No client engagement or measured business outcome

OFFER H1 · SCN-08 · PARTIAL

What should a document-review assistant hand to a human?

An imaginary services firm receives agreements and operating documents with recurring review steps. The synthetic set includes missing sections, dates that need confirmation, and clauses that are intentionally ambiguous.

FIG. 01 · RETRIEVAL PATH · SCN-08CorpusSYNTHETIC · 1,200 DOCSIndexPERMISSIONS APPLIED HEREQuerySCOPED TO THE ACTORAnswer with citationRESOLVABLE SPANRefusalNO SUPPORTING SOURCEHuman reviewCONFLICT OR LOW CONFIDENCESUPPORTEDUNSUPPORTEDCONFLICT
The same path. What a reviewer receives is a cited excerpt or an explicit gap - never a confident answer the corpus cannot support.

WHAT WE WOULD SHOW

  • A cited excerpt with its source metadata
  • Finding severity, assigned rather than inferred
  • A missing-information queue
  • A dates-to-confirm list
  • An explicit handoff to the responsible reviewer

PROPOSED ARTIFACTS

  • Cited excerpts
  • Findings list with severity
  • Missing-information queue
  • Dates-to-confirm list

ILLUSTRATIVE TEST DESIGN, NOT RESULTS

Synthetic agreements, cited excerpts, a missing-information queue, dates-to-confirm, and an explicit human handoff.

Any analysis shown is a prioritisation aid. The reviewer remains responsible for the conclusion.

Have a review process that hides the important exceptions? Map the handoff with us.

DISCUSS A PROBLEM