research-document MS-AIRES-2026-0001
Independent pilot integrity review
Mission
Objective
Obtain two blinded, independent construct and probe reviews for ET-004-P01 and ET-014-P01, then validate, revise, or quarantine each pilot.
Why this matters
Designer calibration cannot establish construct validity. This is the current gate for all capability baselines.
Scope
Included: reviewer recruitment, preregistered materials, independent labels, agreement analysis, post-capture adjudication, immutable dispositions. Excluded: agent capability runs and model comparisons.
Existing context
research/frontier/records/RFR-001.md,
research/evaluation/13-independent-review-protocol.md, and NX-001 in
research/analysis/non-human-next-experiments.md.
Initial hypotheses
Independent reviewers will find both pilots valid after bounded revisions and will agree on material probe labels. A quarantine or unresolved disagreement falsifies promotion readiness.
Required evidence
Original independent reviews, blinded labels, agreement table, adjudication, task/grader hashes, and final pilot disposition.
Constraints
Reviewers must not have designed the tasks or graders. Preserve reviews before discussion and do not simulate independence with repository agents.
Execution instructions
Follow the independent-review protocol and the frozen unseen-outcome portion of NX-001. Record revisions without overwriting prior versions.
Deliverables
Cycle report, immutable review records, agreement analysis, and updated evaluation registries.
Success criteria
Two independent reviews per pilot, no concealed disagreement, and an explicit validate/revise/quarantine decision for each pilot.
Stop conditions
Stop when both pilots have a defensible disposition or reviewer independence cannot be obtained.
Handoff requirements
State which pilots, if any, unlock MS-AIRES-2026-0002 and list every unresolved validity concern.