research-document
Evaluation Registries — Document Frontier
Evaluation Registries — Document Frontier
Origins: research/evaluation/03-evidence-registry.md; 04-hypothesis-registry.md; 05-experiment-registry.md; 06-failure-taxonomy.md
Knowledge and limitations
The registries make claims falsifiable and preserve limitations. Evidence is strongest for repository observations and incident occurrence, weaker for transfer and causal design. The hypothesis registry has no HY-E007, creating an identifier-integrity question.
Five highest-value opportunities
- RFR-003: Test HY-E003/HY-E005 with expert labels.
- RFR-004: Test HY-E001/HY-E002/HY-E008 on a representative suite.
- RFR-008: Test HY-E009/HY-E010 using control exercises.
- RFR-006: Test HY-E011 with observed all-in costs.
- RFR-009: Validate registry identifiers and cross-references.
Challenge: “Leading” hypotheses risk anchoring. Pre-registration and blinded adjudication should precede new observations.