research-document
AI State of the Field — Document Frontier
AI State of the Field — Document Frontier
Origin: research/AI-State-of-the-Field-REP.md
Knowledge and limitations
The REP argues that verified outcomes, context policy, harness effects, trajectory evidence, and security boundaries dominate current AI-ROS decisions. Its evidence is recent and traceable but concentrated in vendor reports, preprints, public benchmarks, and software tasks; transfer to AI-ROS is untested.
Five highest-value opportunities
- RFR-004: Test public-to-native task transfer (EV-001, EV-002, “Risks and Research Debt”).
- RFR-003: Validate layered outcome/trajectory grading (EV-005, EV-006).
- RFR-005: Causally compare context policies (EV-004).
- RFR-008: Validate least-privilege containment (EV-007).
- RFR-006: Measure verified cost rather than token cost (“Recommended Next Research”).
Challenge: The REP’s mission selection is reasoned prioritization, not evidence that evaluation work has higher realized ROI. RFR-006 should eventually test that assumption.