You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Evaluate focused agent context against the v0.4 baseline #53
Test whether a stricter agent-read context strategy fixes the three small-page over-selection failures found by the offline baseline while preserving target recall and large-document savings.
Scope
Add an experiment-only context strategy interface.
Keep the current full-outline and targeted-planner measurements unchanged.
Add a focused candidate that uses explicit block/component targets, ambiguity, missing refs, and bounded neighbours without automatically expanding the entire section.
Report candidates side by side against the same frozen cases and gates.
Guardrails
No product-context change and no public MCP API change in this issue. Promote the strategy only after the experiment shows equal target recall, zero forbidden selections, and useful context reduction.
Implemented and validated in PR #54. The focused experiment-only strategy improves context cases from 5/8 to 8/8, keeps required-target recall at 100%, removes all 3 forbidden selections, and reduces median overall context by 47.3%. No product runtime path changes in this slice.
Activity
triggeredcode commentedon Oct 20, 2026
Implemented and validated in PR #54. The focused experiment-only strategy improves context cases from 5/8 to 8/8, keeps required-target recall at 100%, removes all 3 forbidden selections, and reduces median overall context by 47.3%. No product runtime path changes in this slice.
feat(evals): evaluate focused agent context (#53) (#54)