Skip to content

Evaluate focused agent context against the v0.4 baseline #53

Closed

Description

@triggeredcode

Goal

Test whether a stricter agent-read context strategy fixes the three small-page over-selection failures found by the offline baseline while preserving target recall and large-document savings.

Scope

  • Add an experiment-only context strategy interface.
  • Keep the current full-outline and targeted-planner measurements unchanged.
  • Add a focused candidate that uses explicit block/component targets, ambiguity, missing refs, and bounded neighbours without automatically expanding the entire section.
  • Report candidates side by side against the same frozen cases and gates.

Guardrails

No product-context change and no public MCP API change in this issue. Promote the strategy only after the experiment shows equal target recall, zero forbidden selections, and useful context reduction.

Activity

  1. triggeredcode commented on Oct 20, 2026

    @triggeredcode
    OwnerAuthor

    Implemented and validated in PR #54. The focused experiment-only strategy improves context cases from 5/8 to 8/8, keeps required-target recall at 100%, removes all 3 forbidden selections, and reduces median overall context by 47.3%. No product runtime path changes in this slice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions