Skip to content

Add routing and agent-context experiment baseline - #52

Merged
triggeredcode merged 1 commit into
mainfrom
feat/routing-context-experiment
Oct 20, 2026
Merged

triggeredcode merged 1 commit into
mainfrom
feat/routing-context-experiment

Conversation

@triggeredcode

Copy link
Copy Markdown
Owner

Summary

  • add an offline, candidate-neutral routing and context experiment harness
  • freeze development, calibration, and holdout cases by intent family
  • record safety, routing latency, target recall, unrelated selection, and context reduction
  • write local JSON and Markdown reports without changing Lucid runtime behavior

Baseline result

  • current explicit-state routing: 34/34, zero high-confidence wrong direct actions, sub-millisecond p95
  • current targeted context: 100% required-target recall and about 82% reduction on eligible large documents
  • three small structured-page cases over-select neighbouring components, so the baseline does not pass the adoption gate yet

Validation

  • typecheck
  • lint
  • formatting
  • eval package: 52 passed
  • full unit suite: 1,525 passed, 22 skipped
  • import-impact diagnostics: clean

Closes #51

@triggeredcode
triggeredcode merged commit 8a74e0d into main Oct 20, 2026
4 checks passed
@triggeredcode
triggeredcode deleted the feat/routing-context-experiment branch October 20, 2026 05:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Build an offline routing and agent-context experiment harness

1 participant