Repository navigation
fix: require evidence-backed confidence words in claims - #262
Merged
Merged
Conversation
Every claim about cause, measurement, completion, or safety now carries one word: ran, cited, inferred, or guess, and ran/cited require named evidence. The ship evidence block and scout report guidance state the rule, and AGENTS.md section 9 states it for captain-facing messages. No gate or behaviour change.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Intent
Stop overstated claims with two small text additions in Firstmate's existing owners.
(1) A claim about cause, measurement, completion, or safety carries one confidence word: ran (observed directly: command output, test run, live check), cited (backed by a named file:line, log, or artifact), inferred (reasoned from evidence, not observed), or guess.
(2) A claim may be labelled ran or cited only when the evidence is named next to it; otherwise it is inferred or guess.
Where: (a) the crewmate brief scaffold's acceptance-evidence guidance in bin/fm-brief.sh, so every new ship and scout worker sees it; (b) AGENTS.md section 9 (captain-facing etiquette), one or two sentences, preserving the talk-in-outcomes rule so the words read naturally to the captain, not as jargon; keep AGENTS.md concise per its Maintaining-this-file rules; update only a doc that would otherwise go stale describing the brief text.
Constraints: no new script, gate, checker change, or behaviour change; do not build the rest of data/fm-pstack-bigger-wins/report.md R3; no other files.
Acceptance criteria: AC1 a freshly scaffolded ship brief (--mode no-mistakes) and scout brief (--scout) both contain the four confidence words and the citation rule in their evidence/report guidance, proven by running the scaffold; AC2 AGENTS.md section 9 states the confidence-word and citation rule in at most three sentences without adding internal jargon, proven by the diff; AC3 no new script, gate, check, or behaviour, and the receipt checker, PR check, and all existing tests are unchanged and pass, with the diff touching only bin/fm-brief.sh text, AGENTS.md, and any doc describing the brief text.
Firstmate decision [key=ac3-test-env]: 10 affected suites fail identically on unmodified main commit 338a7ac for environment reasons (missing grok/kimi/pi/omp harnesses, Bun stringWidth version, /tmp fixture ownership), not because of this diff; AC3 is judged from the PR's green CI lanes where those harnesses exist, and the AC3 success receipt is re-recorded from that result.
What Changed
ran,cited,inferred, orguess, with evidence named beside anyranorcitedclaim.AGENTS.md, preserving plain-English outcome reporting.Risk Assessment
✅ Low: The change adds concise guidance to the two required owners, reuses the scaffold text for ship and scout output, and leaves gates, checkers, and tests unchanged.
Testing
Live ship and scout scaffolding, overwrite guards, and focused receipt-check tests passed. An initial missing disposable data directory was corrected before re-driving. Generated Markdown provides the visible evidence; no GUI changed. Broad regression and CI remain with the outer executor under the recorded AC3 decision.
Evidence: Live scaffold commands, generated guidance, and overwrite refusals
Evidence: Generated ship brief
Evidence: Generated scout brief
Pipeline
Updates from git push no-mistakes
✅ **intent** - passed
✅ No issues found.
✅ **Rebase** - passed
✅ No issues found.
✅ **Review** - passed
✅ No issues found.
✅ **Test** - passed
✅ No issues found.
Ranbash bin/fm-brief.sh ship-confidence disposable-project --mode no-mistakeswith an isolated workspace-local FM_HOME and inspected the generated output contract.Ranbash bin/fm-brief.sh scout-confidence disposable-project --scoutwith the same isolated FM_HOME and inspected the generated output contract.Repeated both scaffold commands and verified nonzero exits with byte-for-byte preservation of existing briefs.Ranbash tests/fm-receipt-check.test.sh; exited 0.Reviewed the base-to-target diff: only AGENTS.md and bin/fm-brief.sh changed; section 9 adds two sentences and preserves the outcomes rule.Removed the disposable home and confirmed a clean working tree.✅ **Document** - passed
✅ No issues found.
✅ **Lint** - passed
✅ No issues found.
✅ **Push** - passed
✅ No issues found.