Repository navigation
Opt-in hover strip for the model each assistant reply used #25135
thehiddenlotus
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
After a thread uses more than one model, the composer footer only shows what will send next. Old assistant replies do not say which model, Fast, or Effort they ran with, or what that reply cost. Mixed-provider threads become hard to audit.
#2601 tried to solve a related need with an always-visible stats footer plus persist, tok/sec, and TTFT. That was an XL and got closed. I do not want that PR. I want the small part: provenance on the existing hover row.
Proposed scope, one problem:
##is stored parent uncached input plus output, omitted when missingOut of this request: writing usage at persist time, resolving Auto to the routed model, provider color on
#, showing the hover row while a reply is still streaming.I have a local implementation of that slice and can open a PR if this scope is acceptable.
Please reply with an explicit yes on this direction and scope if you want it. CONTRIBUTING asks for that comment before a feature PR.
All reactions