File tree Expand file tree Collapse file tree 2 files changed +4
-2
lines changed
Expand file tree Collapse file tree 2 files changed +4
-2
lines changed Original file line number Diff line number Diff line change @@ -43,11 +43,11 @@ inputs:
4343 required : false
4444 default : ' '
4545 max-tokens :
46- description : The maximum tokens to generate (deprecated)
46+ description : The maximum number of tokens to generate (deprecated)
4747 required : false
4848 default : ' 200'
4949 max-completion-tokens :
50- description : The maximum tokens to generate
50+ description : The maximum number of tokens to generate
5151 required : false
5252 default : ' '
5353 temperature :
Original file line number Diff line number Diff line change @@ -34,6 +34,8 @@ export interface InferenceResponse {
3434 } >
3535}
3636
37+ // Note: solution around models using different underlying max tokens properties
38+
3739/**
3840 * Build according to what input was passed, default to max_tokens.
3941 * Only one of max_tokens or max_completion_tokens will be set.
You can’t perform that action at this time.
0 commit comments