TokenLimits Interface
Maximum limits for the total tokens that can be used by an llm
This API is provided as an alpha preview and may change without notice.
To use, import via @fluidframework/ai-collab/alpha.
For more information about our API support guarantees, see here.
Signature
export interface TokenLimits
Properties
| Property | Alerts | Modifiers | Type | Description |
|---|---|---|---|---|
| inputTokens | Alpha |
optional, readonly |
number | The maximum number of tokens that can be used by the LLM for input. |
| outputTokens | Alpha |
optional, readonly |
number | The maximum number of tokens that can be used by the LLM for output. |
Property Details
inputTokens
The maximum number of tokens that can be used by the LLM for input.
This API is provided as an alpha preview and may change without notice.
To use, import via @fluidframework/ai-collab/alpha.
For more information about our API support guarantees, see here.
Signature
readonly inputTokens?: number;
Type: number
outputTokens
The maximum number of tokens that can be used by the LLM for output.
This API is provided as an alpha preview and may change without notice.
To use, import via @fluidframework/ai-collab/alpha.
For more information about our API support guarantees, see here.
Signature
readonly outputTokens?: number;
Type: number