Backend Configurations

Use the following keys to configure backend limits and the percentage at which a trigger is set when consumption is reached.

1

tokenConsumptionLimit

This key sets the total tokens limit for the AI service.

2

tokenConsumptionTrigger

This key sets the percentage value of the tokenConsumptionLimit. When the configured percentage of the total token limit is breached, a trigger value will be set to true in the API response.