Use the following keys to configure backend limits and the percentage at which a trigger is set when consumption is reached.
1
tokenConsumptionLimit
This key sets the total tokens limit for the AI service.
2
tokenConsumptionTrigger
This key sets the percentage value of the tokenConsumptionLimit. When the configured percentage of the total token limit is breached, a trigger value will be set to true in the API response.
