Backend Configurations
To set the backend limit on total token consumption and percentage it to send trigger is configured through these keys:
tokenConsumptionLimit - This is the key against which the total tokens for the AI service is set.
tokenConsumptionTrigger - This is the key against which the percentage value of the above key is set. When that percentage consumption is breached, a trigger will be set to true in the API response.
Last updated