Using the API
Rate Limits
Like most other LLM API providers, we have 2 sets of rate limits to prevent abuse and manage our capacity.
- Spend limits: We limit the max amount of money you can spend in a month.
- Usage limits: We limit the number of requests you can make within a time window.
Spend Limits
Spend limits are set per organization per month. We are working on adding support
for setting spend limits automatically from the developer console but for now,
you can contact us at support@thesys.dev
to set a spend limit for your organization.
Billing is done on a monthly basis or a cumulative monthly spend of $100, whichever comes first.
Usage Limits
- Usage limits are also set per organization irrespective of the number of API key used.
- Limits are enforced at both
ITPM
(Input Tokens Per Minute) andOTPM
(Output Tokens Per Minute) - If you hit the rate limit, you will receive a 429 error.
If you need higher limits, please contact us at support@thesys.dev