Like most other LLM API providers, we have 2 sets of rate limits to prevent abuse and manage our capacity.
  • Spend limits: We limit the max amount of money you can spend in a month.
  • Usage limits: We limit the number of requests you can make within a time window.

​
Spend Limits

Spend limits are set per organization per month. We are working on adding support for setting spend limits automatically from the developer console but for now, you can contact us at support@thesys.dev to set a spend limit for your organization. Billing is done on a monthly basis or a cumulative monthly spend of $100, whichever comes first.

​
Usage Limits

  • Usage limits are also set per organization irrespective of the number of API key used.
  • Limits are enforced at both ITPM (Input Tokens Per Minute) and OTPM (Output Tokens Per Minute)
  • If you hit the rate limit, you will receive a 429 error.
If you need higher limits, please contact us at support@thesys.dev