Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.thesys.dev/llms.txt

Use this file to discover all available pages before exploring further.

Like most other LLM API providers, we have 2 sets of rate limits to prevent abuse and manage our capacity.
  • Spend limits: We limit the max amount of money you can spend in a month.
  • Usage limits: We limit the number of requests you can make within a time window.

Spend Limits

Spend limits are set per organization per month. We are working on adding support for setting spend limits automatically from the developer console but for now, you can contact us at support@thesys.dev to set a spend limit for your organization. Billing is done on a monthly basis or a cumulative monthly spend of $100, whichever comes first.

Usage Limits

  • Usage limits are also set per organization irrespective of the number of API key used.
  • Limits are enforced at both ITPM (Input Tokens Per Minute) and OTPM (Output Tokens Per Minute)
  • If you hit the rate limit, you will receive a 429 error.
If you need higher limits, please contact us at support@thesys.dev