FAQ ยท Models & APIs
What are tokens and how do they affect cost and performance?
Tokens are the units models process roughly 4 characters or three-quarters of a word in English. API pricing is per-token (input + output). Longer prompts consume more tokens and increase latency. Always profile token usage in production; use streaming to improve perceived latency for long outputs.