← All terms
AI
Tokens
The unit LLMs charge by. Roughly 4 characters of English per token.
Both input and output tokens are billed. Long context windows allow more tokens per request. Caching reduces cost for repeated context. A typical chatbot conversation costs $0.001 to $0.05 depending on model and length.