Tokenization

Splitting text into subword tokens (e.g. via byte-pair encoding) is the model's input representation whose count drives context limits and per-call cost.

grounded in: The subword unit that token-budgeting, agent-token-overhead and kv-cache (all already in the graph) operate on.