A token is a unit of text used by language models, often a word fragment, character, or symbol. Context length and cost are measured in tokens.
Open the related AI concept, tools, and learning paths.