Token

When you type into an AI, your words are broken down into small pieces called tokens. A token can be a whole word, part of a word, or even punctuation. For example, the phrase 'AI tools' might become two tokens: 'AI' and 'tools'. Understanding tokens helps you realize that the AI 'sees' your input in these small chunks, which can influence how much information it processes at once and how much it 'costs' to generate a response.