How Many Tokens Is a Word? Counting AI Tokens

Counting Tokens

Token counts are not the same as word counts. Common English words are often a single token, while rare words, names, code, and many non-English languages can take several tokens each.

Using the rough rule of about 0.75 words per token, a 1,500-word article is around 2,000 tokens.

You do not need exact numbers. A quick estimate is enough to tell whether a document will fit and how much a request might cost.