Multilingual LLMs · the token tax

Same sentence. Different bill.

AI models bill per token, not per word. The same message needs a different number of tokens depending on its language, and you pay for every one of them.

Sentence

Tokens for the same message

Hover a column to compare ChatGPT, Claude and Gemini

0 
0 
0 
0 
EnglishEnglish
GermanDeutsch
Nepaliनेपाली
Your textany language

How the tokenizer cuts it

Each shaded box is one token

English
German
Nepali