Text Tokenizer
Loading tokenizer...
Toggle Dark/Light Mode
Select Model:
GPT-5 & O1/O3 o-series (o200k_base)
GPT-4 (cl100k_base)
GPT-3.5, GPT-3.5-Turbo (cl100k_base)
GPT-3 Legacy Davinci / Codex (p50k_base)
Ada, Babbage, Curie, Davinci (r50k_base)
GPT-2 (gpt2)
Input Text:
Token count:
0
Tokenized Result (Colored):
Copy
Token Array (IDs):
Copy
Model → Encoding Map
Order by Model