GPT-2
R50k · byte-level BPE
Idle
Browser utility / tokenizer comparison
Paste a skill file, prompt, or code block. The same text is counted with each tokenizer in a separate worker, entirely in your browser.
Supported tokenizer definitions are fetched from Hugging Face on first use. Your text is sent only to the local Web Workers.
R50k · byte-level BPE
SentencePiece BPE
o200k · byte-level BPE
Qwen 2 · byte-level BPE
OLMo 2 · byte-level BPE