dqbd/tiktokenizer
A web-based playground for calculating token counts using OpenAI's tiktoken library.

Velocity · 7d
+1.4
★ / day
Trend
→steady
star history
Tiktokenizer is an online tool that lets users compute the exact number of tokens for a given text prompt using OpenAI’s tiktoken tokenizer library. Built with the T3 Stack and shadcn/ui, it provides a visual interface to test different encodings and understand tokenization costs for LLM applications.