← all repositories

dqbd/tiktokenizer

A web-based playground for calculating token counts using OpenAI's tiktoken library.

1.6k stars TypeScript LLMOps · EvalOther AI
tiktokenizer
Velocity · 7d
+1.4
★ / day
Trend
steady
star history

Tiktokenizer is an online tool that lets users compute the exact number of tokens for a given text prompt using OpenAI’s tiktoken tokenizer library. Built with the T3 Stack and shadcn/ui, it provides a visual interface to test different encodings and understand tokenization costs for LLM applications.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.