dqbd/tiktokenizer
A web-based playground for calculating token counts using OpenAI's tiktoken library.
Not currently ranked — collecting fresh signals.
star history
Tiktokenizer is an online tool that lets users compute the exact number of tokens for a given text prompt using OpenAI’s tiktoken tokenizer library. Built with the T3 Stack and shadcn/ui, it provides a visual interface to test different encodings and understand tokenization costs for LLM applications.
Frequently asked
- What is dqbd/tiktokenizer?
- A web-based playground for calculating token counts using OpenAI's tiktoken library.
- Is tiktokenizer open source?
- Yes — dqbd/tiktokenizer is open source, released under the MIT license.
- What language is tiktokenizer written in?
- dqbd/tiktokenizer is primarily written in TypeScript.
- How popular is tiktokenizer?
- dqbd/tiktokenizer has 1.6k stars on GitHub.
- Where can I find tiktokenizer?
- dqbd/tiktokenizer is on GitHub at https://github.com/dqbd/tiktokenizer.