knuddelsgmbh/jtokkit
A Java library implementing OpenAI's tokenization encodings for counting tokens and encoding text for GPT models.
Not currently ranked — collecting fresh signals.
star history
JTokkit is a Java implementation of OpenAI’s tiktoken tokenizer, supporting encodings like cl100k_base and o200k_base used by GPT-3.5, GPT-4, and GPT-4o. It provides an easy-to-use API for encoding and decoding text, primarily used for counting tokens before sending requests to OpenAI APIs. The library has zero dependencies and targets Java 8+.
Frequently asked
- What is knuddelsgmbh/jtokkit?
- A Java library implementing OpenAI's tokenization encodings for counting tokens and encoding text for GPT models.
- Is jtokkit open source?
- Yes — knuddelsgmbh/jtokkit is open source, released under the MIT license.
- What language is jtokkit written in?
- knuddelsgmbh/jtokkit is primarily written in Java.
- How popular is jtokkit?
- knuddelsgmbh/jtokkit has 740 stars on GitHub.
- Where can I find jtokkit?
- knuddelsgmbh/jtokkit is on GitHub at https://github.com/knuddelsgmbh/jtokkit.