mirth/chonky
A Python library that segments text into semantic chunks using a fine-tuned transformer model for RAG pipelines.
Not currently ranked — collecting fresh signals.
star history
Chonky provides intelligent text segmentation into meaningful semantic chunks via a neural approach. It uses a fine-tuned transformer model to determine natural paragraph boundaries, replacing heuristic text-splitting approaches in RAG pipelines. The library offers a simple ParagraphSplitter API that accepts text and yields coherent text chunks optimized for retrieval-augmented generation systems.
Frequently asked
- What is mirth/chonky?
- A Python library that segments text into semantic chunks using a fine-tuned transformer model for RAG pipelines.
- Is chonky open source?
- Yes — mirth/chonky is open source, released under the MIT license.
- What language is chonky written in?
- mirth/chonky is primarily written in Python.
- How popular is chonky?
- mirth/chonky has 416 stars on GitHub.
- Where can I find chonky?
- mirth/chonky is on GitHub at https://github.com/mirth/chonky.