rkcosmos/deepcut
Thai word tokenization library using a CNN to predict word boundaries by classifying whether characters are word beginnings.
Not currently ranked — collecting fresh signals.
star history
Deepcut is a deep learning-based tokenization library for Thai text. It uses a convolutional neural network trained on the NECTEC BEST corpus to perform binary classification on characters, predicting whether each character marks the beginning of a word. The library provides Python installation via pip, Docker support, and even a JavaScript port (DeepcutJS) for browser-based tokenization. It achieved 98.1% F1 on the test set.
Frequently asked
- What is rkcosmos/deepcut?
- Thai word tokenization library using a CNN to predict word boundaries by classifying whether characters are word beginnings.
- Is deepcut open source?
- Yes — rkcosmos/deepcut is open source, released under the MIT license.
- What language is deepcut written in?
- rkcosmos/deepcut is primarily written in Python.
- How popular is deepcut?
- rkcosmos/deepcut has 429 stars on GitHub.
- Where can I find deepcut?
- rkcosmos/deepcut is on GitHub at https://github.com/rkcosmos/deepcut.