go-ego/gse
A Go implementation of jieba text segmentation using HMM and Viterbi algorithm for English, Chinese, and Japanese.

Velocity · 7d
+0.9
★ / day
Trend
→steady
star history
Gse is a Go library for multilingual natural language processing and text segmentation, implementing the jieba algorithm with Hidden Markov Model and Viterbi algorithm for word boundary detection. It uses a trie data structure for efficient dictionary lookup and supports English, Chinese, and Japanese tokenization. The library provides integration with search engines like Elasticsearch and Bleve.