gotokenizer

github.comtool

A tokenizer based on the dictionary and Bigram language models for Golang. (Now only support chinese segmentation)

from

Go

added

2026-10-10

likes

0

Go › Natural Language Processing > Tokenizers: “A tokenizer based on the dictionary and Bigram language models for Golang. (Now only support chinese segmentation)”