tactful_tokenizer

github.comtool

RegExp based tokenizer for different languages.

from

NLP with Ruby

added

2026-10-10

likes

0

NLP with Ruby › NLP Pipeline Subtasks > Segmentation: “RegExp based tokenizer for different languages.”