zurawiki/tiktoken-rs

github.comtool

[tiktoken-rs] - Library for tokenizing text with OpenAI models using tiktoken.

from

Rust

added

2026-10-10

likes

0

Rust › Libraries > Artificial Intelligence > OpenAI: “[tiktoken-rs] - Library for tokenizing text with OpenAI models using tiktoken.”