Skip to main content

count_tiktoken_batch

Function count_tiktoken_batch 

Source
pub fn count_tiktoken_batch(
    encoding: &str,
    values: &[String],
) -> Result<Vec<usize>, CoreError>
Expand description

Count an OpenAI-compatible encoding in parallel without entering Python.