Skip to main content

AI_TOKENS_TO_CHARS_RATIO

Constant AI_TOKENS_TO_CHARS_RATIO 

Source
pub const AI_TOKENS_TO_CHARS_RATIO: f64 = 3.5;
Expand description

Approximate characters-per-token ratio for LLM token budget estimation. Used to convert available token budget into a character limit for content truncation.