Skip to main content

AI_LLM_DAILY_TOKEN_BUDGET

Constant AI_LLM_DAILY_TOKEN_BUDGET 

Source
pub const AI_LLM_DAILY_TOKEN_BUDGET: u64 = 0;
Expand description

Default daily token budget (input + output). 0 = unlimited. Offline-first default: local LLM servers (llama.cpp, vLLM, Ollama) have no token cost. Set to a non-zero value only for paid cloud APIs (e.g. 100_000 for OpenAI free tier).