Skip to main content

AI_LLM_RPM_WINDOW_SECS

Constant AI_LLM_RPM_WINDOW_SECS 

Source
pub const AI_LLM_RPM_WINDOW_SECS: u64 = 60;
Expand description

RPM sliding window duration for LLM rate limiting (seconds).