When an LLM call fails, our system detects the error and retries the request to prevent failovers.
{ // ...some other Respan params... "retry_params": { "num_retries": 3, "retry_after": 0.1, // seconds, minimum time to wait before retry. "retry_enabled": true } }
Properties