InferenceRetryConfig

class baseten.client.inferenceapi.InferenceRetryConfig(*, max_attempts=3, initial_delay_ms=1000, max_delay_ms=5000)

Bases: BaseModel

Parameters:

• max_attempts (Annotated[int | None, Ge(ge=1), Le(le=10)])

• initial_delay_ms (Annotated[int | None, Ge(ge=0), Le(le=10000)])

• max_delay_ms (Annotated[int | None, Ge(ge=0), Le(le=60000)])

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].