AsyncPredictRequest

class baseten.client.inferenceapi.AsyncPredictRequest(*, model_input, webhook_endpoint=None, priority=0, max_time_in_queue_seconds=600, inference_retry_config=None)

Bases: BaseModel

Parameters:

• model_input (dict[str, Any])

• webhook_endpoint (AnyUrl | None)

• priority (Annotated[int | None, Ge(ge=0), Le(le=2)])

• max_time_in_queue_seconds (Annotated[int | None, Ge(ge=10), Le(le=259200)])

• inference_retry_config (InferenceRetryConfig | None)

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].