Runtime

class baseten.client.modelconfig.Runtime(*, predict_concurrency=1, streaming_read_timeout=60, enable_tracing_data=False, enable_debug_logs=False, transport=None, is_websocket_endpoint=None, health_checks=None, remote_ssh=None, truss_server_version_override=None, **extra_data)

Bases: BaseModel

Parameters:

• predict_concurrency (int | None)

• streaming_read_timeout (int | None)

• enable_tracing_data (bool | None)

• enable_debug_logs (bool | None)

• transport (HTTPOptions | WebsocketOptions | GRPCOptions | None)

• is_websocket_endpoint (bool | None)

• health_checks (HealthChecks | None)

• remote_ssh (RemoteSSH | None)

• truss_server_version_override (str | None)

• extra_data (Any)

model_config = {'extra': 'allow'}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].