InferenceClientOptions

class baseten.client.InferenceClientOptions(api_key, headers=None, model_id=None, chain_id=None, environment=None, base_url_override=None)

Bases: object

Options for InferenceClient and AsyncInferenceClient.

Obtain via InferenceClient.options to inspect the values a client was constructed with.

Parameters:

• api_key (str)

• headers (Mapping[str, str] | None)

• model_id (str | None)

• chain_id (str | None)

• environment (str | None)

• base_url_override (str | None)

api_key: str

API key for authentication.

property base_url: str

The resolved base URL for the inference API.

base_url_override: str | None = None

Explicit base URL override. When set, model_id, chain_id, and environment are ignored.

chain_id: str | None = None

Chain ID. Mutually exclusive with model_id.

environment: str | None = None

Environment name for regional routing (e.g. "production"). Affects the base URL hostname.

headers: Mapping[str, str] | None = None

Additional headers to send on every request.

model_id: str | None = None

Model ID. Mutually exclusive with chain_id.