LLMModelHandle

class baseten.client.managementapi.LLMModelHandle(*, model_id, version_id, hostname, instance_type_name=None)

Bases: BaseModel

Parameters:
  • model_id (str)

  • version_id (str)

  • hostname (str)

  • instance_type_name (str | None)

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].