LLMModelHandle¶

class baseten.client.managementapi.LLMModelHandle(*, model_id, version_id, hostname, instance_type_name=None)¶

Parameters:

model_id (Annotated[str, FieldInfo(annotation=NoneType, required=True, title='Model Id', description='Unique identifier of the model')])
version_id (Annotated[str, FieldInfo(annotation=NoneType, required=True, title='Version Id', description='Unique identifier of the model version')])
hostname (Annotated[str, FieldInfo(annotation=NoneType, required=True, title='Hostname', description='Hostname used to invoke the model')])
instance_type_name (Annotated[str | None, FieldInfo(annotation=NoneType, required=True, title='Instance Type Name', description='Name of the instance type the model deployment is running on')])

model_config = {}¶: Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].