TRTLLMConfigurationV1

class baseten.client.modelconfig.TRTLLMConfigurationV1(*, build, inference_stack='v1', runtime=<factory>, version_overrides=<factory>, **extra_data)

Bases: BaseModel

Parameters:

• build (ModelTRTLLMBuildConfiguration)

• inference_stack (Literal['v1'])

• runtime (ModelTRTLLMRuntimeConfiguration | None)

• version_overrides (VersionsOverrides | None)

• extra_data (Any)

model_config = {'extra': 'allow'}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].