TRTLLMConfigurationV2

class baseten.client.modelconfig.TRTLLMConfigurationV2(*, inference_stack='v2', build, runtime, version_overrides=<factory>, **extra_data)

Bases: BaseModel

Parameters:

• inference_stack (Literal['v2'])

• build (ModelTRTLLMBuildConfiguration)

• runtime (TRTLLMRuntimeConfigurationV2)

• version_overrides (VersionsOverrides | None)

• extra_data (Any)

model_config = {'extra': 'allow'}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].