TRTLLMConfiguration

class baseten.client.modelconfig.TRTLLMConfiguration(root=PydanticUndefined)

Bases: RootModel[Union[TRTLLMConfigurationV1, TRTLLMConfigurationV2]]

Parameters:

root (RootModelRootType)

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].