ModelTRTLLMLoraConfiguration

class baseten.client.modelconfig.ModelTRTLLMLoraConfiguration(*, max_lora_rank=64, lora_target_modules=[], **extra_data)

Bases: BaseModel

Parameters:

• max_lora_rank (int | None)

• lora_target_modules (list[str] | None)

• extra_data (Any)

model_config = {'extra': 'allow'}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].