baseten.client.modelconfig¶

Generated models for the Baseten model config (truss config.yaml).

Types in this module are generated from the Truss config JSON schema and are NOT covered by any stability or compatibility guarantees. They may change without notice between versions.

Classes

`AcceleratorSpec`
`AdditionalAutoscalingConfig`
`AutoscalingMetric`
`BISLLM`
`BaseImage`
`Build`
`CacheInternal`
`CheckpointList`
`CheckpointRepository`
`CheckpointSource`
`DockerAuthSettings`
`DockerAuthType`
`DockerServer`
`ExternalData`
`ExternalDataItem`
`GRPCOptions`
`HTTPOptions`
`HealthChecks`
`KvCacheHostMemoryBytes`
`LookaheadNgramSize`
`LookaheadVerificationSetSize`
`LookaheadWindowsSize`
`MaxSeqLen`
`ModelCache`
`ModelConfig`
`ModelMetadata`
`ModelRepo`
`ModelRepoCacheInternal`
`ModelRepoSourceKind`
`ModelServer`
`ModelSpecDecMode`
`ModelSpeculatorConfiguration`
`ModelTRTLLMBatchSchedulerPolicy`
`ModelTRTLLMBuildConfiguration`
`ModelTRTLLMLoraConfiguration`
`ModelTRTLLMModel`
`ModelTRTLLMPluginConfiguration`
`ModelTRTLLMQuantizationType`
`ModelTRTLLMRuntimeConfiguration`
`ModelTRTQuantizationConfiguration`
`NodeCount`
`NumBuilderGpus`
`NumDraftTokens`
`RemoteSSH`
`RequestDefaultMaxTokens`
`Resources`
`Runtime`
`TRTLLMConfiguration`
`TRTLLMConfigurationV1`
`TRTLLMConfigurationV2`
`TRTLLMRuntimeConfigurationV2`
`TrainingArtifactReference`
`VersionsOverrides`
`VolumeFolder`
`WebserverDefaultRoute`
`WebsocketOptions`
`Weights`
`WeightsAuth`
`WeightsAuthMethod`
`WeightsSource`