baseten.client.modelconfig
==========================

.. automodule:: baseten.client.modelconfig
   :no-members:

   
   
   .. rubric:: Classes

   .. autosummary::
      :nosignatures:
   
      AcceleratorSpec
      AdditionalAutoscalingConfig
      AutoscalingMetric
      BISLLM
      BaseImage
      Build
      CacheInternal
      CheckpointList
      CheckpointRepository
      CheckpointSource
      DockerAuthSettings
      DockerAuthType
      DockerServer
      ExternalData
      ExternalDataItem
      GRPCOptions
      HTTPOptions
      HealthChecks
      KvCacheHostMemoryBytes
      LookaheadNgramSize
      LookaheadVerificationSetSize
      LookaheadWindowsSize
      MaxSeqLen
      ModelCache
      ModelConfig
      ModelMetadata
      ModelRepo
      ModelRepoCacheInternal
      ModelRepoSourceKind
      ModelServer
      ModelSpecDecMode
      ModelSpeculatorConfiguration
      ModelTRTLLMBatchSchedulerPolicy
      ModelTRTLLMBuildConfiguration
      ModelTRTLLMLoraConfiguration
      ModelTRTLLMModel
      ModelTRTLLMPluginConfiguration
      ModelTRTLLMQuantizationType
      ModelTRTLLMRuntimeConfiguration
      ModelTRTQuantizationConfiguration
      NodeCount
      NumBuilderGpus
      NumDraftTokens
      RemoteSSH
      RequestDefaultMaxTokens
      Resources
      Runtime
      TRTLLMConfiguration
      TRTLLMConfigurationV1
      TRTLLMConfigurationV2
      TRTLLMRuntimeConfigurationV2
      TrainingArtifactReference
      VersionsOverrides
      VolumeFolder
      WebserverDefaultRoute
      WebsocketOptions
      Weights
      WeightsAuth
      WeightsAuthMethod
      WeightsSource
   
   

   
   
   


.. toctree::
   :hidden:

   baseten.client.modelconfig.ModelConfig