CreateSamplingServerRequest

class baseten.client.managementapi.CreateSamplingServerRequest(*, model, max_seq_length=None, checkpoint_path=None)

Bases: BaseModel

Parameters:

• model (str)

• max_seq_length (int | None)

• checkpoint_path (str | None)

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].