CreateLoopsSamplerRequest¶
- class baseten.client.managementapi.CreateLoopsSamplerRequest(*, availability_model=None, session_id, base_model=None, run_id=None, max_seq_length=None, model_path=None, reuse_from_session_id=None, num_replicas=None, scope='default')¶
Bases:
BaseModel- Parameters:
availability_model (Literal['standard', 'spot'] | str | None)
session_id (str)
base_model (str | None)
run_id (str | None)
max_seq_length (int | None)
model_path (str | None)
reuse_from_session_id (str | None)
num_replicas (NumReplicas | None)
scope (Literal['default', 'serverless', 'dedicated'] | str)
- model_config = {}¶
Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].