CreateLoopsSamplerRequest

class baseten.client.managementapi.CreateLoopsSamplerRequest(*, availability_model=None, session_id, base_model=None, run_id=None, max_seq_length=None, model_path=None, reuse_from_session_id=None, num_replicas=None, scope='default')

Bases: BaseModel

Parameters:
  • availability_model (Literal['standard', 'spot'] | str | None)

  • session_id (str)

  • base_model (str | None)

  • run_id (str | None)

  • max_seq_length (int | None)

  • model_path (str | None)

  • reuse_from_session_id (str | None)

  • num_replicas (NumReplicas | None)

  • scope (Literal['default', 'serverless', 'dedicated'] | str)

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].