ModelAPIRateLimit

class baseten.client.managementapi.ModelAPIRateLimit(*, type, unit, threshold, is_pooled, service_tier, baseline_threshold)

Bases: BaseModel

Parameters:

• type (Literal['REQUEST', 'TOKEN', 'CONCURRENT_REQUEST', 'UNCACHED_INPUT_TOKEN', 'OUTPUT_TOKEN'] | str)

• unit (Literal['SECOND', 'MINUTE'] | str)

• threshold (Annotated[int, Ge(ge=0)])

• is_pooled (bool)

• service_tier (Literal['DEFAULT', 'FLEX', 'PRIORITY'] | str)

• baseline_threshold (Annotated[int, Ge(ge=0)])

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].