EmbeddingBenchmarkMetrics

class baseten.client.managementapi.EmbeddingBenchmarkMetrics(*, e2e_latency_ms_p50=None, e2e_latency_ms_p99=None, input_tokens_per_sec=None, requests_per_sec=None)

Bases: BaseModel

Parameters:

• e2e_latency_ms_p50 (float | None)

• e2e_latency_ms_p99 (float | None)

• input_tokens_per_sec (float | None)

• requests_per_sec (float | None)

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].