@basetenlabs/client - v0.2.0

Preparing search index...

modelconfig
ModelTRTLLMBatchSchedulerPolicy

Type Alias ModelTRTLLMBatchSchedulerPolicy

ModelTRTLLMBatchSchedulerPolicy: "max_utilization" | "guaranteed_no_evict"

Defined in packages/client/src/modelconfig/models.gen.d.ts:85

Settings

Member Visibility

Protected
Inherited
External

Theme

@basetenlabs/client - v0.2.0

Loading...

Generated using TypeDoc