Skip to content

API Reference

baseten.client

ModelTRTLLMBatchSchedulerPolicy¶

class baseten.client.modelconfig.ModelTRTLLMBatchSchedulerPolicy(*values)¶: Bases: Enum

Copyright ©

Made with Sphinx and @pradyunsg's Furo

On this page

ModelTRTLLMBatchSchedulerPolicy
- ModelTRTLLMBatchSchedulerPolicy