@basetenlabs/client - v0.2.0
    Preparing search index...

    Interface Resources

    Compute resources that your model needs, including CPU, memory, and GPU resources.

    interface Resources {
        accelerator?: string | null;
        cpu?: string;
        fabric?: FabricRequirement | null;
        instance_type?: string | null;
        memory?: string;
        node_count?: number | null;
        [k: string]: unknown;
    }

    Indexable

    • [k: string]: unknown
    Index
    accelerator? cpu? fabric? instance_type? memory? node_count?
    accelerator?: string | null

    The GPU type for your instance. To request multiple GPUs, use the ':' operator (e.g. L4:4).

    cpu?: string

    CPU resources needed, expressed as either a raw number or millicpus. For example, 500m is half of a CPU core.

    fabric?: FabricRequirement | null

    Network fabric requirements for this deployment.

    instance_type?: string | null

    The full SKU name for the instance type. When specified, cpu, memory, and accelerator fields are ignored.

    memory?: string

    CPU RAM needed, expressed as a number with units. Units include Gi (Gibibytes), G (Gigabytes), Mi (Mebibytes), and M (Megabytes).

    node_count?: number | null

    Number of nodes for multi-node deployments.

    Settings
    Member Visibility

    On This Page
    Properties