Type Alias CreateDeploymentRequest

CreateDeploymentRequest: {
    acceptEula?: boolean;
    endpoints: Inference.v1.EndpointSpec[];
    maxSize?: number;
    minSize?: number;
    modelId: string;
    name?: string;
    nodeTypeName: string;
    projectId?: string;
    quantization?: Inference.v1.DeploymentQuantization;
    region?: Region;
    tags?: string[];
}

Type declaration

  • OptionalacceptEula?: boolean

    If the model has an EULA, you must accept it before proceeding. The terms of the EULA can be retrieved using the GetModelEula API call.

  • endpoints: Inference.v1.EndpointSpec[]

    List of endpoints to create.

  • OptionalmaxSize?: number

    Defines the maximum size of the pool.

  • OptionalminSize?: number

    Defines the minimum size of the pool.

  • modelId: string

    ID of the model to use.

  • Optionalname?: string

    Name of the deployment.

  • nodeTypeName: string

    Name of the node type to use.

  • OptionalprojectId?: string

    ID of the Project to create the deployment in.

  • Optionalquantization?: Inference.v1.DeploymentQuantization

    Quantization settings to apply to this deployment.

  • Optionalregion?: Region

    Region to target. If none is passed will use default region from the config.

  • Optionaltags?: string[]

    List of tags to apply to the deployment.

Settings