Interface DeploymentQuantization

interface DeploymentQuantization {
bits: number;
}

Index

Properties

Properties

bits

bits: number

The number of bits each model parameter should be quantized to. The quantization method is chosen based on this value.