Overview > klyn.math.nn.quantization > QuantizationOptions > QuantizationOptions
Version 0.2.1 Overview Index Tree Deprecated
klyn.math.nn.quantization.QuantizationOptions.QuantizationOptions
constructor
public QuantizationOptions(groupSize as Long = 128l, bufferBytes as Long = 1048576l, verbose as Boolean = true)
Description

Configures Q8 grouping and the bounded-memory conversion pipeline.

Parameters
ParameterDescription
groupSizePower of two in 16..4096; no group crosses a matrix row.
bufferBytesSource block capacity in 64 KiB..64 MiB.
verboseShow conversion progress on standard error.
Throws
  • ValueException for an invalid group size or buffer budget.
Example

options = QuantizationOptions(bufferBytes=1048576l)