klyn.math.nn.quantization.DeviceQuantizedMatrix.multiply
method
public multiply(inputs as NDArray<Float>) as NDArray<Float>
Description

Computes [batch, columns] times the packed weight transpose on its device.

Parameters
ParameterDescription
inputsFloat matrix.
Returns

Float matrix [batch, rows], with FP32 accumulation.

Throws
  • ValueException for invalid shapes, device failures or a closed matrix.
Example

output = matrix.multiply(NDArray<Float>.ones([1l, matrix.columns]))