klyn.math.nn.activations.Softmax.differentiate
method
public override differentiate(inputs as NDArray<T>, upstream as NDArray<T>) as LayerGradients<T>
Description

Computes a Jacobian-vector product without materializing a Jacobian.

Parameters
ParameterDescription
inputsOriginal logits.
upstreamSame-shaped derivative of the probabilities.
Returns

Input derivatives and no parameter derivatives.

Throws
  • ValueException if shapes disagree.
Example

dx = activation.differentiate(logits, upstream).inputs