klyn.math.nn.activations.ReLU.differentiate
method
public override differentiate(inputs as NDArray<T>, upstream as NDArray<T>) as LayerGradients<T>
Description

Computes input derivatives; there are no parameter derivatives.

Parameters
ParameterDescription
inputsOriginal pre-activation tensor.
upstreamSame-shaped output derivative.
Returns

Derivative bundle for sequential composition.

Example

gradients = activation.differentiate(inputs, upstream)