Overview > klyn.math.nn.activations > ReLU > backward
Version 0.2.2 Overview Index Tree Deprecated
klyn.math.nn.activations.ReLU.backward
method
public backward(inputs as NDArray<T>, upstream as NDArray<T>) as NDArray<T>
Description

Propagates an upstream derivative through the activation.

Parameters
ParameterDescription
inputsUnmodified pre-activation tensor used in forward.
upstreamGradient with the same shape.
Returns

Independent input gradient, zero where inputs are non-positive.

Throws
  • ValueException if either shape is invalid or they differ.
Example

dx = activation.backward(preactivation, upstream)