Examples with SwishDerivative org.nd4j.linalg.api.ops.impl.transforms.SwishDerivative used on opensource projects

Example 1 with SwishDerivative

use of org.nd4j.linalg.api.ops.impl.transforms.SwishDerivative in project nd4j by deeplearning4j.

the class ActivationSwish method backprop.

@Override
public Pair<INDArray, INDArray> backprop(INDArray in, INDArray epsilon) {
    INDArray dLdz = Nd4j.getExecutioner().execAndReturn(new SwishDerivative(in));
    dLdz.muli(epsilon);
    return new Pair<>(dLdz, null);
}