mindspore.ops.selu

mindspore.ops.selu(input_x)

Activation function SeLU (Scaled exponential Linear Unit).

The activation function is defined as:

$$E_i=scale\ast \{\begin{array}{ll}{x}_i,& \text{if }{x}_i\ge 0;\\ \text{alpha}\ast (\exp (x_i)-1),& \text{otherwise.}\end{array}$$

where $alpha$ and $scale$ are pre-defined constants($alpha=1.67326324$ and $scale=1.05070098$).

See more details in Self-Normalizing Neural Networks.

SeLU Activation Function Graph:

Parameters

input_x (Tensor) – Tensor of any dimension, the data type is int8, int32, float16, float32, or float64 (CPU, GPU only).

Returns

Tensor, with the same type and shape as the input_x.

Raises

TypeError – If dtype of input_x is not int8, int32, float16, float32, or float64.

Supported Platforms:

Ascend GPU CPU

Examples

>>> import mindspore
>>> import numpy as np
>>> from mindspore import Tensor, ops
>>> input_x = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
>>> output = ops.selu(input_x)
>>> print(output)
[[-1.1113307 4.202804 -1.7575096]
[ 2.101402 -1.7462534 9.456309 ]]