Lite Operator List

Linux On Device Inference Application Beginner Intermediate Expert

View Source On Gitee

This article lists the operators supported by MindSpore Lite.

Operation
 

CPU
FP16

CPU
FP32

CPU
Int8

CPU
UInt8

GPU
FP16

GPU
FP32

NPU
 

TensorRT
 

TensorFlow Lite
operators supported

Caffe Lite
operators supported

Onnx Lite
operators supported

TensorFlow
operators supported

Abs

✅

✅

✅

✅

✅

✅

✅

Abs

Abs

Abs

Add

✅

✅

✅

✅

✅

✅

✅

✅

Add

Add, Int8Add

Add, AddV2

AddGrad

✅

AddN

✅

✅

AddN

Assert

✅

Assert

Argmax

✅

✅

✅

✅

✅

✅

✅

Argmax

ArgMax

ArgMax

Argmax

Argmin

✅

✅

✅

✅

✅

✅

Argmin

ArgMin

AvgPool

✅

✅

✅

✅

✅

✅

✅

MeanPooling

Pooling

AveragePool,
GlobalAveragePool,
Int8AveragePool

AvgPool

AvgPoolGrad

✅

✅

BatchNorm

✅

✅

✅

✅

✅

✅

BatchNorm

BatchNormalization

BatchNormGrad

✅

✅

BatchToSpace

✅

✅

✅

✅

✅

BatchToSpace,
BatchToSpaceND

BatchToSpace,
BatchToSpaceND

BiasAdd

✅

✅

✅

✅

✅

✅

BiasAdd

BiasAdd

BiasAddGrad

✅

✅

Broadcast

✅

BroadcastTo

Expand

Cast

✅

✅

✅

✅

✅

✅

✅

Cast,
QUANTIZE,
DEQUANTIZE

Cast

Cast

Ceil

✅

✅

✅

✅

✅

✅

✅

Ceil

Ceil

Ceil

Concat

✅

✅

✅

✅

✅

✅

✅

✅

Concat

Concat

Concat

ConcatV2

ConstantOfShape

✅

ConstantOfShape

Conv2d

✅

✅

✅

✅

✅

✅

✅

✅

Conv2D

Convolution

Conv, Int8Conv,
ConvRelu,
Int8ConvRelu

Conv2D

Conv2dGrad

✅

Conv2dTranspose

✅

✅

✅

✅

✅

✅

✅

DeConv2D

Deconvolution

ConvTranspose

Conv2DBackpropInput

Conv2dTransposeGrad

✅

Cos

✅

✅

✅

✅

✅

✅

✅

Cos

Cos

Cos

Crop

✅

✅

✅

✅

Crop

CropAndResize

✅

✅

CropAndResize

CumSum

✅

Cumsum

CustomExtractFeatures

✅

ExtractFeatures

CustomNormalize

✅

Normalize

CustomPredict

✅

Predict

DeDepthwiseConv2D

✅

✅

✅

Deconvolution

DepthToSpace

✅

✅

✅

✅

✅

DepthToSpace

DepthToSpace

DepthwiseConv2dNative

✅

✅

✅

✅

✅

✅

✅

DepthwiseConv2D

Convolution

DepthwiseConv2dNative

DetectionPostProcess

✅

✅

✅

Custom

Div

✅

✅

✅

✅

✅

✅

✅

✅

Div, RealDiv

Div

Div, RealDiv

DivGrad

✅

Eltwise

✅

✅

✅

✅

✅

✅

✅

✅

Eltwise

Sum, Max[3]

Elu

✅

Elu

Elu,
NonMaxSuppression

NonMaxSuppressionV3

EluGrad

✅

Equal

✅

✅

✅

✅

✅

✅

✅

Equal

Equal

Equal

Exp

✅

✅

✅

Exp

Exp

Exp

Exp

ExpandDims

✅

✅

✅

✅

✅

ExpandDims

ExpandDims

Fill

✅

✅

Fill

Fill

Flatten

✅

✅

Flatten

Floor

✅

✅

✅

✅

✅

✅

✅

flOOR

Floor

Floor

FloorDiv

✅

✅

✅

✅

✅

FloorDiv

FloorDiv

FloorMod

✅

✅

✅

✅

✅

FloorMod

FloorMod

FullConnection

✅

✅

✅

✅

✅

✅

✅

FullyConnected

InnerProduct

FusedBatchNorm

✅

✅

✅

✅

✅

FusedBatchNorm

FusedBatchNorm,
FusedBatchNormV3

GatherNd

✅

✅

✅

✅

✅

GatherND

GatherNd

Gather

✅

✅

✅

✅

✅

✅

✅

Gather

Gather

GatherV2

Greater

✅

✅

✅

✅

✅

✅

✅

Greater

Greater

Greater

GreaterEqual

✅

✅

✅

✅

✅

✅

✅

GreaterEqual

GreaterEqual

GRU

✅

✅

HardTanh

✅

✅

HashtableLookup

✅

HashtableLookup

HSigmoid

✅

✅

Hswish

✅

✅

✅

✅

✅

✅

✅

HardSwish

HswishGrad

✅

InstanceNorm

✅

✅

InstanceNorm

InvertPermutation

✅

InvertPermutation

L2Norm

✅

✅

L2_NORMALIZATION

LayerNorm

✅

✅

✅

LeakyReLU

✅

✅

✅

✅

✅

✅

✅

LeakyRelu

LeakyRelu

LeakyRelu

LeakyReLUGrad

✅

Less

✅

✅

✅

✅

✅

✅

✅

Less

Less

Less

LessEqual

✅

✅

✅

✅

✅

✅

✅

LessEqual

LessEqual

LRN

✅

LocalResponseNorm

Lrn, LRN

Log

✅

✅

✅

✅

✅

✅

✅

Log

Log

Log

LogGrad

✅

✅

LogicalAnd

✅

✅

✅

✅

✅

LogicalAnd

And

LogicalAnd

LogicalNot

✅

✅

✅

✅

✅

✅

✅

LogicalNot

Not

LogicalNot

LogicalOr

✅

✅

✅

✅

✅

LogicalOr

Or

LogicalOr

LogSoftmax

✅

✅

✅

✅

✅

LogSoftmax

LogSoftmax

LshProjection

✅

LshProjection

LSTM

✅

✅

LSTM

MatMul

✅

✅

✅

✅

✅

✅

✅

✅

BatchMatMul

MatMul,
Gemm

MatMul,
BatchMatMul

MatMulGrad

✅

Maximum

✅

✅

✅

✅

✅

Maximum

Maximum

MaximumGrad

✅

✅

MaxPool

✅

✅

✅

✅

✅

✅

✅

MaxPooling

Pooling

MaxPool,
GlobalMaxPool

MaxPool

MaxPoolGrad

✅

✅

Merge

✅

✅

Merge

Minimum

✅

✅

✅

✅

✅

Minimum

Min

Minimum

MinimumGrad

✅

✅

Mul

✅

✅

✅

✅

✅

✅

✅

Mul

Mul

Mul

MulGrad

✅

Neg

✅

✅

✅

✅

✅

Neg

Neg

NegGrad

✅

✅

NotEqual

✅

✅

✅

✅

✅

✅

✅

NotEqual

NotEqual

OneHot

✅

✅

✅

OneHot

OneHot

OneHot

Pad

✅

✅

✅

✅

✅

✅

✅

Pad, MirrorPad, PadV2

Pad

MirrorPad, Pad, PadV2

Pow

✅

✅

✅

✅

✅

✅

✅

Pow

Power

Pow[2]

Pow

PowGrad

✅

PReLU

✅

✅

✅

PRELU

PReLU

PRelu

RandomStandardNormal

✅

RandomStandardNormal

RandomUniform

✅

RandomUniform

Range

✅

Range

Range,
RaggedRange

Rank

✅

Rank

Rank

Reciprocal

✅

✅

✅

✅

ReduceAll

✅

All

ReduceASum

✅

✅

✅

Reduction

ReduceMax

✅

✅

✅

✅

✅

✅

ReduceMax

ReduceMax

Max

ReduceMean

✅

✅

✅

✅

✅

✅

✅

Mean

Reduction

ReduceMean

Mean

ReduceMin

✅

✅

✅

✅

✅

ReduceMin

ReduceMin

Min

ReduceProd

✅

✅

✅

✅

✅

ReduceProd

ReduceProd

Prod

ReduceSum

✅

✅

✅

✅

✅

Sum

Reduction

ReduceSum

Sum

ReduceSumSquare

✅

✅

✅

Reduction

ReduceSumSquare

ReLU

✅

✅

✅

✅

✅

✅

✅

✅

Relu

ReLU

Relu

Relu

ReLUGrad

✅

✅

ReLU6

✅

✅

✅

✅

✅

✅

✅

Relu6

ReLU6

Clip[1]

Relu6

ReLU6Grad

✅

✅

Reshape

✅

✅

✅

✅

✅

✅

✅

✅

Reshape

Reshape

Reshape,
Flatten

Reshape

Resize

✅

✅

✅

✅

✅

✅

ResizeBilinear,
NearestNeighbor

Interp

ResizeBilinear,
ResizeBicubic,
ResizeNearestNeighbor

ResizeGrad

✅

✅

Reverse

✅

reverse

ReverseV2

ReverseSequence

✅

ReverseSequence

ReverseSequence

Round

✅

✅

✅

✅

✅

✅

✅

Round

Round

Round

Rsqrt

✅

✅

✅

✅

✅

✅

✅

Rsqrt

Rsqrt

Select

✅

Select

Selu

Selu

Scale

✅

✅

✅

✅

✅

✅

✅

✅

Scale

ScatterNd

✅

ScatterNd

Shape

✅

✅

✅

✅

✅

✅

✅

Shape

Shape

Shape

Sigmoid

✅

✅

✅

✅

✅

✅

✅

Logistic

Sigmoid

Sigmoid

Sigmoid

SigmoidGrad

✅

✅

Sin

✅

✅

✅

✅

✅

✅

✅

Sin

Sin

Sin

Size

✅

Size

Slice

✅

✅

✅

✅

✅

✅

✅

Slice

Slice

Slice

Slice

SkipGram

✅

SKipGram

Softmax

✅

✅

✅

✅

✅

✅

✅

Softmax

Softmax

Softmax

Softmax

SoftmaxGrad

✅

Softplus

✅

Softplus

SpaceToBatch

✅

✅

✅

✅

✅

SpaceToBatch

SpaceToBatchND

✅

✅

✅

✅

✅

SpaceToBatchND

SpaceToBatchND

SpaceToDepth

✅

✅

✅

SpaceToDepth

SpaceToDepth

SparseToDense

✅

✅

✅

SpareToDense

Split

✅

✅

✅

✅

✅

Split, SplitV

Split

Split, SplitV

Sqrt

✅

✅

✅

✅

✅

✅

✅

✅

Sqrt

Sqrt

Sqrt

Square

✅

✅

✅

✅

✅

✅

✅

Square

Square

SquaredDifference

✅

✅

✅

✅

✅

SquaredDifference

SquaredDifference

Squeeze

✅

✅

✅

✅

✅

✅

✅

Squeeze

Squeeze

Squeeze

StridedSlice

✅

✅

✅

✅

✅

✅

✅

StridedSlice

Slice,
DynamicSlice

StridedSlice

Stack

✅

✅

✅

✅

Stack

Pack

Sub

✅

✅

✅

✅

✅

✅

✅

✅

Sub

Sub

Sub

SubGrad

✅

Swish

✅

✅

Switch

✅

✅

Switch

Tanh

✅

✅

✅

✅

✅

✅

Tanh

TanH

Tanh, Sign

Tanh

TanhGrad

✅

TensorListFromTensor

✅

✅

TensorListFromTensor

TensorListGetItem

✅

✅

TensorListGetItem

TensorListReserve

✅

✅

TensorListReserve

TensorListSetItem

✅

✅

TensorListSetItem

TensorListStack

✅

✅

TensorListStack

Tile

✅

✅

✅

Tile

Tile

Tile

TopK

✅

✅

✅

TopKV2

TopK

TopKV2

Transpose

✅

✅

✅

✅

✅

✅

✅

Transpose

Permute

Transpose

Transpose

UniformReal

✅

Unique

✅

Unique

Unsqueeze

✅

✅

✅

✅

✅

✅

Unsqueeze

Unstack

✅

Unstack

Where

✅

Where

Where

Where

ZerosLike

✅

ZerosLike

ZerosLike

Other operators supported by the converter.[4]

Loop, Dropout, If

Dropout, Enter,
Exit, If,
IsFinite,
LinSpace,
LoopCond,
NextIteration,
StatelessIf,
StatelessWhile,
While

[1] Clip: Only support converting clip(0, 6) to Relu6.

[2] Pow: Only support the form where the exponent is a single constant.

[3] Sum and Max: Only support 2 inputs.

[4] Operators supported by converter but do not require specific implementation. Generally, such operators are optimized by the conversion tool, such as being merged or replaced by other operators.