Lite Operator List
This article lists the operators supported by MindSpore Lite.
Operation |
CPU |
CPU |
CPU |
CPU |
GPU |
GPU |
NPU |
TensorRT |
Ascend |
TensorFlow Lite |
Caffe |
Onnx |
TensorFlow |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Abs |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Abs |
Abs |
Abs |
|
Add |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Add |
Add, Int8Add |
Add, AddV2 |
|
Adder |
✅ |
adder_f |
|||||||||||
AddGrad |
✅ |
||||||||||||
AddN |
✅ |
✅ |
AddN |
||||||||||
Assert |
✅ |
✅ |
Assert |
||||||||||
Argmax |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Argmax |
ArgMax |
ArgMax |
ArgMax |
Argmin |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Argmin |
ArgMin |
||||
AvgPool |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
MeanPooling |
Pooling |
AveragePool, |
AvgPool |
AvgPoolGrad |
✅ |
✅ |
|||||||||||
BatchNorm |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
BatchNorm |
BatchNormalization |
||||
BatchNormGrad |
✅ |
✅ |
|||||||||||
BatchToSpace |
✅ |
✅ |
✅ |
✅ |
✅ |
BatchToSpace, |
BatchToSpace, |
||||||
BiasAdd |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
BiasAdd |
BiasAdd |
|||
BiasAddGrad |
✅ |
✅ |
|||||||||||
BroadcastTo |
✅ |
BroadcastTo |
Expand |
BroadcastTo |
|||||||||
Cast |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Cast, |
Cast |
Cast |
|
Ceil |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Ceil |
Ceil |
Ceil |
||
Concat |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Concat |
Concat |
Concat |
ConcatV2 |
ConstantOfShape |
✅ |
✅ |
ConstantOfShape |
||||||||||
Conv2d |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Conv2D |
Convolution |
Conv, Int8Conv, |
Conv2D |
Conv2DBackpropFilterFusion |
✅ |
✅ |
|||||||||||
Conv2DBackpropInputFusion |
✅ |
✅ |
|||||||||||
Conv2dGrad |
✅ |
||||||||||||
Conv2dTranspose |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
DeConv2D |
Deconvolution |
ConvTranspose |
Conv2DBackpropInput |
Conv2dTransposeGrad |
✅ |
||||||||||||
Cos |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Cos |
Cos |
Cos |
||
Crop |
✅ |
✅ |
✅ |
✅ |
Crop |
||||||||
CropAndResize |
✅ |
✅ |
CropAndResize |
||||||||||
CumSum |
✅ |
Cumsum |
|||||||||||
CustomExtractFeatures |
✅ |
ExtractFeatures |
|||||||||||
CustomNormalize |
✅ |
Normalize |
|||||||||||
CustomPredict |
✅ |
Predict |
|||||||||||
Deconvolution |
✅ |
||||||||||||
DeDepthwiseConv2D |
✅ |
✅ |
✅ |
✅ |
✅ |
Deconvolution |
|||||||
DepthToSpace |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
DepthToSpace |
DepthToSpace |
DepthToSpace |
||||
DepthwiseConv2dNative |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
DepthwiseConv2D |
Convolution |
DepthwiseConv2dNative |
||||
DetectionPostProcess |
✅ |
✅ |
✅ |
Custom |
|||||||||
Div |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Div, RealDiv |
Div |
Div, RealDiv |
|
DivGrad |
✅ |
||||||||||||
DropoutGrad |
✅ |
✅ |
|||||||||||
Eltwise |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Eltwise |
Sum, Max[3] |
||
Elu |
✅ |
✅ |
✅ |
ELU |
Elu, |
NonMaxSuppressionV3 |
|||||||
EluGrad |
✅ |
||||||||||||
Equal |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Equal |
Equal |
Equal |
|
ExpFusion |
✅ |
✅ |
✅ |
✅ |
Exp |
Exp |
Exp |
Exp |
|||||
ExpandDims |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
ExpandDims |
ExpandDims |
||
Fill |
✅ |
✅ |
✅ |
✅ |
✅ |
Fill |
Fill |
||||||
Flatten |
✅ |
✅ |
✅ |
✅ |
Flatten |
||||||||
FlattenGrad |
✅ |
✅ |
|||||||||||
Floor |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
flOOR |
Floor |
Floor |
||
FloorDiv |
✅ |
✅ |
✅ |
✅ |
✅ |
FloorDiv |
FloorDiv |
||||||
FloorMod |
✅ |
✅ |
✅ |
✅ |
✅ |
FloorMod |
FloorMod |
||||||
FullConnection |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
FullyConnected |
InnerProduct |
||
FusedBatchNorm |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
FusedBatchNorm |
FusedBatchNorm, |
|||||
GatherNd |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
GatherND |
GatherNd |
||||
Gather |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Gather |
Gather |
GatherV2 |
|
Greater |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Greater |
Greater |
Greater |
||
GreaterEqual |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
GreaterEqual |
GreaterEqual |
|||
GRU |
✅ |
✅ |
|||||||||||
HardTanh |
✅ |
✅ |
|||||||||||
HashtableLookup |
✅ |
HashtableLookup |
|||||||||||
HSigmoid |
✅ |
✅ |
✅ |
||||||||||
Hswish |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
HardSwish |
|||||
HswishGrad |
✅ |
||||||||||||
InstanceNorm |
✅ |
✅ |
✅ |
InstanceNorm |
InstanceNormalization |
||||||||
InvertPermutation |
✅ |
✅ |
InvertPermutation |
||||||||||
L2Norm |
✅ |
✅ |
L2_NORMALIZATION |
||||||||||
LayerNorm |
✅ |
✅ |
✅ |
✅ |
✅ |
||||||||
LayerNormGrad |
✅ |
✅ |
|||||||||||
LeakyReLU |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
LeakyRelu |
LeakyRelu |
LeakyRelu |
||
LeakyReLUGrad |
✅ |
||||||||||||
Less |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Less |
Less |
Less |
|||
LessEqual |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
LessEqual |
LessEqual |
||||
LRN |
✅ |
LocalResponseNorm |
Lrn, LRN |
||||||||||
Log |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Log |
Log |
Log |
|||
LogGrad |
✅ |
✅ |
|||||||||||
LogicalAnd |
✅ |
✅ |
✅ |
✅ |
✅ |
LogicalAnd |
And |
LogicalAnd |
|||||
LogicalNot |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
LogicalNot |
Not |
LogicalNot |
|||
LogicalOr |
✅ |
✅ |
✅ |
✅ |
✅ |
LogicalOr |
Or |
LogicalOr |
|||||
LogSoftmax |
✅ |
✅ |
LogSoftmax |
LogSoftmax |
|||||||||
LshProjection |
✅ |
LshProjection |
|||||||||||
LSTM |
✅ |
✅ |
LSTM |
||||||||||
MatMul |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
BatchMatMul |
MatMul, |
MatMul, |
|
MatMulGrad |
✅ |
||||||||||||
Maximum |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Maximum |
Max |
Maximum |
||||
MaximumGrad |
✅ |
✅ |
|||||||||||
MaxPool |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
MaxPooling |
Pooling |
MaxPool, |
MaxPool |
MaxPoolGrad |
✅ |
✅ |
|||||||||||
Merge |
✅ |
✅ |
Merge |
||||||||||
Minimum |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Minimum |
Min |
Minimum |
||||
MinimumGrad |
✅ |
✅ |
|||||||||||
Mul |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Mul |
Mul |
Mul |
|
MulGrad |
✅ |
||||||||||||
Neg |
✅ |
✅ |
✅ |
✅ |
✅ |
Neg |
Neg |
Neg |
|||||
NegGrad |
✅ |
✅ |
|||||||||||
NotEqual |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
NotEqual |
NotEqual |
||||
OneHot |
✅ |
✅ |
✅ |
✅ |
OneHot |
OneHot |
OneHot |
||||||
Pad |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Pad, MirrorPad, PadV2 |
Pad |
MirrorPad, Pad, PadV2 |
|
Pow |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Pow |
Power |
Pow[2] |
Pow |
|
PowGrad |
✅ |
||||||||||||
PReLU |
✅ |
✅ |
✅ |
✅ |
✅ |
PRELU |
PReLU |
PRelu |
|||||
QuantDTypeCast |
✅ |
✅ |
✅ |
✅ |
|||||||||
RaggedRange |
✅ |
✅ |
RaggedRange |
||||||||||
RandomStandardNormal |
✅ |
✅ |
RandomStandardNormal |
||||||||||
RandomUniform |
✅ |
RandomUniform |
|||||||||||
Range |
✅ |
✅ |
Range |
Range |
Range |
||||||||
Rank |
✅ |
✅ |
Rank |
Rank |
|||||||||
RealDiv |
✅ |
✅ |
✅ |
||||||||||
Reciprocal |
✅ |
✅ |
✅ |
✅ |
Reciprocal |
||||||||
ReduceAll |
✅ |
All |
|||||||||||
ReduceASum |
✅ |
✅ |
✅ |
✅ |
Reduction |
||||||||
ReduceMax |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
ReduceMax |
ReduceMax |
Max |
|||
ReduceMean |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Mean |
Reduction |
ReduceMean |
Mean |
|
ReduceMin |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
ReduceMin |
ReduceMin |
Min |
|||
ReduceProd |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
ReduceProd |
ReduceProd |
Prod |
|||
ReduceSum |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Sum |
Reduction |
ReduceSum |
Sum |
|
ReduceSumSquare |
✅ |
✅ |
✅ |
✅ |
Reduction |
ReduceSumSquare |
|||||||
ReLU |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Relu |
ReLU |
Relu |
Relu |
ReLUGrad |
✅ |
✅ |
|||||||||||
ReLU6 |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Relu6 |
ReLU6 |
Clip[1] |
Relu6 |
|
ReLU6Grad |
✅ |
✅ |
|||||||||||
Reshape |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Reshape |
Reshape |
Reshape, |
Reshape |
Resize |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
ResizeBilinear, |
Interp |
Resize, Upsample |
ResizeBilinear, |
|
ResizeGrad |
✅ |
✅ |
|||||||||||
ResizeNearestNeighbor |
✅ |
||||||||||||
Reverse |
✅ |
reverse |
ReverseV2 |
||||||||||
ReverseSequence |
✅ |
ReverseSequence |
ReverseSequence |
||||||||||
Round |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Round |
Round |
Round |
||
Rsqrt |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Rsqrt |
Rsqrt |
||||
Select |
✅ |
Select |
|||||||||||
Selu |
Selu |
||||||||||||
Scale |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Scale |
|||
ScatterNd |
✅ |
✅ |
ScatterNd |
ScatterND |
|||||||||
ScatterNdUpdate |
✅ |
✅ |
ScatterNdUpdate |
ScatterNdUpdate |
|||||||||
Shape |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Shape |
Shape |
Shape |
|||
Sigmoid |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Logistic |
Sigmoid |
Sigmoid |
Sigmoid |
|
SigmoidGrad |
✅ |
✅ |
|||||||||||
Sin |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Sin |
Sin |
Sin |
||
Size |
✅ |
✅ |
Size |
||||||||||
Slice |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Slice |
Slice |
Slice |
Slice |
||
SkipGram |
✅ |
SKipGram |
|||||||||||
Softmax |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Softmax |
Softmax |
Softmax |
Softmax |
SoftmaxGrad |
✅ |
||||||||||||
Softplus |
✅ |
✅ |
Softplus |
||||||||||
SpaceToBatch |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
SpaceToBatch |
||||||
SpaceToBatchND |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
SpaceToBatchND |
SpaceToBatchND |
|||||
SpaceToDepth |
✅ |
✅ |
✅ |
✅ |
SpaceToDepth |
SpaceToDepth |
|||||||
SparseToDense |
✅ |
✅ |
✅ |
✅ |
SpareToDense |
||||||||
Splice |
✅ |
✅ |
Splice |
||||||||||
Split |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Split, SplitV |
Split |
Split, SplitV |
|||
SplitWithOverlap |
✅ |
✅ |
|||||||||||
Sqrt |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Sqrt |
Sqrt |
Sqrt |
|
Square |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Square |
Square |
|||
SquaredDifference |
✅ |
✅ |
✅ |
✅ |
SquaredDifference |
SquaredDifference |
|||||||
Squeeze |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Squeeze |
Squeeze |
Squeeze |
|||
StridedSlice |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
StridedSlice |
Slice, |
StridedSlice |
|
StridedSliceGrad |
✅ |
✅ |
|||||||||||
Stack |
✅ |
✅ |
✅ |
✅ |
✅ |
Stack |
Pack |
||||||
Sub |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Sub |
Sub |
Sub |
|
SubGrad |
✅ |
||||||||||||
Swish |
✅ |
✅ |
|||||||||||
Switch |
✅ |
✅ |
Switch |
||||||||||
Tanh |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Tanh |
TanH |
Tanh, Sign |
Tanh |
||
TanhGrad |
✅ |
||||||||||||
TensorListFromTensor |
✅ |
✅ |
TensorListFromTensor |
||||||||||
TensorListGetItem |
✅ |
✅ |
TensorListGetItem |
||||||||||
TensorListReserve |
✅ |
✅ |
TensorListReserve |
||||||||||
TensorListSetItem |
✅ |
✅ |
TensorListSetItem |
||||||||||
TensorListStack |
✅ |
✅ |
TensorListStack |
||||||||||
Tile |
✅ |
✅ |
✅ |
Tile |
Tile |
Tile |
Tile |
||||||
TopK |
✅ |
✅ |
✅ |
✅ |
TopKV2 |
TopK |
TopKV2 |
||||||
Transpose |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Transpose |
Permute |
Transpose,Int8Transpose |
Transpose |
|
UniformReal |
✅ |
||||||||||||
Unique |
✅ |
✅ |
Unique |
||||||||||
UnsortedSegmentSum |
✅ |
✅ |
UnsortedSegmentSum |
||||||||||
Unsqueeze |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
✅ |
Unsqueeze |
||||
Unstack |
✅ |
✅ |
Unstack |
||||||||||
Upsample |
✅ |
||||||||||||
Where |
✅ |
✅ |
Where |
NonZero,Where |
Where |
||||||||
ZerosLike |
✅ |
✅ |
ZerosLike |
ZerosLike |
|||||||||
Other operators supported by the converter.[4] |
Constant, |
Dropout, Enter, |
[1] Clip: Only support converting clip(0, 6) to Relu6.
[2] Pow: Only support the form where the exponent is a single constant.
[3] Sum and Max: Only support 2 inputs.
[4] Operators supported by converter but do not require specific implementation. Generally, such operators are optimized by the conversion tool, such as being merged or replaced by other operators.