Lite算子支持¶
Linux Ascend 端侧 推理应用 初级 中级 高级
本文列举MindSpore Lite支持的算子。
| 操作名 |
CPU FP16 |
CPU FP32 |
CPU Int8 |
CPU UInt8 |
GPU FP16 |
GPU FP32 |
NPU |
支持的TensorFlow Lite算子 |
支持的Caffe Lite算子 |
支持的Onnx Lite算子 |
支持的TensorFlow 算子 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Abs | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Abs | Abs | Abs | |
| Add | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Add | Add, Int8Add | Add, AddV2 | |
| AddGrad | Supported | ||||||||||
| AddN | Supported | AddN | |||||||||
| Assert | Supported | Assert | |||||||||
| Argmax | Supported | Supported | Supported | Supported | Supported | Supported | Argmax | ArgMax | ArgMax | Argmax | |
| Argmin | Supported | Supported | Supported | Supported | Supported | Supported | Argmin | ArgMin | |||
| AvgPool | Supported | Supported | Supported | Supported | Supported | Supported | Supported | MeanPooling | Pooling | AveragePool, GlobalAveragePool, Int8AveragePool | AvgPool |
| AvgPoolGrad | Supported | ||||||||||
| BatchNorm | Supported | Supported | Supported | Supported | Supported | Supported | BatchNorm | BatchNormalization | |||
| BatchNormGrad | Supported | ||||||||||
| BatchToSpace | Supported | Supported | Supported | Supported | Supported | BatchToSpace, BatchToSpaceND | BatchToSpace, BatchToSpaceND | ||||
| BiasAdd | Supported | Supported | Supported | Supported | Supported | Supported | BiasAdd | BiasAdd | |||
| BiasAddGrad | Supported | ||||||||||
| Broadcast | Supported | BroadcastTo | Expand | ||||||||
| Cast | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Cast, QUANTIZE, DEQUANTIZE | Cast | Cast | |
| Ceil | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Ceil | Ceil | Ceil | |
| Concat | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Concat | Concat | Concat | ConcatV2 |
| ConstantOfShape | Supported | ConstantOfShape | |||||||||
| Conv2d | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Conv2D | Convolution | Conv, Int8Conv, ConvRelu, Int8ConvRelu | Conv2D |
| Conv2dGrad | Supported | ||||||||||
| Conv2dTranspose | Supported | Supported | Supported | Supported | Supported | Supported | Supported | DeConv2D | Deconvolution | ConvTranspose | Conv2DBackpropInput |
| Conv2dTransposeGrad | Supported | ||||||||||
| Cos | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Cos | Cos | Cos | |
| Crop | Supported | Supported | Supported | Supported | Crop | ||||||
| CropAndResize | Supported | CropAndResize | |||||||||
| CustomExtractFeatures | Supported | ExtractFeatures | |||||||||
| CustomNormalize | Supported | Normalize | |||||||||
| CustomPredict | Supported | Predict | |||||||||
| DeDepthwiseConv2D | Supported | Supported | Supported | Deconvolution | |||||||
| DepthToSpace | Supported | Supported | Supported | Supported | Supported | DepthToSpace | DepthToSpace | ||||
| DepthwiseConv2dNative | Supported | Supported | Supported | Supported | Supported | Supported | Supported | DepthwiseConv2D | Convolution | DepthwiseConv2dNative | |
| DetectionPostProcess | Supported | Supported | Supported | Custom | |||||||
| Div | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Div, RealDiv | Div | Div, RealDiv | |
| DivGrad | Supported | ||||||||||
| Eltwise | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Eltwise | Sum, Max[3] | ||
| Elu | Supported | Elu | Elu, NonMaxSuppression | NonMaxSuppressionV3 | |||||||
| EluGrad | Supported | ||||||||||
| Equal | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Equal | Equal | Equal | |
| Exp | Supported | Supported | Supported | Exp | Exp | Exp | Exp | ||||
| ExpandDims | Supported | Supported | Supported | Supported | ExpandDims | ExpandDims | |||||
| Fill | Supported | Fill | Fill | ||||||||
| Flatten | Supported | Supported | Flatten | ||||||||
| Floor | Supported | Supported | Supported | Supported | Supported | Supported | Supported | flOOR | Floor | Floor | |
| FloorDiv | Supported | Supported | Supported | Supported | Supported | FloorDiv | FloorDiv | ||||
| FloorMod | Supported | Supported | Supported | Supported | Supported | FloorMod | FloorMod | ||||
| FullConnection | Supported | Supported | Supported | Supported | Supported | Supported | Supported | FullyConnected | InnerProduct | ||
| FusedBatchNorm | Supported | Supported | Supported | Supported | Supported | FusedBatchNorm | FusedBatchNorm, FusedBatchNormV3 | ||||
| GatherNd | Supported | Supported | Supported | Supported | Supported | GatherND | GatherNd | ||||
| Gather | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Gather | Gather | GatherV2 | |
| Greater | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Greater | Greater | Greater | |
| GreaterEqual | Supported | Supported | Supported | Supported | Supported | Supported | Supported | GreaterEqual | GreaterEqual | ||
| GRU | Supported | Supported | |||||||||
| HardTanh | Supported | Supported | |||||||||
| HashtableLookup | Supported | HashtableLookup | |||||||||
| HSigmoid | Supported | Supported | |||||||||
| Hswish | Supported | Supported | Supported | Supported | Supported | Supported | Supported | HardSwish | |||
| HswishGrad | Supported | ||||||||||
| InstanceNorm | Supported | Supported | InstanceNorm | ||||||||
| InvertPermutation | Supported | InvertPermutation | |||||||||
| L2Norm | Supported | Supported | L2_NORMALIZATION | ||||||||
| LayerNorm | Supported | Supported | |||||||||
| LeakyReLU | Supported | Supported | Supported | Supported | Supported | Supported | Supported | LeakyRelu | LeakyRelu | LeakyRelu | |
| LeakyReLUGrad | Supported | ||||||||||
| Less | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Less | Less | Less | |
| LessEqual | Supported | Supported | Supported | Supported | Supported | Supported | Supported | LessEqual | LessEqual | ||
| LRN | Supported | LocalResponseNorm | Lrn, LRN | ||||||||
| Log | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Log | Log | Log | |
| LogGrad | Supported | Supported | |||||||||
| LogicalAnd | Supported | Supported | Supported | Supported | Supported | LogicalAnd | And | LogicalAnd | |||
| LogicalNot | Supported | Supported | Supported | Supported | Supported | Supported | Supported | LogicalNot | Not | LogicalNot | |
| LogicalOr | Supported | Supported | Supported | Supported | Supported | LogicalOr | Or | LogicalOr | |||
| LshProjection | Supported | LshProjection | |||||||||
| LSTM | Supported | Supported | LSTM | ||||||||
| MatMul | Supported | Supported | Supported | Supported | Supported | Supported | Supported | MatMul | MatMul, BatchMatMul | ||
| MatMulGrad | Supported | ||||||||||
| Maximum | Supported | Supported | Supported | Supported | Supported | Maximum | Maximum | ||||
| MaximumGrad | Supported | ||||||||||
| MaxPool | Supported | Supported | Supported | Supported | Supported | Supported | Supported | MaxPooling | Pooling | MaxPool, GlobalMaxPool | MaxPool |
| MaxPoolGrad | Supported | ||||||||||
| Merge | Supported | Supported | Merge | ||||||||
| Minimum | Supported | Supported | Supported | Supported | Supported | Minimum | Min | Minimum | |||
| MinimumGrad | Supported | ||||||||||
| Mul | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Mul | Mul | Mul | |
| MulGrad | Supported | ||||||||||
| Neg | Supported | Supported | Supported | Supported | Supported | Neg | Neg | ||||
| NegGrad | Supported | ||||||||||
| NotEqual | Supported | Supported | Supported | Supported | Supported | Supported | Supported | NotEqual | NotEqual | ||
| OneHot | Supported | Supported | Supported | OneHot | OneHot | OneHot | |||||
| Pad | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Pad, MirrorPad | Pad | MirrorPad, Pad | |
| Pow | Supported | Supported | Supported | Supported | Supported | Pow | Power | Pow[2] | Pow | ||
| PowGrad | Supported | ||||||||||
| PReLU | Supported | Supported | Supported | PRELU | PReLU | PRelu | |||||
| RandomStandardNormal | Supported | RandomStandardNormal | |||||||||
| RandomUniform | Supported | RandomUniform | |||||||||
| Range | Supported | Range | Range, RaggedRange | ||||||||
| Rank | Supported | Rank | Rank | ||||||||
| Reciprocal | Supported | Supported | Supported | Supported | |||||||
| ReduceAll | Supported | All | |||||||||
| ReduceASum | Supported | Supported | Supported | Reduction | |||||||
| ReduceMax | Supported | Supported | Supported | Supported | Supported | Supported | ReduceMax | ReduceMax | Max | ||
| ReduceMean | Supported | Supported | Supported | Supported | Supported | Supported | Mean | Reduction | ReduceMean | Mean | |
| ReduceMin | Supported | Supported | Supported | Supported | Supported | ReduceMin | ReduceMin | Min | |||
| ReduceProd | Supported | Supported | Supported | Supported | Supported | ReduceProd | ReduceProd | Prod | |||
| ReduceSum | Supported | Supported | Supported | Supported | Supported | Sum | Reduction | ReduceSum | Sum | ||
| ReduceSumSquare | Supported | Supported | Supported | Reduction | ReduceSumSquare | ||||||
| ReLU | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Relu | ReLU | Relu | Relu |
| ReLUGrad | Supported | Supported | |||||||||
| ReLU6 | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Relu6 | ReLU6 | Clip[1] | Relu6 |
| ReLU6Grad | Supported | Supported | |||||||||
| Reshape | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Reshape | Reshape | Reshape,Flatten | Reshape |
| Resize | Supported | Supported | Supported | Supported | Supported | Supported | ResizeBilinear, NearestNeighbor | Interp | ResizeBilinear, ResizeBicubic, ResizeNearestNeighbor | ||
| ResizeGrad | Supported | ||||||||||
| Reverse | Supported | reverse | ReverseV2 | ||||||||
| ReverseSequence | Supported | ReverseSequence | ReverseSequence | ||||||||
| Round | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Round | Round | Round | |
| Rsqrt | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Rsqrt | Rsqrt | ||
| Select | Supported | Select | |||||||||
| Selu | Supported | Selu | |||||||||
| Scale | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Scale | |||
| ScatterNd | Supported | ScatterNd | |||||||||
| Shape | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Shape | Shape | Shape | |
| Sigmoid | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Logistic | Sigmoid | Sigmoid | Sigmoid |
| SigmoidGrad | Supported | Supported | |||||||||
| Sin | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Sin | Sin | Sin | |
| Size | Supported | Size | |||||||||
| Slice | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Slice | Slice | Slice | Slice |
| SkipGram | Supported | SKipGram | |||||||||
| Softmax | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Softmax | Softmax | Softmax | Softmax |
| SoftmaxGrad | Supported | ||||||||||
| SpaceToBatch | Supported | Supported | Supported | Supported | Supported | SpaceToBatch | |||||
| SpaceToBatchND | Supported | Supported | Supported | Supported | Supported | SpaceToBatchND | SpaceToBatchND | ||||
| SpaceToDepth | Supported | Supported | Supported | SpaceToDepth | SpaceToDepth | ||||||
| SparseToDense | Supported | Supported | Supported | SpareToDense | |||||||
| Split | Supported | Supported | Supported | Supported | Supported | Split, SplitV | Split | Split, SplitV | |||
| Sqrt | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Sqrt | Sqrt | Sqrt | |
| Square | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Square | Square | ||
| SquaredDifference | Supported | Supported | Supported | Supported | Supported | SquaredDifference | SquaredDifference | ||||
| Squeeze | Supported | Supported | Supported | Supported | Supported | Supported | Squeeze | Squeeze | Squeeze | ||
| StridedSlice | Supported | Supported | Supported | Supported | Supported | Supported | Supported | StridedSlice | StridedSlice | ||
| Stack | Supported | Supported | Supported | Supported | Stack | Pack | |||||
| Sub | Supported | Supported | Supported | Supported | Supported | Supported | Supported | Sub | Sub | Sub | |
| SubGrad | Supported | ||||||||||
| Swish | Supported | Supported | |||||||||
| Switch | Supported | Supported | Switch | ||||||||
| Tanh | Supported | Supported | Supported | Supported | Supported | Tanh | TanH | Tanh, Sign | Tanh | ||
| TanhGrad | Supported | ||||||||||
| TensorListFromTensor | Supported | Supported | TensorListFromTensor | ||||||||
| TensorListGetItem | Supported | Supported | TensorListGetItem | ||||||||
| TensorListReserve | Supported | Supported | TensorListReserve | ||||||||
| TensorListSetItem | Supported | Supported | TensorListSetItem | ||||||||
| TensorListStack | Supported | Supported | TensorListStack | ||||||||
| Tile | Supported | Supported | Tile | Tile | Tile | Tile | |||||
| TopK | Supported | Supported | Supported | TopKV2 | TopK | TopKV2 | |||||
| Transpose | Supported | Supported | Supported | Supported | Supported | Supported | Transpose | Permute | Transpose | Transpose | |
| Unique | Supported | Unique | |||||||||
| Unsqueeze | Supported | Supported | Supported | Supported | Supported | Unsqueeze | |||||
| Unstack | Supported | Unstack | |||||||||
| Where | Supported | Where | Where | ||||||||
| ZerosLike | Supported | ZerosLike | ZerosLike | ||||||||
| 转换工具支持的其他算子[4] | Loop, Dropout, If | Dropout, Enter, Exit, If, IsFinite, LinSpace, LoopCond, NextIteration, StatelessIf, StatelessWhile, While |
[1] Clip：仅支持将clip(0, 6)转换为Relu6。
[2] Pow：仅支持指数为单个常数。
[3] Sum与Max：仅支持输入个数为2。
[4] 转换工具支持，但不需要具体实现的算子，一般这类算子在转化工具中被优化而消失，如被融合掉或者使用其他算子代替。