Inference

Based on the model trained by MindSpore, it supports the execution of inferences on various platforms such as Ascend 910 AI processor, Ascend 310 AI processor, GPU, CPU, and device side. For more details, please refer to the following tutorials:

• Inference on the Ascend 910 AI processor

• Inference on the Ascend 310 AI processor

• Inference on a GPU

• Inference on a CPU

• Inference on the device side

At the same time, MindSpore offers a lightweight and high-performance module called “MindSpore Serving”, which helps MindSpore developers effectively deploy online inferences in a production environment. For more details, please refer to the following tutorials:

• MindSpore Serving-based Inference Service Deployment

• gRPC-based MindSpore Serving Access

• RESTful-based MindSpore Serving Access

• Servable Provided Through Model Configuration