Model Inference

MindSpore Inference

Provides “out-of-the-box” deployment of large language models and inference capabilities to achieve optimal performance based on model characteristics.

MindSpore Lite Inference

A lightweight inference engine focused on efficient inference deployment solutions for offline models and high performance inference for end-to-end devices.