Model Online Inference

This section describes how to download the Ascend MindSpore online inference case on the OrangePi AIpro (hereafter: OrangePi development board) and launch the Jupyter Lab interface to perform inference.

1. Downloading Case

Step1 Download case code.

# Open a terminal on the development board and run the following command
cd samples/notebooks/
git clone https://github.com/mindspore-courses/orange-pi-mindspore.git

Step2 Enter the case catalog.

The downloaded code package is in the following directory of the OrangePi development board: /home/HwHiAiUser/samples/notebooks.

The project catalog is listed below:

/home/HwHiAiUser/samples/notebooks/orange-pi-mindspore/tutorial/
01-dev_start
02-ResNet50
03-ViT
04-FCN
05-Shufflenet
06-SSD
07-RNN
08-LSTM+CRF
09-GAN
10-DCGAN
11-Pix2Pix
12-Diffusion  
13-ResNet50_transfer

2. Inference Execution

Step 1 Launch the Jupyter Lab interface.

cd /home/HwHiAiUser/samples/notebooks/  
./start_notebook.sh

After executing the script, the following printout will appear in the terminal, in which there will be a link to the URL for logging into Jupyter Lab.

Then open the browser.

Then enter the URL link you see above in your browser to log into the Jupyter Lab software.

Step 2 In the Jupyter Lab interface, double-click the case directory shown in the figure below, take “04-FCN” as an example here, you can enter the case directory.

Step 3 In this directory there are all the resources to run the sample, where mindspore_fcn8s.ipynb is the file to run the sample in Jupyter Lab. Double-click to open the mindspore_fcn8s.ipynb, which will be displayed in the right window. The contents of the mindspore_fcn8s.ipynb file is shown in the following figure:

Step 4 Click the ⏩ button to run the sample. In the pop-up dialog box, click the "Restart" button, then the sample begins to run.