mindspore::lite

#include <model.h>

Allocator

Allocator defines a memory pool for dynamic memory malloc and memory free.

Context is defined for holding environment variables during runtime.

Context()

Constructor of MindSpore Lite Context using default value for parameters.

 ~Context()

Destructor of MindSpore Lite Context.

float16_priority

A bool value. Defaults to false. Prior enable float16 inference.

Enabling float16 inference may cause low precision inference，because some variables may exceed the range of float16 during forwarding.

device_type

A DeviceType enum type. Defaults to DT_CPU. Using to specify the device.

thread_num_

An int value. Defaults to 2. Thread number config for thread pool.

allocator

A pointer pointing to Allocator.

cpu_bind_mode_

A CpuBindMode enum variable. Defaults to MID_CPU.

Primitive is defined as prototype of operator.

Model defines model in MindSpore Lite for managing graph.

virtual ~Model()

Destructor of MindSpore Lite Model.

void Free()

Free MetaGraph in MindSpore Lite Model to reduce memory usage during inference.

void Destroy()

Destroy all temporary memory in MindSpore Lite Model.

static Model *Import(const char *model_buf, size_t size)

Static method to create a Model pointer.

Parameters
- model_buf: Define the buffer read from a model file.
- size: variable. Define bytes number of model buffer.
Returns

Pointer of MindSpore Lite Model.

An enum type. CpuBindMode defined for holding bind cpu strategy argument.

MID_CPU = -1

Bind middle cpu first.

HIGHER_CPU = 1

Bind higher cpu first.

NO_BIND = 0

No bind.

An enum type. DeviceType defined for holding user’s preferred backend.

DT_CPU = -1

CPU device type.

DT_GPU = 1

GPU device type.

DT_NPU = 0

NPU device type, not supported yet.

std::string Version()

Global method to get a version string.