Class Context
Defined in File context.h
Class Documentation
-
class Context
Context is used to store environment variables during execution.
Public Functions
-
void SetThreadNum(int32_t thread_num)
Set the number of threads at runtime. Only valid for Lite.
- Parameters
thread_num – [in] the number of threads at runtime.
-
int32_t GetThreadNum() const
Get the current thread number setting. Only valid for Lite.
- Returns
The current thread number setting.
-
void SetInterOpParallelNum(int32_t parallel_num)
Set the parallel number of operators at runtime. Only valid for Lite.
- Parameters
parallel_num – [in] the parallel number of operators at runtime.
-
int32_t GetInterOpParallelNum() const
Get the current operators parallel number setting. Only valid for Lite.
- Returns
The current operators parallel number setting.
-
void SetThreadAffinity(int mode)
Set the thread affinity to CPU cores. Only valid for Lite.
- Parameters
mode – [in] 0: no affinities, 1: big cores first, 2: little cores first
-
int GetThreadAffinityMode() const
Get the thread affinity of CPU cores. Only valid for Lite.
- Returns
Thread affinity to CPU cores. 0: no affinities, 1: big cores first, 2: little cores first
-
void SetThreadAffinity(const std::vector<int> &core_list)
Set the thread lists to CPU cores. Only valid for Lite.
Note
If core_list and mode are set by SetThreadAffinity at the same time, the core_list is effective, but the mode is not effective.
- Parameters
core_list – [in] a vector of thread core lists.
-
std::vector<int32_t> GetThreadAffinityCoreList() const
Get the thread lists of CPU cores. Only valid for Lite.
- Returns
core_list: a vector of thread core lists.
-
void SetEnableParallel(bool is_parallel)
Set the status whether to perform model inference or training in parallel. Only valid for Lite.
- Parameters
is_parallel – [in] true, parallel; false, not in parallel.
-
bool GetEnableParallel() const
Get the status whether to perform model inference or training in parallel. Only valid for Lite.
- Returns
Bool value that indicates whether in parallel.
Set Delegate to access third-party AI framework. Only valid for Lite.
- Parameters
delegate – [in] the custom delegate.
-
std::shared_ptr<Delegate> GetDelegate() const
Get the delegate of the third-party AI framework. Only valid for Lite.
- Returns
Pointer to the custom delegate.
-
void SetMultiModalHW(bool float_mode)
Set quant model to run as float model in multi device.
- Parameters
float_mode – [in] true, run as float model; false, not run as float model.
-
bool GetMultiModalHW() const
Get the mode of the model run.
- Returns
Bool value that indicates whether run as float model
-
std::vector<std::shared_ptr<DeviceInfoContext>> &MutableDeviceInfo()
Get a mutable reference of DeviceInfoContext vector in this context. Only MindSpore Lite supports heterogeneous scenarios with multiple members in the vector.
- Returns
Mutable reference of DeviceInfoContext vector in this context.
-
void SetThreadNum(int32_t thread_num)