mindspore.runtime.set_kernel_launch_group

View Source On Gitee
mindspore.runtime.set_kernel_launch_group(thread_num=2, kernel_group_num=8)[source]

O0 mode supports operator batch parallel delivery interface, supports enabling parallel delivery, and configures parallel number.

Parameters

  • thread_num (int, optional) – The number of concurrent threads, generally not recommended to increase. The thread_num and the number of threads configured by the existing interface mindspore.runtime.dispatch_threads_num are independent of each other. Default value is 2.

  • kernel_group_num (int, optional) – Total number of operator groups, kernel_group_num/thread_num groups per thread. Default value is 8.

Examples

>>> import mindspore as ms
>>> ms.runtime.set_kernel_launch_group(thread_num=2, kernel_group_num=8)