Skip to content

ONNX Runtime

Failure

Unfortunately, NPU is not supported on linux.

ONNX Runtime replies on the Execution Provider (EP) to distribute tasks on devices. The supports for AMD GPU is MIGraphX EP (ROCm EP has been removed. It is recommended to use MIGraphX EP instead.), and the AMD AIE (NPU) is supported by Vitis AI EP. However, Visis AI only support on Windows.

The installation for iGPU support should be already met if the pytorch support ROCm already. Check by 

# Check the MIGraphX status
python3 -c 'import torch_migraphx' 2> /dev/null && echo 'Success' || echo 'Failure'
pytest ./torch_migraphx/tests

# Check onnxruntime
import onnxruntime as ort
  ort.get_available_providers()

"""Expected output
>>> ort.get_available_providers()
['MIGraphXExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider']
"""

See more on Install ONNX Runtime for Radeon GPUs.