2. Acceleration

CUDA (Nvidia)

1. Install CUDA Toolkit 11.8 and cuDNN for Cuda 11.x

2. Install dependencies:

pip uninstall onnxruntime onnxruntime-gpu
pip install onnxruntime-gpu==1.15.1

3. Usage in case the provider is available:

python run.py --execution-provider cuda

CoreML (Apple)

Apple Silicon

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-silicon
pip install onnxruntime-silicon==1.13.1

2. Usage in case the provider is available:

python run.py --execution-provider coreml

Apple Legacy

1.Install dependencies:

pip uninstall onnxruntime onnxruntime-coreml
pip install onnxruntime-coreml==1.13.1

2. Usage in case the provider is available:

python run.py --execution-provider coreml

DirectML (Windows)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-directml
pip install onnxruntime-directml==1.15.1

2. Usage in case the provider is available:

python run.py --execution-provider dml

OpenVINO (Intel)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-openvino
pip install onnxruntime-openvino==1.15.0

2. Usage in case the provider is available:

python run.py --execution-provider openvino