RKNPU Execution Provider (preview)

RKNPU DDK is an advanced interface to access Rockchip NPU. RKNPU Execution Provider enables deep learning inference on Rockchip NPU via RKNPU DDK.

Contents

• RKNPU Execution Provider (preview)
  • Supported platforms
  • Build
  • Usage
    • C/C++
  • Supported Operators
  • Supported Models
    • Image Classification
    • Object Detection

Supported platforms

• RK1808 Linux

Note: RK3399Pro platform is not supported.

Build

For build instructions, please see the BUILD page.

Usage

C/C++

To use RKNPU as execution provider for inferencing, please register it as below.

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions sf;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_RKNPU(sf));
Ort::Session session(env, model_path, sf);

The C API details are here.

Supported Operators

The table below shows the ONNX Ops supported using RKNPU Execution Provider and the mapping between ONNX Ops and RKNPU Ops.

Supported Models

Below Models are supported from ONNX open model zoo using RKNPU Execution Provider

Image Classification

• squeezenet
• mobilenetv2-1.0
• resnet50v1
• resnet50v2
• inception_v2

Object Detection

• ssd
• yolov3