RKNN Toolkit Lite

RKNN Toolkit Lite is a stripped-down version of RKNN Toolkit that
provides users with a development kit for model inference on PC,
RK3399Pro, RK1808, RK1806, V1109, RV1126. Users can easily and quickly
complete the development and deployment of AI applications through the
Python interface provided by the SDK. Compared with the complicated
and time-consuming installation process of RKNN Toolkit, the
installation process of RKNN Toolkit Lite takes less than ten minutes.

OS： Ubuntu18.04 / Debian 10

OpenCV version： 3.4.15

Board: RK3399pro

NPU driver：firefly-3399pronpu-driver_1.7.1_arm64.deb

Build a python3.7 virtual environment  # Install compilation
environments such as gcc and cmake in turn # Install python3.7-tk and
python3.7-dev # Install virtualenv virtual environment sudo apt
install gcc cmake git build-essential \ python3-tk python3.7-dev \
virtualenv

Create a python3.7 virtual environment  virtualenv -p
/usr/bin/python3.7m /home/firefly/venv # Use a virtual environment, if
you want to quit, you can enter deactivate in the terminal source
/home/firefly/venv/bin/activate

Install rknn_toolkit_lite-1.7.1-cp37-cp37m-linux_aarch64.whl  mkdir
/home/firefly/wrok cd /home/firefly/wrok git clone https://github.com
/rockchip-linux/rknn-toolkit.git pip3 install /home/firefly/work/rknn-
toolkit/rknn-toolkit-lite/packages/rknn_toolkit_lite-1.7.1-cp37-cp37m-
linux_aarch64.whl -i https://mirrors.aliyun.com/pypi/simple/

Test

The test process requires OpenCV support. For the installation of
OpenCV, please refer to "Opencv compilation and installation"

Install the NPU driver for 3399pro: firefly-3399pronpu-
driver_1.7.1_arm64.deb  sudo apt update sudo apt install firefly-
3399pronpu-driver # reboot sudo reboot

Run test code  cd /home/firefly/work/rknn-toolkit/rknn-toolkit-
lite/examples/inference_with_lite/ source
/home/firefly/venv/bin/activate python3 test.py