3. RKNN Toolkit Lite

RKNN Toolkit Lite is a stripped-down version of RKNN Toolkit that provides users with a development kit for model inference on PC, RK3399Pro, RK1808, RK1806, V1109, RV1126. Users can easily and quickly complete the development and deployment of AI applications through the Python interface provided by the SDK. Compared with the complicated and time-consuming installation process of RKNN Toolkit, the installation process of RKNN Toolkit Lite takes less than ten minutes.

• OS： Ubuntu18.04 / Debian 10

• OpenCV version： 3.4.15

• Board: RK3399pro

• NPU driver：firefly-3399pronpu-driver_1.7.1_arm64.deb

1. Build a python3.7 virtual environment

   # Install compilation environments such as gcc and cmake in turn
   # Install python3.7-tk and python3.7-dev
   # Install virtualenv virtual environment
   sudo apt install gcc cmake git build-essential \
   python3-tk python3.7-dev \
   virtualenv
   

2. Create a python3.7 virtual environment

   virtualenv -p /usr/bin/python3.7m /home/firefly/venv
   # Use a virtual environment, if you want to quit, you can enter deactivate in the terminal
   source /home/firefly/venv/bin/activate
   

3. Install rknn_toolkit_lite-1.7.1-cp37-cp37m-linux_aarch64.whl

   mkdir /home/firefly/wrok
   cd /home/firefly/wrok
   git clone https://github.com/rockchip-linux/rknn-toolkit.git
   pip3 install /home/firefly/work/rknn-toolkit/rknn-toolkit-lite/packages/rknn_toolkit_lite-1.7.1-cp37-cp37m-linux_aarch64.whl -i https://mirrors.aliyun.com/pypi/simple/
   

3.1. Test

The test process requires OpenCV support. For the installation of OpenCV, please refer to “Opencv compilation and installation”

1. Install the NPU driver for 3399pro: firefly-3399pronpu-driver_1.7.1_arm64.deb

   sudo apt update
   sudo apt install firefly-3399pronpu-driver
   # reboot
   sudo reboot
   

2. Run test code

   cd /home/firefly/work/rknn-toolkit/rknn-toolkit-lite/examples/inference_with_lite/
   source /home/firefly/venv/bin/activate
   python3 test.py