1. Video Usage

AIBOX-9075 default video framework is Gstreamer.

1.1. Available Gst Plugins

Use gst-inspect to list available media plugins, these v4l plugins have hardware acceleration.

firefly@ubuntu:~$ gst-inspect-1.0 --plugin | grep v4l2
video4linux2:  v4l2av1dec: V4L2 AV1 Decoder
video4linux2:  v4l2deviceprovider (GstDeviceProviderFactory)
video4linux2:  v4l2h264dec: V4L2 H264 Decoder
video4linux2:  v4l2h264enc: V4L2 H.264 Encoder
video4linux2:  v4l2h265dec: V4L2 H265 Decoder
video4linux2:  v4l2h265enc: V4L2 H.265 Encoder
video4linux2:  v4l2radio: Radio (video4linux2) Tuner
video4linux2:  v4l2sink: Video (video4linux2) Sink
video4linux2:  v4l2src: Video (video4linux2) Source
video4linux2:  v4l2vp9dec: V4L2 VP9 Decoder

1.2. VPU Capability

• decode

1x 8K60, 2x 8K30, 4x 4K60, 8x 4K30, 16x 1080p60, 32x 1080p30

Formats: AV1, H.264, H.265, VP9, MPEG2

• encode

2x 4K60, 4x 4K30, 8x 1080p60, 16x 1080p30

Formats: H.264, H.265, HEIF/ HEIC

1.3. Video Play

For example, play h264 video, use v4l2h264dec:

export XDG_RUNTIME_DIR=/run/user/1000
export WAYLAND_DISPLAY=wayland-0
gst-launch-1.0 filesrc location=/usr/local/test.mp4 ! qtdemux name=demux demux.video_0 ! queue ! h264parse ! v4l2h264dec ! glimagesink sync=true

1.4. Video Encode

For example, encode h264 stream use v4l2h264enc:

gst-launch-1.0 videotestsrc ! v4l2h264enc ! h264parse ! qtmux ! filesink location=test.mp4 -e

# Use Ctrl+C to stop encoding.