4. Display

_images/usage_display_rk3588_vop.png

RK3588S has four video output ports, each video output port is bound to a fixed display controller, such as Port0 can be used to connect with display controllers such as DP0, DP1, HDMI/eDP0 and HDMI/eDP1, other Portx and so on.

Each Portx has its own maximum resolution:

  • Port0 can output up to 7680x4320@60Hz

  • Port1 can output up to 4096x2304@60Hz

  • Port2 can output up to 4096x2304@60Hz

  • Port3 can output up to 1920x1080@60Hz

In software, if the HDMI0 display controller is connected to Port0, and the hardware phy supports HDMI2.1, then HDMI0 supports 8K@60Hz output.

If each Portx is assigned a separate display controller, it can support four-screen simultaneous display (different display) at the same time.

But from the software point of view, there are the following configuration considerations:

  1. When RK3588 does 8K output, in fact, the chip uses the resources of Port0 and Port1 at the same time, but only borrows the Port0 port for output, so when the display controller connected to Port0 is connected to an external 8K display for output and the Port1 is using. The display controller will work abnormally.

    For example, when HDMI0 (connected to Port0) is connected to 8K output, the display of DP0 (connected to Port1) will be abnormal. Only when the output of Port0 is less than or equal to 4K@60Hz, Port1 can output 4K@60Hz normally.

4.1. AIO-3588SG Displays the configuration of the interface

AIO-3588SG There are three display output interfaces, namely eDP, Display Port and MIPI DSI, which can achieve multi-screen simultaneous display/exclusive display. The interface diagram is as follows:

  • eDP/ Display Port/ MIPI DSI1 _images/usage_display_interface-B.png

The following is a basic introduction to the configuration and use of each display output interface. For details, please refer to the file:

  • kernel-5.10/arch/arm64/boot/dts/rockchip/rk3588s-firefly-aio-3588sg.dtsi

  • kernel-5.10/arch/arm64/boot/dts/rockchip/rk3588s-firefly-aio-3588sg-mipi101-M101014-BE45-A1.dtsi

  • kernel-5.10/arch/arm64/boot/dts/rockchip/rk3588s-firefly-aio-3588sg-edp-NV156FHM-T06.dtsi

4.1.1. Display Port

AIO-3588SG has a Display Port display output interface, supports DP TX 1.4a protocol, and resolution can support up to 7680x4320@30Hz.

4.1.1.1. Software configuration

Display Port is represented as dp0 on the system status tree, add:

// enable dp0 audio output
&spdif_tx2{
        status = "okay";
};

&dp0_sound{
        status = "okay";
};

//enable dp0
&dp0 {
        status = "okay";
};

//connect dp0 with port2
&dp0_in_vp2 {
        status = "okay";
};

//enable Type-C's PD power chip
&usbc0{
        status = "okay";
        interrupt-parent = <&gpio0>;
        interrupts = <RK_PC4 IRQ_TYPE_LEVEL_LOW>;
};

/* disable for charge ic sc8886 */
&vbus5v0_typec_pwr_en {
    status = "disabled";
};

/* Note:Currently dp0 does not support the startup logo display function */

Note that the default software configuration of the SDK is to connect dp0 to vp2, which results in dp0 only being able to output 4096x2304@60Hz at most, so if you want the functionality of 7680x4320@30Hz, you need to connect dp0 to vp0.

4.1.2. MIPI DSI

AIO-3588SG There are two MIPI DSI display output interfaces, both support DPHY2.0 and 4 Lane data output, and can output up to 4096x2304@60Hz (depending on the connected Portx).

4.1.2.1. Software configuration

The following uses DSI1 as an example. The external screen is 101-M101014-BE45-A1 screen, which is represented as’ DSI1 ‘by DSI software.

Combining AIO-3588SG DSI1 interface and screen timing

  • DSI1 interface
    _images/usage_display_mipi_v2_interface.png

  • V2 screen display timing
    _images/usage_display_mipi_v2_timing.jpg

  • V2 screen power-on timing
    _images/usage_display_mipi_v2_power_on.png

  • V2 screen power-down timing
    _images/usage_display_mipi_v2_power_off.png

  • V2 screen power-up symbol reference
    _images/usage_display_mipi_v2_power_menu.png

Add to the system status tree:

//Configure screen power supply
vcc3v3_tp_en_regulator: vcc3v3-tp-en-regultor{
        status = "okay";
        compatible = "regulator-fixed";
        regulator-name = "vcc3v3_tp_en";
        regulator-always-on;
        enable-active-high;
        gpio = <&pca9555 PCA_IO0_6 GPIO_ACTIVE_HIGH>;
};

//Configure the backlight
backlight_dsi1: backlight-dsi1 {
	...
        status = "okay";
        compatible = "pwm-backlight";
        enable-gpios = <&gpio4 RK_PB7 GPIO_ACTIVE_HIGH>;
        pwms = <&pwm3 0 50000 1>;

        ...
}
&pwm3 {
        pinctrl-0 = <&pwm3m1_pins>;
        status = "okay";
};

//enable DPHY
&mipi_dcphy1 {
    status = "okay";
};

&dsi1_in_vp2 {
    status = "disabled";
};

//connect dsi1 with Port3 
&dsi1_in_vp3 {
    status = "okay";
};

//enable the dsi1 logo og startup
&route_dsi1 {
    status = "okay";
    connect = <&vp3_out_dsi1>;
};

&route_hdmi0{
    status = "disabled";
};

//enable dsi1(Note:this part is more important which contants the timing of the display)
&dsi1 {
    status = "okay";
    //rockchip,lane-rate = <1000>;
    dsi_panel: panel@0 {
        status = "okay";
        compatible = "simple-panel-dsi";
        reg = <0>;

	//select the backlight node of the previous configuration
	backlight = <&backlight_dsi1>; 
		
        //select the power supply node
        power-supply = <&vcc3v3_tp_en_regulator>;

	//sets the LCD enable pin
	enable-gpios = <&pca9555 PCA_IO0_5 GPIO_ACTIVE_HIGH>;

	//sets the LCD reset pin
	reset-gpios = <&pca9555 PCA_IO0_4 GPIO_ACTIVE_LOW>;

	//sets the timing of startup of LCD 
        enable-delay-ms = <50>;
        prepare-delay-ms = <200>;
        reset-delay-ms = <50>;
        init-delay-ms = <55>;
        unprepare-delay-ms = <50>;
        disable-delay-ms = <20>;
        mipi-data-delay-ms = <200>;
        size,width = <120>;
        size,height = <170>;

	//set the output mode of DSI (DPHY). the default mode is Video  
	dsi,flags = <(MIPI_DSI_MODE_VIDEO | MIPI_DSI_MODE_VIDEO_BURST | MIPI_DSI_MODE_LPM | MIPI_DSI_MODE_EOT_PACKET)>;

	//sets the output format for DSI pixel data, depending on whether the receiving screen supports the format  
	dsi,format = <MIPI_DSI_FMT_RGB888>;

	//set the number of lanes to be used. Default is 4 lanes
	dsi,lanes  = <4>;

	//set the power-on command for the MIPI DSI
	panel-init-sequence = [
		//39 00 04 B9 83 10 2E
		// 15 00 02 CF FF
		05 78 01 11
		05 32 01 29
		//15 00 02 35 00
	];

	//set the power-off command for the MIPI DSI
	panel-exit-sequence = [
		05 00 01 28
		05 00 01 10
	];

	//set the display timing of the LCD screen (this part can be obtained from the corresponding screen, as shown in the figure above)  
	disp_timings0: display-timings {
		native-mode = <&dsi0_timing0>;
		dsi0_timing0: timing0 {

		/* the conversion formula for display timing sequence is generally:
		(hactive + hsync-len + hback-porch + hfront-porch)   
					x
		( vactive + vsync-len + vback-porch + vfront-porch)x fps
		 = clock-frequency
		*/
                clock-frequency = <72600000>;//<80000000>;
                hactive = <800>;//<768>;
                vactive = <1280>;
                hsync-len = <14>;   //20, 50,10
                hback-porch = <26>; //50, 56,10
                hfront-porch = <32>;//50, 30,180
                vsync-len = <8>;//4
                vback-porch = <20>;//4
                vfront-porch = <80>;//8
                hsync-active = <0>;
                vsync-active = <0>;
                de-active = <0>;
                pixelclk-active = <0>;
		};
	};

		ports {
			#address-cells = <1>;
			#size-cells = <0>;

			port@0 {
				reg = <0>;
				panel_in_dsi: endpoint {
					remote-endpoint = <&dsi_out_panel>;
				};
			};
		};
	};

	ports {
		#address-cells = <1>;
		#size-cells = <0>;

		port@1 {
			reg = <1>;
			dsi_out_panel: endpoint {
			remote-endpoint = <&panel_in_dsi>;
			};
		};
	};
};

//enable the touch function on the screen
&i2c6{
    status = "okay";
    hxchipset@48{
        status = "okay";
        compatible = "himax,hxcommon";
        reg = <0x48>;
	//set the reset pin for the touch function
        himax,rst-gpio =  <&gpio1 RK_PB2 GPIO_ACTIVE_HIGH>;

	//sets the interrupt pin for the touch function
        himax,irq-gpio = <&gpio1 RK_PA7 IRQ_TYPE_LEVEL_HIGH>;
        pinctrl-names = "default";
        pinctrl-0 = <&touch_int0>;
        himax,panel-coords = <0 800 0 1280>;      //Range of touch
        himax,display-coords = <0 800 0 1280>;    //resolution
        report_type = <1>;
    };
};

When configuring MIPI DSI, if there are abnormal phenomena, such as black screen, picture stretching, display noise, etc., you need to pay attention to troubleshooting:

  1. Shows whether the timing configuration is correct, especially the DCLK configuration.

  2. Is the power-on timing correct, in the file kernel-5.10/drivers/gpu/drm/panel/panel-simple.c In thepanel_simple_prepare and panel_simple_unprepare functions, the power-up timing and gpio port configured in the system status tree are called.

    If you choose to enable the boot logo during the uboot phase, you also need to troubleshoot the u-boot/drivers/video/drm/rockchip_panel.c and panel_simple_prepare functions in the panel_simple_unprepare file.

  3. Take an oscilloscope to see if the power-on timing is correct, mainly to confirm whether the timing between the LCD enable pin, the reset pin and the on-screen power-on command is correct.

4.1.3. EDP

AIO-3588SG has one EDP display output interface, up to 4096x2304@60Hz

4.1.3.1. Software configuration

EDP software configuration, external screen is 15.6 inch NV156FHM-T06 screen (name needs to be discussed).

  • EDP interface
    _images/usage_display_edp_1080_interface.png

  • screen power-on/power-down timing
    _images/usage_display_edp_NV156FHM-T06.png

kernel-5.10/arch/arm64/boot/dts/rockchip/rk3588-firefly-aio-3588q-edp_NV156FHM-T06.dts, from this file we can see the following statement:

edp_panel: edp-panel {
        compatible = "simple-panel";
        status = "okay";

        //select the backlight node of the previous configuration
        backlight = <&backlight_edp>;
        
        //sets the LCD power pin
        pwr-gpios = <&pca9555 PCA_IO0_6 GPIO_ACTIVE_HIGH>;
        pwr-delay-ms = <200>;

        //sets the LCD enable pin
        enable-gpios = <&pca9555 PCA_IO0_2 GPIO_ACTIVE_HIGH>; // EDP_BL_EN

        //set the display timing of the LCD screen
        display-timings {
            native-mode = <&timing0>;
            timing0: timing0 {
                clock-frequency = <140000000>;
                hactive = <1920>;
                vactive = <1080>;
                hfront-porch = <40>;
                hsync-len = <40>;
                hback-porch = <80>;
                vfront-porch = <16>;
                vsync-len = <8>;
                vback-porch = <16>;
                hsync-active = <0>;
                vsync-active = <0>;
                de-active = <0>;
                pixelclk-active = <0>;
            };
        };

        ports {
            panel_in_edp1: endpoint {
                remote-endpoint = <&edp1_out_panel>;
            };
        };
    };

    //config the backlight
    backlight_edp: backlight-edp {
        status = "okay";
        compatible = "pwm-backlight";
        pwms = <&pwm14 0 500000 0>;

        ...
};

&pwm14 {
    pinctrl-0 = <&pwm14m1_pins>;
    status = "okay";
};

&edp0 {
    //force-hpd;
    hpd-gpios = <&gpio1 RK_PA6 GPIO_ACTIVE_HIGH>;
    status = "okay";

    ports {
        port@1 {
            reg = <1>;

            edp1_out_panel: endpoint {
                remote-endpoint = <&panel_in_edp1>;
            };
        };
    };
};

//enable the  dsi1 logo og startup
&route_edp0  {
    status = "okay";
    connect = <&vp2_out_edp1>;
};

&edp0_in_vp2 {
    status = "okay";
};

&hdptxphy0 {
    status = "okay";
};

//enable the touch function on the screen
&i2c6{
    status = "okay";

    goodix_ts@5d {
        status = "okay";
        compatible = "goodix,gt9xxx";
        reg = <0x5d>;
        interrupt-parent = <&gpio1>;
        interrupts = <0 17 0x2008 0>;

        //Set the power control pin for the touch function
        goodix,pwr-gpio = <&pca9555 PCA_IO0_1 GPIO_ACTIVE_HIGH>;

        //set the reset pin for the touch function
        goodix,rst-gpio = <&pca9555 PCA_IO0_0 GPIO_ACTIVE_HIGH>;

        //sets the interrupt pin for the touch function
        goodix,irq-gpio = <&gpio1 RK_PA4 IRQ_TYPE_LEVEL_LOW>;
        flip-x = <0>;
        flip-y = <0>;

        ...
    };
};

4.2. Debug method

  • Set resolution in the system

System mouse click: ‘Settings — > Display — > HDMI- > resolution settings’

  • Get the edid of HDMI/Display Port (take HDMI as an example)

:/ # busybox hexdump /sys/class/drm/card0-HDMI-A-1/edid
0000000 ff00 ffff ffff 00ff 040d 0030 0001 0000
0000010 1e01 0301 8b80 784e 502a a31f 4959 2497
0000020 4fbb 2153 0008 8081 c081 0081 c0d1 7c61
0000030 fc81 0101 0101 7404 7c00 70f6 805a 58fc
0000040 008a 1072 0053 1e00 3a02 1880 3871 402d
0000050 2c58 0045 1072 0053 1e00 0000 fc00 4300
0000060 5348 5648 200a 2020 2020 2020 0000 fd00
0000070 1700 0f4c 1e50 0a00 2020 2020 2020 4a01
0000080 0302 f07c 015f 0302 0504 0706 1190 1312
0000090 1514 1f16 2220 5e5d 605f 6261 6564 c266
00000a0 c4c3 c7c6 0932 0717 0715 5750 0106 0467
00000b0 3d03 c007 7e5f e601 4611 00d0 8070 4783
00000c0 0000 036e 000c 0020 3cb8 0020 0180 0302
00000d0 6d04 5dd8 01c4 8078 2267 0000 67cf e51f
00000e0 000f 3000 e363 0506 e301 c305 e201 ff00
00000f0 01eb d046 4800 42af 38a2 d727 0000 a400
0000100
  • Get the resolutions supported by HDMI/Display Port (take HDMI as an example)

:/ # cat /sys/class/drm/card0-HDMI-A-1/modes
3840x2160
7680x4320
7680x4320
7680x4320
7680x4320
7680x4320
7680x4320
7680x4320
7680x4320
4096x2160
4096x2160
4096x2160
4096x2160
4096x2160
4096x2160
4096x2160
  • Get the connection status of HDMI/Display Port (take HDMI as an example)

:/ # cat /sys/class/drm/card0-HDMI-A-1/status
connected
  • Get information on the Video Portx in use on the system (with the connected display controller)

:/ # cat /d/dri/0/summary
Video Port0: ACTIVE
    Connector: HDMI-A-1
        bus_format[2026]: UYYVYY8_0_5X24
        overlay_mode[1] output_mode[e] color_space[3], eotf:0
    Display mode: 7680x4320p60
        clk[2376000] real_clk[2376000] type[40] flag[5]
        H: 7680 8232 8408 9000
        V: 4320 4336 4356 4400
    Cluster0-win0: ACTIVE
        win_id: 0
        format: AB24 little-endian (0x34324241)[AFBC] SDR[0] color_space[0] glb_alpha[0xff]
        rotate: xmirror: 0 ymirror: 0 rotate_90: 0 rotate_270: 0
        csc: y2r[0] r2y[1] csc mode[1]
        zpos: 0
        src: pos[0, 0] rect[3840 x 2160]
        dst: pos[0, 0] rect[7680 x 4320]
        buf[0]: addr: 0x0000000010971000 pitch: 15360 offset: 0
Video Port1: DISABLED
Video Port2: DISABLED
Video Port3: DISABLED

Generally, if you encounter the problem that HDMI/Display Port cannot be displayed, you need to execute the above command to see if the connection status, edid and resolution are correct.