RK356X Ubuntu 推流USB攝像頭

本文適用與觸覺智能所有RK356X ubuntu系統的主板。

IDO-SBC3566基于瑞芯微RK3566研發的一款高性能低功耗的智能主板，采用四核A55,主頻高達1.8GHz，專為個人移動互聯網設備和AIOT設備而設計，內置了多種功能強大的嵌入式硬件引擎，為高端應用提供了優異的性能，支持幾乎全格式的4K編解碼，內置3DGPU，能夠完全兼容OpenGL ES1.1/2.0/3.2、OpenCL2.0和Vulkan1.0.特殊的MMU2D硬件引擎，此外，憑借其強大的兼容性，可以輕松地轉換基于TensorFlow/MXNet/PyTorch/Caffe等一系列框架的網絡模型。

支持Android，Linux，OpenHarmony，麒麟OS等多種操作系統，可廣泛應用于平板、教育平板、帶屏音箱、詞典筆、云終端、視頻會議系統等安卓/Linux類應用方案，以及其他帶屏消費類、或輕量級AI應用場景。

產品規格書：IDO-SBC3566-V1B 產品手冊

01確認USB攝像頭設備節點主板接上USB攝像頭后，使用以下命令查看USB攝像頭的設備節點：

root@ido:~# v4l2-ctl --list-devices
rkisp-statistics (platform:rkisp):
/dev/video7
/dev/video8

rkisp_mainpath (platform:rkisp-vir0):
/dev/video0
/dev/video1
/dev/video2
/dev/video3
/dev/video4
/dev/video5
/dev/video6
/dev/media0

AC_2019053011080005:ZH-0305(usb-xhci-hcd.4.auto-1):
/dev/video9
/dev/video10
/dev/media1

video9即為USB攝像頭的設備節點。02查看USB攝像頭支持的圖像格式

root@ido:~# v4l2-ctl -d /dev/video9 --list-formats-ext --all
...
...
...
ioctl:VIDIOC_ENUM_FMT
Type: Video Capture

[0]: 'MJPG'(Motion-JPEG, compressed)
Size: Discrete 1024x576
Interval:Discrete 0.033s (30.000fps)
Size: Discrete 1280x720
Interval:Discrete 0.033s (30.000fps)
Size: Discrete 896x504
Interval:Discrete 0.033s (30.000fps)
Size: Discrete 800x600
Interval:Discrete 0.033s (30.000fps)
Size: Discrete 640x480
Interval:Discrete 0.033s (30.000fps)
[1]: 'YUYV'(YUYV 4:2:2)
Size: Discrete 1280x720
Interval:Discrete 0.100s (10.000fps)
Size: Discrete 1024x576
Interval:Discrete 0.067s (15.000fps)
Size: Discrete 896x504
Interval:Discrete 0.100s (10.000fps)
Size: Discrete 800x600
Interval:Discrete 0.067s (15.000fps)
Size: Discrete 640x480
Interval:Discrete 0.033s (30.000fps)

可以看到，該USB攝像頭支持MPEG格式最高1280x720@30FPS輸出。03推流到電腦上

RK356X主板將USB攝像頭圖像推流到電腦上顯示。

3.1 主板安裝gst-rtsp插件

apt installgstreamer1.0-rtsp

apt installgstreamer1.0-rtsp

3.2 主板安裝mediamtx

mediamtx是一個rtsp server程序

root@ido:/home/ido# tar-xvfmediamtx_v1.1.1_linux_arm64v8.tar.gz
mediamtx
mediamtx.yml
LICENSE
root@ido:/home/ido# ./mediamtx&
[1]1315
root@ido:/home/ido# 2023/10/200204INFMediaMTXv1.1.1
2023/10/200204INF[RTSP]listeneropenedon:8554(TCP), :8000(UDP/RTP), :8001(UDP/RTCP)
2023/10/200204INF[RTMP]listeneropenedon:1935
2023/10/200204INF[HLS]listeneropenedon:8888
2023/10/200204INF[WebRTC]listeneropenedon:8889(HTTP)
2023/10/200204INF[SRT]listeneropenedon:8890(UDP)

3.3 主板開始RTSP推流

查看主板的IP地址：

root@ido:/home/ido# ifconfig
eth0:flags=4163 mtu 1500
inet 192.168.1.196netmask 255.255.255.0broadcast 192.168.1.255
inet6 fe80::d079c367:fea6 prefixlen 64scopeid 0x20
ether 86:41:8a:06:1d:7c txqueuelen 1000(Ethernet)
RX packets 52836bytes 38891607(38.8MB)
RX errors 0dropped 1overruns 0frame 0
TX packets 885065bytes 1255645741(1.2GB)
TX errors 0dropped 0overruns 0carrier 0collisions 0
device interrupt 40

lo:flags=73 mtu 65536
inet 127.0.0.1netmask 255.0.0.0
inet6 ::1prefixlen 128scopeid 0x10
loop txqueuelen 1000(Local Loopback)
RX packets 284667bytes 313713612(313.7MB)
RX errors 0dropped 0overruns 0frame 0
TX packets 284667bytes 313713612(313.7MB)
TX errors 0dropped 0overruns 0carrier 0collisions 0

使用gst-launch-1.0工具進行RTSP推流：

gst-launch-1.0v4l2src device=/dev/video9 \
! image/jpeg ! avdec_mjpeg ! videoconvert \
! video/x-raw,height=720,width=1280,frame=30/1,format=NV12 ! mpph264enc \
! rtspclientsink location=rtsp://127.0.0.1:8554/stream

3.4 電腦播放

電腦打開VLC軟件，點擊【媒體】->【打開網絡串流】->【網絡】，并輸入主板的RTSP推流地址和端口，然后點擊播放：

點擊播放按鈕后，即可看到USB攝像頭的圖像了：

04推流到RK356X主板

RK356X主板A將USB攝像頭推流到RK356X主板B上播放。

4.1 主板A安裝gst-rtsp插件

sudo apt installgstreamer1.0-rtsp

4.2 主板A安裝mediamtx

mediamtx是一個rtsp server程序

sudo apt installgstreamer1.0-rtsp

root@ido:/home/ido# tar-xvfmediamtx_v1.1.1_linux_arm64v8.tar.gz
mediamtx
mediamtx.yml
LICENSE
root@ido:/home/ido# ./mediamtx&
[1]1315
root@ido:/home/ido# 2023/10/200204INFMediaMTXv1.1.1
2023/10/200204INF[RTSP]listeneropenedon:8554(TCP), :8000(UDP/RTP), :8001(UDP/RTCP)
2023/10/200204INF[RTMP]listeneropenedon:1935
2023/10/200204INF[HLS]listeneropenedon:8888
2023/10/200204INF[WebRTC]listeneropenedon:8889(HTTP)
2023/10/200204INF[SRT]listeneropenedon:8890(UDP)

4.3 主板A開始RTSP推流

查看主板A的IP地址：

root@ido:/home/ido# ifconfig
eth0:flags=4163 mtu 1500
inet 192.168.1.196netmask 255.255.255.0broadcast 192.168.1.255
inet6 fe80::d079c367:fea6 prefixlen 64scopeid 0x20
ether 86:41:8a:06:1d:7c txqueuelen 1000(Ethernet)
RX packets 52836bytes 38891607(38.8MB)
RX errors 0dropped 1overruns 0frame 0
TX packets 885065bytes 1255645741(1.2GB)
TX errors 0dropped 0overruns 0carrier 0collisions 0
device interrupt 40

lo:flags=73 mtu 65536
inet 127.0.0.1netmask 255.0.0.0
inet6 ::1prefixlen 128scopeid 0x10
loop txqueuelen 1000(Local Loopback)
RX packets 284667bytes 313713612(313.7MB)
RX errors 0dropped 0overruns 0frame 0
TX packets 284667bytes 313713612(313.7MB)
TX errors 0dropped 0overruns 0carrier 0collisions 0

使用gst-launch-1.0工具進行RTSP推流：

gst-launch-1.0v4l2src device=/dev/video9 \
! image/jpeg ! avdec_mjpeg ! videoconvert \
! video/x-raw,height=720,width=1280,frame=30/1,format=NV12 ! mpph264enc \
! rtspclientsink location=rtsp://127.0.0.1:8554/stream

4.4 主板B拉流并播放

root@ido:~# gst-launch-1.0playbin uri=rtsp://192.168.1.196:8554/stream
Setting pipeline toPAUSED ...
Pipeline islive anddoes not need PREROLL ...
Progress:(open) Opening Stream
Progress:(connect) Connecting tortsp://192.168.1.196:8554/stream
Progress:(open) Retrieving server options
Progress:(open) Retrieving media info
Progress:(request) SETUP stream 0
Progress:(open) Opened Stream
Setting pipeline toPLAYING ...
New clock: GstSystemClock
Progress:(request) Sending PLAY request
Progress:(request) Sending PLAY request
Progress:(request) Sent PLAY request
mpp[1359]: mpp_rt:NOT found ion allocator
mpp[1359]: mpp_rt:found drm allocator
mpp[1359]: mpp_info: mpp version: 49f29006 author: Jeffy Chen 2021-08-04[drm]: Add mmap flag detection
mpp[1359]: hal_h264d_vdpu34x: control info: fmt 7, w1280, h 720
mpp[1359]: mpp_buf_slot:setframe info: w1280h 720hor 1280ver 720
mpp[1359]: mpp_dec: setting default w1280h 720h_str 1280v_str 720
mpp[1359]: h264d_api: is_avcC=1