无人机之眼 | ROS图像RTMP协议推流到地面站，CPU表示软件解码

Posted 2022-03-18 阿木实验室

一、Nginx服务器搭建

因为要将处理过的图片串成rtmp码流，因此，需要搭建一个rtmp服务器，常用的方案是nginx服务器。

1.1 安装依赖

sudo apt-get update
sudo apt-get install -y openssl libssl-dev libpcre3 libpcre3-dev zlib1g-dev 
sudo apt-get install -y autoconf automake build-essential git libass-dev libfreetype6-dev libsdl2-dev libtheora-dev libtool libva-dev libvdpau-dev libvorbis-dev libxcb1-dev libxcb-shm0-dev libxcb-xfixes0-dev pkg-config texinfo wget zlib1g-dev
sudo apt-get install -y ffmpeg

1.2 编译源码

• 在工作空间下，新建一个nginx文件夹，用来存放需要下载nginx和nginx-rtmp-module两个安装包源码。
• nginx下载链接，nginx-rtmp-module下载链接。
• 解压文件，生成nginx-1.18.0文件夹，生成nginx-rtmp-module文件夹。
• 然后编译安装nginx，cd进nginx的目录。

cd nginx-1.18.0
./configure --add-module=../nginx-rtmp-module
make -j4
sudo make install

1.3 测试nginx

直接运行以下命令：

sudo /usr/local/nginx/sbin/nginx

在浏览器中输入localhost：80（或者服务器的IP），看到如下画面，表示安装成功。

1.4 配置

编辑 /usr/local/nginx/conf/nginx.conf文件（）。sudo gedit /usr/local/nginx/conf/nginx.conf

#user  nobody;
worker_processes  1;
#error_log  logs/error.log;
#error_log  logs/error.log  notice;
#error_log  logs/error.log  info;
#pid        logs/nginx.pid;
events 
    worker_connections  1024;

rtmp             
    server 
        listen 1935;  # 服务端口--默认
        chunk_size 4096;   # 数据传输块的大小--默认
        # 设置直播的application名称是live
        application live  
            live on; # live on表示开启直播模式
        
    

http 
    include       mime.types;
    default_type  application/octet-stream;
    #log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
    #                  '$status $body_bytes_sent "$http_referer" '
    #                  '"$http_user_agent" "$http_x_forwarded_for"';
    #access_log  logs/access.log  main;
    sendfile        on;
    #tcp_nopush     on;
    #keepalive_timeout  0;
    keepalive_timeout  65;
    #gzip  on;
    server 
        listen       80;
        server_name  localhost;
        #charset koi8-r;
        #access_log  logs/host.access.log  main;
        location / 
            root   html;
            index  index.html index.htm;
        
        location /info 
            rtmp_stat all;
            rtmp_stat_stylesheet stat.xsl;
        
        location /stat.xsl 
            root html;
        
        #error_page  404              /404.html;
        # redirect server error pages to the static page /50x.html
        #
        error_page   500 502 503 504  /50x.html;
        location = /50x.html 
            root   html;
        
    

配置完之后，需要重启nginx：

sudo cp nginx-rtmp-module/stat.xsl /usr/local/nginx/html/
sudo /usr/local/nginx/sbin/nginx -s reload

然后在浏览器中输入localhost:80/info可看到如下画面：

至此，完成了rtmp-nginx服务器的全部配置。

1.5 让系统启动时自动加载nginx服务

• 首先需要安装sysv-rc-conf：

sudo apt-get update
apt install sysv-rc-conf

• 设置nginx开机启动：

先为nginx在下创建一个启动脚本/etc/init.d/

gedit /etc/init.d/nginx

添加内容如下：

#! /bin/sh
# chkconfig: 2345 55 25
# Description: Startup script for nginx webserver on Debian. Place in /etc/init.d and
# run 'update-rc.d -f nginx defaults', or use the appropriate command on your
# distro. For CentOS/Redhat run: 'chkconfig --add nginx'
### BEGIN INIT INFO
# Provides:          nginx
# Required-Start:    $all
# Required-Stop:     $all# Default-Start:     2 3 4 5
# Default-Stop:      0 1 6
# Short-Description: starts the nginx web server
# Description:       starts nginx using start-stop-daemon
### END INIT INFO
# Author:   licess
# website:  http://lnmp.org
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
NAME=nginx
NGINX_BIN=/usr/local/nginx/sbin/$NAME
CONFIGFILE=/usr/local/nginx/conf/$NAME.conf
PIDFILE=/usr/local/nginx/logs/$NAME.pid
case "$1" in
    start)        echo -n "Starting $NAME... "

        if netstat -tnpl | grep -q nginx;then
            echo "$NAME (pid `pidof $NAME`) already running."
            exit 1   
        fi

        $NGINX_BIN -c $CONFIGFILE

        if [ "$?" != 0 ] ; then
            echo " failed"
            exit 1        else
            echo " done"
        fi
        ;;


    stop)    
       echo -n "Stoping $NAME... "


        if ! netstat -tnpl | grep -q nginx; then
            echo "$NAME is not running."
            exit 1   
        fi


        $NGINX_BIN -s stop    

        if [ "$?" != 0 ] ; then
            echo " failed. Use force-quit"
            exit 1   
        else
            echo " done"
        fi
        ;;


    status)    
        if netstat -tnpl | grep -q nginx; then
            PID=`pidof nginx`
            echo "$NAME (pid $PID) is running..."
        else
            echo "$NAME is stopped"
            exit 0        fi
        ;;


    force-quit)    
        echo -n "Terminating $NAME... "


        if ! netstat -tnpl | grep -q nginx; then
            echo "$NAME is not running."
            exit 1    
        fi


        kill `pidof $NAME`


        if [ "$?" != 0 ] ; then
            echo " failed"
            exit 1   
        else
            echo " done"
        fi
        ;;


    restart)    
        $0 stop
        sleep 1   
        $0 start
        ;;


    reload)        echo -n "Reload service $NAME... "


        if netstat -tnpl | grep -q nginx; then
            $NGINX_BIN -s reload        
            echo " done"
        else
            echo "$NAME is not running, can't reload."
            exit 1    
        fi
        ;;


    configtest)   
        echo -n "Test $NAME configure files... "


        $NGINX_BIN -t
        ;;   

    *)    
        echo "Usage: $0 start|stop|force-quit|restart|reload|status|configtest"
        exit 1
        ;;
esac

• 保存成功之后我们要对这个管理脚本设置一个权限：

chmod +x /etc/init.d/nginx

• 接下来我们可以看看这个脚本能否正确执行：

/etc/init.d/nginx restart

这个管理脚本支持的命令有start|stop|force-quit|restart|reload|status|configtest。

• 如果没有错误能正确执行，那我们可以开始把他加入启动项了：

sysv-rc-conf --list    # 我们先查看一下list中有没有我们刚刚加进去的这个nginx管理脚本
sysv-rc-conf nginx on  # 然后用这个命令添加开机自启动

二、运行Prometheus推流示例程序（Python编写）

运行如下命令：

roslaunch prometheus_detection web_cam0.launch     # 打开一个usb摄像头0
roslaunch prometheus_detection rtmp_stream.launch  # 开始推流

具体的Python推流代码如下（位置在）：

Prometheus/Modules/object_detection/py_nodes/rtmp_stream/ocv_rtmp_stream.py#!/usr/bin/env python

# -*- coding: utf-8 -*-
import rospy
from sensor_msgs.msg import Image
from geometry_msgs.msg import Pose, Point, Quaternion
from cv_bridge import CvBridge
from std_msgs.msg import String
from std_msgs.msg import Bool
import numpy as np
import cv2
import subprocess
import os
import yaml
import math
rospy.init_node('rtmp_stream', anonymous=True)
rtmp = r'rtmp://localhost:1935/live'
size_str = str(640) + 'x' + str(400)
command = ['ffmpeg',    '-y', '-an',    '-f', 'rawvideo',    '-vcodec','rawvideo',    '-pix_fmt', 'bgr24',    '-s', size_str,    '-r', '25',    '-i', '-',    '-c:v', 'libx264',    '-pix_fmt', 'yuv420p',    '-preset', 'ultrafast',    '-f', 'flv',    rtmp]
pipe = subprocess.Popen(  
  command,  
  shell=False,  
  stdin=subprocess.PIPE
  )

  def image_callback(imgmsg):  
       bridge = CvBridge()  
       frame = bridge.imgmsg_to_cv2(imgmsg, "bgr8")  
       # processing
       # end


       h, w = frame.shape[:2]  
       img_resize = 400
       if h > w:    
       h = int(float(h) / w * img_resize)   
       w = img_resize
       else:    
       w = int(float(w) / h * img_resize)    
       h = img_resize
       frame = cv2.resize(frame, (w, h))  
       frame = frame[:, :640, :]  
       pipe.stdin.write(frame.tostring())  
       cv2.imshow("cap", frame)  
       # cv2.imshow("area", area)
       cv2.waitKey(10)

def rtmp_stream(topic_name):  
     rospy.Subscriber(topic_name, Image, image_callback)  
     rospy.spin()

if __name__ == '__main__':  
     subscriber = rospy.get_param('~camera_topic', '/prometheus/camera/rgb/image_raw')  

     try:   
         rtmp_stream(subscriber)   
     except rospy.ROSInterruptException:   
         pass


     pipe.terminate()

• End -

技术发展的日新月异，阿木实验室将紧跟技术的脚步，不断把机器人行业最新的技术和硬件推荐给大家。看到经过我们培训的学员在技术上突飞猛进，是我们培训最大的价值。如果你在机器人行业，就请关注我们的公众号，我们将持续发布机器人行业最有价值的信息和技术。 阿木实验室致力于为机器人研发提供开源软硬件工具和课程服务，让研发更高效！