移动端设备管理平台 atx server2实践

Posted 2022-01-15 webdepofqws

目录

• 1、需求背景
• 2、初步调研
  • 2.1、云测试平台
  • 2.2、开源工具
  • 2.3、VNC
  • 2.4、企业内部自研云测试平台
• 3、ATX Server安装
  • 依赖环境
  • 安装rethinkdb
  • 安装atx server
• 4、安卓设备接入
• 5、Docker端口转发
• 5、小结

---

1、需求背景

• 移动设备（android和ios）异地调试，包括但不限于apk安装，功能测试，日志查看，屏幕截图等。
• 移动设备管理，重启，关机，网络管理等。
• 结合设备管理平台完成app UI自动化测试。
• 异常调试时延迟可接受，画质可接受。

2、初步调研

了解需求后便开始在网络上查看资料，大部分都是自动化工具的，关于设备管理平台的介绍很少。多番查阅之下，发现业内目前的移动端设备主要有以下几种：

2.1、云测试平台

• 优点：省心，机型多，服务全面。
• 缺点：费用不菲，部分是按照时间收费的。

2.2、开源工具

STF

• 优点：开源免费
• 缺点：网络延迟比较严重

atx server

这个是在TesterHome上看到的，感觉不错决定试一试，感谢作者。github地址如下：
https://github.com/openatx/atxserver2

2.3、VNC

Android VNC Server多年不更新，Android 5.x由于Pie的限制用不了，需要重新编译，过程略复杂，作为安卓未入门级选手果断直接放弃。

2.4、企业内部自研云测试平台

比如美团点评的云真机平台，知乎的云测试平台，这种的一般都是投入一个团队在研发，成本大。

3、ATX Server安装

我使用的机器是Ubuntu18，Windows平台推荐用源码安装。

依赖环境

• Python3
• rethinkdb

安装rethinkdb

官方安装手册地址：https://www.rethinkdb.com/docs/install/ 。根据平台选择对应的安装方法。官方给出的ubuntu安装方法如下：

source /etc/lsb-release && echo "deb http://download.rethinkdb.com/apt $DISTRIB_CODENAME main" | sudo tee /etc/apt/sources.list.d/rethinkdb.list
wget -qO- https://download.rethinkdb.com/apt/pubkey.gpg | sudo apt-key add -
sudo apt-get update

sudo apt-get install rethinkdb

无法定位到rethinkdb，有的网友说是http改成了https，修改后重新安装也不行。经过查阅资料，rethinkdb不支持ubuntu18,于是尝试用deb的包安装。下载倒数第四个。

下载地址：https://github.com/srh/rethinkdb/releases/tag/v2.3.6.srh.1

安装方法：

Run sudo dpkg -i foo.deb to install a deb package.

If you get a message about missing some dependencies, run sudo apt-get install -f to install them.

Then run rethinkdb --version to test that installation succeeded.

安装atx server

clone代码到本地

git clone https://github.com/openatx/atxserver2.git

安装curl工具

sudo apt install curl 

安装docker-compose

sudo curl -L https://github.com/docker/compose/releases/download/1.22.0/docker-compose-$(uname -s)-$(uname -m) -o /usr/local/bin/docker-compose

将当前用户假如docker组

sudo gpasswd -a $USER docker

编辑/etc/default/docker文件
加入如下配置

DOCKER_OPTS="-H tcp://127.0.0.1:4243 -H unix:///var/run/docker.sock"

重启docker或重启机器

service  docker restart

退出命令行，切换到代码docker-compose.yml所在目录，执行

docker-compose up

启动日志如下：

[email protected]:~/atx-server/atxserver2$ docker-compose up
Creating network "atxserver2_default" with the default driver
Pulling rethinkdb (rethinkdb:2.3.6)...
2.3.6: Pulling from library/rethinkdb
9811207f4eba: Pull complete
d7c48489ee79: Pull complete
bd3fe89ae346: Pull complete
1914a1a7f89d: Pull complete
bf26223d4854: Pull complete
Digest: sha256:37340d5fcc7b0e83eed0e699a6af5362a3d8ff19cf3f80819dcf75d6c5ebcc18
Status: Downloaded newer image for rethinkdb:2.3.6
Building web
Step 1/6 : FROM python:3.6
3.6: Pulling from library/python
6f2f362378c5: Pull complete
494c27a8a6b8: Pull complete
7596bb83081b: Pull complete
372744b62d49: Pull complete
615db220d76c: Pull complete
1865698adfb0: Pull complete
7159b3304cc0: Pull complete
ad0713808ef6: Pull complete
7ba593904573: Pull complete
Digest: sha256:904bc648c46a22d0bca62340785da841eaeb7099addb2fc4941a5a8b878c5ce7
Status: Downloaded newer image for python:3.6
 ---> 48c06762acf0
Step 2/6 : ADD . /app
 ---> abff59a2fca3
Step 3/6 : WORKDIR /app
 ---> Running in cc16e0af3f06
Removing intermediate container cc16e0af3f06
 ---> 61b746c8516d
Step 4/6 : RUN pip install -r requirements.txt
 ---> Running in 8faf64de476a
Collecting six (from -r requirements.txt (line 1))
  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting bunch (from -r requirements.txt (line 2))
  Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz
Collecting logzero (from -r requirements.txt (line 3))
  Downloading https://files.pythonhosted.org/packages/97/24/27295d318ea8976b12cf9cc51d82e7c7129220f6a3cc9e3443df3be8afdb/logzero-1.5.0-py2.py3-none-any.whl
Collecting tornado>=5.0 (from -r requirements.txt (line 4))
  Downloading https://files.pythonhosted.org/packages/03/3f/5f89d99fca3c0100c8cede4f53f660b126d39e0d6a1e943e95cc3ed386fb/tornado-6.0.2.tar.gz (481kB)
Collecting requests (from -r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)
Collecting apkutils-patch<=0.6.0,>=0.5.4 (from -r requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/d0/e3/fd4d547044b9fcf0af7eca25c055dc1169aadc47a3677eb5951426c9a66a/apkutils-patch-0.5.4.tar.gz (60kB)
Collecting rethinkdb==2.4.2.post1 (from -r requirements.txt (line 7))
  Downloading https://files.pythonhosted.org/packages/98/4b/b22065b2686f440f8eaa8a7326e96a442ce98b7b637d28529958b83b2128/rethinkdb-2.4.2.post1-py2.py3-none-any.whl (155kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl (158kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->-r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl (150kB)
Collecting idna<2.9,>=2.5 (from requests->-r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)
Collecting chardet<3.1.0,>=3.0.2 (from requests->-r requirements.txt (line 5))
  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
Collecting pyelftools (from apkutils-patch<=0.6.0,>=0.5.4->-r requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/fa/9a/0674cb1725196568bdbca98304f2efb17368b57af1a4bb3fc772c026f474/pyelftools-0.25.tar.gz (499kB)
Collecting cigam (from apkutils-patch<=0.6.0,>=0.5.4->-r requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/3c/d0/19ff49c1938aea4e0076ee084ca23845408cffb51582b2be975f926533b5/cigam-0.0.3-py3-none-any.whl
Collecting xmltodict (from apkutils-patch<=0.6.0,>=0.5.4->-r requirements.txt (line 6))
  Downloading https://files.pythonhosted.org/packages/28/fd/30d5c1d3ac29ce229f6bdc40bbc20b28f716e8b363140c26eff19122d8a5/xmltodict-0.12.0-py2.py3-none-any.whl
Building wheels for collected packages: bunch, tornado, apkutils-patch, pyelftools
  Building wheel for bunch (setup.py): started
  Building wheel for bunch (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c
  Building wheel for tornado (setup.py): started
  Building wheel for tornado (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/61/7e/7a/5e02e60dc329aef32ecf70e0425319ee7e2198c3a7cf98b4a2
  Building wheel for apkutils-patch (setup.py): started
  Building wheel for apkutils-patch (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/43/70/ff/194b6150b109c3143bf17d8821a21cb7060de738038b920c64
  Building wheel for pyelftools (setup.py): started
  Building wheel for pyelftools (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/55/2f/15/4ce6885a52f475de68c16f3116a94d2156d588390cdb6c507c
Successfully built bunch tornado apkutils-patch pyelftools
Installing collected packages: six, bunch, logzero, tornado, certifi, urllib3, idna, chardet, requests, pyelftools, cigam, xmltodict, apkutils-patch, rethinkdb
Successfully installed apkutils-patch-0.5.4 bunch-1.0.1 certifi-2019.3.9 chardet-3.0.4 cigam-0.0.3 idna-2.8 logzero-1.5.0 pyelftools-0.25 requests-2.22.0 rethinkdb-2.4.2.post1 six-1.12.0 tornado-6.0.2 urllib3-1.25.3 xmltodict-0.12.0
Removing intermediate container 8faf64de476a
 ---> 1fa1eb974541
Step 5/6 : ENTRYPOINT [ "scripts/wait-for-db.sh" ]
 ---> Running in 38527f1e1551
Removing intermediate container 38527f1e1551
 ---> b107d738e458
Step 6/6 : CMD ["python", "main.py"]
 ---> Running in 2c4b41cc5b10
Removing intermediate container 2c4b41cc5b10
 ---> 41a3cc6d72f4
Successfully built 41a3cc6d72f4
Successfully tagged atxserver2_web:latest
WARNING: Image for service web was built because it did not already exist. To rebuild this image you must use `docker-compose build` or `docker-compose up --build`.
Creating atxserver2_rethinkdb_1 ... done
Creating atxserver2_web_1       ... done
Attaching to atxserver2_rethinkdb_1, atxserver2_web_1
rethinkdb_1  | Recursively removing directory /data/rethinkdb_data/tmp
rethinkdb_1  | Initializing directory /data/rethinkdb_data
rethinkdb_1  | Running rethinkdb 2.3.6~0jessie (GCC 4.9.2)...
rethinkdb_1  | Running on Linux 4.15.0-34-generic x86_64
rethinkdb_1  | Loading data from directory /data/rethinkdb_data
rethinkdb_1  | Listening for intracluster connections on port 29015
rethinkdb_1  | Listening for client driver connections on port 28015
rethinkdb_1  | Listening for administrative HTTP connections on port 8080
rethinkdb_1  | Listening on cluster addresses: 127.0.0.1, 172.18.0.2
rethinkdb_1  | Listening on driver addresses: 127.0.0.1, 172.18.0.2
rethinkdb_1  | Listening on http addresses: 127.0.0.1, 172.18.0.2
rethinkdb_1  | Server ready, "32b5db1e779c_vxj" d1530d1a-a1e6-4c91-ba9a-09343c76dd16
web_1        | RethinkDB is running
web_1        | [I 190616 05:21:21 main:70] listen on port http://172.18.0.3:4000
web_1        | [I 190616 05:21:50 web:2246] 302 GET / (172.18.0.1) 1.69ms
web_1        | [I 190616 05:21:50 web:2246] 200 GET /login?next=%2F (172.18.0.1) 3.17ms
web_1        | [I 190616 05:21:50 web:2246] 200 GET /favicon.ico (172.18.0.1) 34.69ms
web_1        | [I 190616 05:22:00 web:2246] 302 POST /login (172.18.0.1) 307.36ms
web_1        | [I 190616 05:22:00 web:2246] 302 GET / (172.18.0.1) 9.53ms
web_1        | [I 190616 05:22:00 web:2246] 200 GET /devices (172.18.0.1) 18.83ms
web_1        | [I 190616 05:22:00 web:2246] 200 GET /static/vendor/fontawesome-5.7.2/css/all.css (172.18.0.1) 1.48ms

在浏览器地址栏输入：http://172.18.0.3:4000/devices，具体的地址见启动日志，页面如下：

至此，说明atx sever部署成功了，pull镜像的时间略长，耐心等等，接下来就是部署atxserver2-android-provider。

4、安卓设备接入

vim .bashrc,在环境变量中加入

SERVER_URL="http://172.18.0.3:4000" # 这个修改成自己的atxserver2地址
IMAGE="codeskyblue/atxserver2-android-provider"

保存后，source .bashrc 使之生效。然后执行命令：

docker pull $IMAGE

安装pillow

pip3 install pillow

安装wediter

pip3 install -U weditor

安装adb工具

apt-get install android-tools-adb

机器安装uiautomator2

pip install  --pre --upgrade uiautomator2

使用usb线连接上手机，打开开发者模式。查看当前机器上挂的设备

[email protected]:~$ adb  devices
List of devices attached
9fb1c6ae    device

初始化（可选步骤）

python3.6 -m uiautomator2 init

最后执行下面这条命令，该镜像会把所有必要的资源 （atx-uiautomator.apk, minicap, minitouch, atx-agent) 全部推送到手机上。安装时需要确认。

docker run --rm --privileged -v /dev/bus/usb:/dev/bus/usb --net host     $IMAGE python main.py --server $SERVER_URL

等待一切推送完成后，激动人心的时候到了，打开web端看一下效果。点击立即使用可以操作手机。

5、Docker端口转发

截至目前，部署成功，来尝试从别的机器访问web页面，发现无法打开，初步怀疑是防火墙的问题，后排除。导致无法访问的原因是：docker 需要设置端口。
列出容器信息：

[email protected]:~$ docker ps
CONTAINER ID        IMAGE                                     COMMAND                  CREATED             STATUS              PORTS                            NAMES
b0bae8e68a86        codeskyblue/atxserver2-android-provider   "python main.py --se…"   12 minutes ago      Up 12 minutes                                        affectionate_ardinghelli
7c5284cbdb9e        atxserver2_web                            "scripts/wait-for-db…"   5 hours ago         Up 4 hours          0.0.0.0:4000->4000/tcp           atxserver2_web_1
32b5db1e779c        rethinkdb:2.3.6                           "rethinkdb --bind all"   5 hours ago         Up 4 hours          8080/tcp, 28015/tcp, 29015/tcp   atxserver2_rethinkdb_1

查看容器地址：

docker inspect "web服务所在的容器id"| grep IPAddress

[email protected]:~/atx-server/atxserver2$ docker inspect 7c5284cbdb9e| grep IPAddress
            "SecondaryIPAddresses": null,
            "IPAddress": "",
                    "IPAddress": "172.18.0.3",

设置端口转发

iptables -t nat -A  DOCKER -p tcp --dport 4001 -j DNAT --to-destination 172.18.0.3:4000

然后使用地址：http://本机地址:4001 ，查看本机地址用ifconfig，然后就可以从其它机器上访问了。

5、小结

非常棒的一款工具，开源，简洁易用，期待更多新特性，不足之处是画质有点模糊，接下来实践一下IOS设备如何接入和是否能和appium集成。