Quick BI 本地安装部署 centos7(详细版)

Posted 张国荣家的弟弟

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Quick BI 本地安装部署 centos7(详细版)相关的知识,希望对你有一定的参考价值。

文章目录

部署前置工作

产品镜像准备

image.dbinit=reg.docker.alibaba-inc.com/quickbi/dbinit:ind_v4.3
image.driver=reg.docker.alibaba-inc.com/quickbi/base-biz-yunbi:ind_v4.3
image.executor=reg.docker.alibaba-inc.com/quickbi/base-biz-yunbi-executor:ind_v4.3
image.quickdata=reg.docker.alibaba-inc.com/quickbi/base-biz-yunbi:ind_v4.3
image.subscription=reg.docker.alibaba-inc.com/quickbi/quickbi-subscription:ind_v1.4

命令:

wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.3/base-biz-yunbi-executor-ind_v4.3.tar.gz
 wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.3/base-biz-yunbi-ind_v4.3.tar.gz
 wegt https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.3/dbinit-ind_v4.3.tar.gz
 wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.3/dbinit-ind_v4.3.tar.gz

服务器配置
qbi-driver-01
公:47.94.92.250 (连接所需)
私:172.17.31.173 (配置所需)
administrator:root
password:Biz65228680

qbi-executor-01
公:47.95.208.246 (连接所需)
私: 172.17.31.174 (配置所需)
administrator:root
password:Biz65228680

Mysql配置信息

db_name=quickbi,quickbi_demo
db_username=root
db_port=3306
db_host=172.17.31.173 公:47.94.92.250
db_password=Password@123

Redis配置信息
redis.url=172.17.31.173:6379
redis.password=Password@123

qbi-web登录
地址:http://47.94.92.250/
⽤户名:quickBiAdmin
密码:Bizinsight@xing.9711

前期准备

修改主机名
172.17.31.174 qbi-executor-01
172.17.31.173 qbi-driver-01
主机映射

172.17.31.174   qbi-executor-01 e1
172.17.31.173   qbi-driver-01   d1

vim /etc/hosts

免密登录




将生成的公钥追加到authorized_keys里面

命令:wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.2.3.3/base-biz-yunbi-executor-ind_v4.2.3.3.tar.gz

命令:wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.2.3.3/base-biz-yunbi-ind_v4.2.3.3.tar.gz

命令:wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/v4.2.3.3/dbinit-ind_v4.2.3.3.tar.gz

不是必须下载:
https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/common/monitor/iad-oxs-ind_v1.1.tar.gz
 https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/common/monitor/influxdb_1.8.4.tar.gz

查看当前下载的安装包
命令:ll

部署资源准备

https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/os-env-init.tar.gz
离线安装包,⽤于⽆法访问yum及docker源情形
https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/centos7-basic.tar.gz
https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/docker-ce-20.10.x86_64.tar.gz
https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/mysql-setup.tar.gz
https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/redis-setup.tar.gz
部署脚本,下载地址询问@嘉央 qbi_install_cmd.tar.gz

[root@iZ2zebfu2pfe982btcz2fuZ software]# wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/os-env-init.tar.gz
--2022-05-07 20:24:07--  https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/os-env-init.tar.gz
Resolving qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)... 47.95.85.41
Connecting to qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)|47.95.85.41|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2332848 (2.2M) [application/gzip]
Saving to: ‘os-env-init.tar.gz’

100%[=======================================================>] 2,332,848   --.-K/s   in 0.1s

2022-05-07 20:24:07 (23.2 MB/s) - ‘os-env-init.tar.gz’ saved [2332848/2332848]

[root@iZ2zebfu2pfe982btcz2fuZ software]# wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/softwa re/centos7-basic.tar.gz
--2022-05-07 20:24:35--  https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/centos7-basic.tar.gz
Resolving qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)... 47.95.85.41
Connecting to qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)|47.95.8 5.41|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 37074506 (35M) [application/gzip]
Saving to: ‘centos7-basic.tar.gz’

100%[=======================================================>] 37,074,506  15.3MB/s   in 2.3s

2022-05-07 20:24:37 (15.3 MB/s) - ‘centos7-basic.tar.gz’ saved [37074506/37074506]

[root@iZ2zebfu2pfe982btcz2fuZ software]# wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/docker-ce-20.10.x86_64.tar.gz
--2022-05-07 20:24:48--  https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/docker-ce-20.10.x86_64.tar.gz
Resolving qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)... 47.95.85.41
Connecting to qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)|47.95.85.41|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 112236029 (107M) [application/gzip]
Saving to: ‘docker-ce-20.10.x86_64.tar.gz’

100%[=======================================================>] 112,236,029 12.4MB/s   in 8.6s

2022-05-07 20:24:57 (12.5 MB/s) - ‘docker-ce-20.10.x86_64.tar.gz’ saved [112236029/112236029]

[root@iZ2zebfu2pfe982btcz2fuZ software]# wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/softwa  re/mysql-setup.tar.gz
--2022-05-07 20:25:16--  https://qbi-temp.oss-cn-beijing.aliyuncs.com/software/mysql-setup.tar.gz
Resolving qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)... 47.95.85.41
Connecting to qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)|47.95.85.41|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 147956537 (141M) [application/gzip]
Saving to: ‘mysql-setup.tar.gz’

100%[=======================================================>] 147,956,537 12.3MB/s   in 10s

2022-05-07 20:25:27 (13.5 MB/s) - ‘mysql-setup.tar.gz’ saved [147956537/147956537]

[root@iZ2zebfu2pfe982btcz2fuZ software]# wget https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickb                          i/common/monitor/influxdb_1.8.4.tar.gz
--2022-05-07 20:25:35--  https://qbi-temp.oss-cn-beijing.aliyuncs.com/quickbi/common/monitor/influxdb_1.8.4.tar.gz
Resolving qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)... 47.95.85.41
Connecting to qbi-temp.oss-cn-beijing.aliyuncs.com (qbi-temp.oss-cn-beijing.aliyuncs.com)|47.95.8 5.41|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 89275319 (85M) [application/gzip]
Saving to: ‘influxdb_1.8.4.tar.gz’

100%[===============================================================================================================>] 89,2

2022-05-07 20:25:42 (12.8 MB/s) - ‘influxdb_1.8.4.tar.gz’ saved [89275319/89275319]

Mysql 安装

说明:本MySQL部署⽅案不具备⾼可⽤能⼒,仅限于POC使⽤。
将 mysql-setup.tar.gz 拷贝⾄⽬标服务器,执⾏以下命令:
解压安装包
tar -zxxf mysql-setup.tar.gz

切换到解压的mysql目录
cd mysql/

若需⾃定义MySQL密码,则编辑 deploy_mysql.sh⽂件
vi deploy_mysql.sh
拉起 MySQL 容器
bash deploy_mysql.sh

检查服务启动状态
ss -ltnp |grep 3306

登录

创建数据库

create database quickbi charset = utf8;
create database quickbi_demo charset = utf8;


外部连接测

docker

将安装包放入目录: os-env-init/pgk/
不然安装docker命令不会成功!

脚本安装docker

显示compete,大致表示成功安装

查看容器是否现在成功
docker images
删除容器
docker rmi 900666ede12a0
查看已经运⾏的docker镜像
docker ps ##查看容器ID
docker rm 43asdf213421 ##删除运行镜像

启动容器

命令:docker info ## 查看docker当前信息
连接到 容器
命令:docker exec -it 容器ID bash

查看容器日志:

 docker logs b444a91f1aba

命令:ss -nltp
作用:显示更多更详细的有关 TCP 和连接状态的信息,而且比 netstat 更快

命令:grep db 文件
查文件下有关db的行

  1. Redis 安装(同上↑)
    说明:本Redis部署⽅案不具备⾼可⽤能⼒,仅限于POC使⽤。
    将 redis-setup.tar.gz 拷贝⾄⽬标服务器,执⾏以下命令:
    解压安装包
    tar xf redis-setup.tar.gz

cd redis/

#若需⾃定义Redis密码,则编辑 deploy_redis.sh⽂件
vi deploy_redis.sh
拉起 Redis 容器
bash deploy_redis.sh

#检查服务启动状态
ss -ltnp |grep 6379

qbi服务安装

解压:tar -zxvf os-env-init.tart.gz



移动

解压:tar -zxvf qbi_install_cmd.tar.gz


移动

操作系统初始化
将 os-env-init.tar.gz 拷⻉⾄跳板机并解压。若⽆客户环境⽆外⽹⽹络,则将 centos7-
basic.tar.gz、 docker-ce-20.10.x86_64.tar.gz 拷⻉⾄ os-env-init/pkg/ ⽬录,执⾏以下操作

根据部署资源修改 config.sh
vi config.sh

#!/bin/bash

declare -A hostname_map disk_lvm_vg_map disk_lvm_lv_map

hostname_map=(
  ['172.17.31.173']='qbi-driver-01'
  ['172.17.31.174']='qbi-executor-01'
)

disk_lvm_vg_map=(
  ['172.17.31.173']='vgdocker:/dev/vdb'
  ['172.17.31.174']='vgdocker:/dev/vdb'
)

disk_lvm_lv_map=(
  ['172.17.31.173']='vgdocker:/var/lib/docker/,FREE'
  ['172.17.31.174']='vgdocker:/var/lib/docker/,FREE'
)

jumpserver=172.17.31.173

# modify hostname
hostname_modify=true
# base & docker-ce yum repo
base_repo_available=true
docker_repo_available=false
# which user run docker commands
container_create_by="root"
# ssh login
ssh_private_file=/root/.ssh/id_rsa
ssh_passphrase=defalutLoginPassword

分发安装包⾄所有服务器并执⾏
sh main.sh init

查看初始化执⾏结果

sh main.sh show

切换到 qbi_install_cmd目录下

命令:vim config.properties.example


按ESC之后输入命令 :wq!

修改config.properties.example名字

命令:vim config.properties

# Images
image.dbinit=reg.docker.alibaba-inc.com/quickbi/dbinit:ind_v4.3
image.driver=reg.docker.alibaba-inc.com/quickbi/base-biz-yunbi:ind_v4.3
image.executor=reg.docker.alibaba-inc.com/quickbi/base-biz-yunbi-executor:ind_v4.3
image.quickdata=reg.docker.alibaba-inc.com/quickbi/base-biz-yunbi:ind_v4.3
image.subscription=reg.docker.alibaba-inc.com/quickbi/quickbi-subscription:ind_v1.4
image.iad-oxs=reg.docker.alibaba-inc21克:仅需3天,我们就用Quick BI搭建起数据驾驶舱

centos7安装部署本地局域网yum源

DataX 安装部署

Quick BI产品核心功能大图:Quick引擎加速--十亿数据亚秒级分析

使用power bi 部署到本地

Quick BI的可视分析之路