Nginx K8s + Docker 部署 ，虚拟机部署教程。

Posted 2021-04-11 Java软件编程之家

nginx K8s + Docker 部署 ，虚拟机部署教程！

Linux 虚拟机 部署

1、下载nginx:

http://nginx.org/download/

2、选择一个版本进行下载：

wget http://nginx.org/download/nginx-1.14.0.tar.gz

3、解压：

tar -xvf nginx-1.14.0.tar.gz

4、安装依赖包：

yum -y install gcc pcre-devel zlib-devel openssl openssl-devel

5、编译、安装

cd $NGINX_HOME
./configure --prefix=/usr/local/nginx --with-http_stub_status_module --with-http_realip_module
makemake install

6、修改nginx.conf

#user nobody;worker_processes  1;#error_log logs/error.log;#error_log logs/error.log notice;#error_log logs/error.log info;#pid logs/nginx.pid;events { worker_connections 1024;}
http { include mime.types;    default_type  application/octet-stream; #log_format main '$remote_addr - $remote_user [$time_local] "$request" ' # '$status $body_bytes_sent "$http_referer" '    #                  '"$http_user_agent" "$http_x_forwarded_for"';    #access_log  logs/access.log  main; sendfile on;    #tcp_nopush     on; #keepalive_timeout 0;    keepalive_timeout  65; #gzip on; upstream admin-server { server 10.68.60.100:18060 max_fails=2 fail_timeout=30; server 10.68.60.101:18060 max_fails=2 fail_timeout=30; server 10.68.60.110:18060 max_fails=2 fail_timeout=30; }     upstream api-server { server 10.68.60.100:18082 max_fails=2 fail_timeout=30; server 10.68.60.101:18082 max_fails=2 fail_timeout=30; server 10.68.60.110:18082 max_fails=2 fail_timeout=30;    }
 server { listen 8080; server_name api-server;                keepalive_timeout       30; location / { proxy_pass http://api-server; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host;                        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_set_header Host $host:$server_port;

 } }
 server { listen 8081; server_name admin-server; keepalive_timeout 30; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;                proxy_set_header Host $host:$server_port; location / { proxy_pass http://admin-server; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;                        proxy_set_header Host $host:$server_port; }    }}

7、启动nginx:

$NGINX_HOMT/sbin/nginx

8、重启nginx:

$NGINX_HOMT/sbin/nginx -s stop$NGINX_HOMT/sbin/nginx

9、热更新：

$NGINX_HOMT/sbin/nginx -s reload

Docker + k8s 部署

前提：假定你已经安装并集成好docker和k8s基础环境！

1、创建docker构建目录：

mkdir -p /opt/docker/build/nginx

2、下载nginx：

cd /opt/docker/build/nginxwget http://nginx.org/download/nginx-1.14.0.tar.gz

3、编写Dockerfile，内容如下：

FROM ansible/centos7-ansible
ADD nginx-1.14.0.tar.gz /
RUN mkdir -p /opt/soft &&\ mkdir -p /opt/tarball &&\ mkdir -p /opt/src &&\ touch /opt/daemon.log &&\ mv /nginx-1.14.0 /opt/src &&\ yum -y install gcc pcre-devel zlib-devel openssl openssl-devel &&\ cd /opt/src/nginx-1.14.0 &&\ ./configure --prefix=/usr/local/nginx --with-http_stub_status_module --with-http_realip_module &&\ make &&\ make install &&\ cp -R /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

ENTRYPOINT [ "sh", "-c", "/usr/local/nginx/sbin/nginx && tail -f /opt/daemon.log" ]

4、构建docker 镜像：

cd /opt/docker/build/nginx
docker build --network host -t 10.68.60.103:5000/nginx:1.14.0 -f Dockerfile .

5、推送镜像到私服：

docker push 10.68.60.103:5000/nginx:1.14.0

6、编写k8s nginx-deployment.yaml文件，内容如下：

apiVersion: apps/v1kind: Deploymentmetadata: name: nginx-deployment namespace: my-namespace labels: app: nginx-deploymentspec: replicas: 1 selector: matchLabels: app: nginx-pod template: metadata: labels: app: nginx-pod spec: nodeSelector: deploy.nginx: "true" restartPolicy: Always containers: - name: nginx-container image: "10.68.60.103:5000/nginx:1.14.0" ports:# - containerPort: 80 volumeMounts: - mountPath: "/usr/local/nginx/conf/nginx.conf" name: "nginx-volume-conf" - mountPath: "/usr/local/nginx/logs" name: "nginx-volume-log" imagePullSecrets: - name: regcred volumes: - name: "nginx-volume-conf" hostPath: path: "/opt/apps-mgr/nginx/conf/nginx.conf" type: File - name: "nginx-volume-log" hostPath: path: "/opt/apps-mgr/nginx/logs" type: DirectoryOrCreate

注意：/opt/apps-mgr/nginx/conf/nginx.conf文件需要提前配置好,笔者这里配置文件如下：

#user nobody;worker_processes  1;#error_log logs/error.log;#error_log logs/error.log notice;#error_log logs/error.log info;#pid logs/nginx.pid;events { worker_connections 1024;}
http { include mime.types;    default_type  application/octet-stream; #log_format main '$remote_addr - $remote_user [$time_local] "$request" ' # '$status $body_bytes_sent "$http_referer" '    #                  '"$http_user_agent" "$http_x_forwarded_for"';    #access_log  logs/access.log  main; sendfile on;    #tcp_nopush     on; #keepalive_timeout 0;    keepalive_timeout  65; #gzip on; upstream admin-server { server 10.68.60.100:18060 max_fails=2 fail_timeout=30; server 10.68.60.101:18060 max_fails=2 fail_timeout=30; server 10.68.60.110:18060 max_fails=2 fail_timeout=30; }     upstream api-server { server 10.68.60.100:18082 max_fails=2 fail_timeout=30; server 10.68.60.101:18082 max_fails=2 fail_timeout=30; server 10.68.60.110:18082 max_fails=2 fail_timeout=30;    }
 server { listen 8080; server_name api-server;                keepalive_timeout       30; location / { proxy_pass http://api-server; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host;                        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_set_header Host $host:$server_port;

 } }
 server { listen 8081; server_name admin-server; keepalive_timeout 30; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;                proxy_set_header Host $host:$server_port; location / { proxy_pass http://admin-server; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;                        proxy_set_header Host $host:$server_port; }    }}

初步可以先用默认的配置，等启动成功后再修改，修改后需要进入Pod重启Nginx，进入命令如下：

kubectl get pods -A | grep nginxkubectl exec -it -n my-namespace nginx-deployment-5dcf489c44-f9c4r/usr/local/nginx/sbin/nginx -s stop && /usr/local/nginx/sbin/nginx

另外nodeSelector部分作用是指定nginx运行在某个节点上。需要提前通过下面命令给指定节点打上标签，例如指定允许在node2时：

kubectl label nodes node2 deploy.nginx=true

7、执行deployment：

kubectl apply -f nginx-deployment.yamlkubectl get pods -Akubectl -n my-namespace describe pod xxxxxkubectl -n my-namespace get events

8、编写k8s nginx-service.yaml文件，内容如下：

apiVersion: v1kind: Servicemetadata: namespace: my-namespace name: nginx-api-server-servicespec: type: NodePort selector: app: nginx-pod ports: - protocol: TCP port: 8080 targetPort: 8080      nodePort: 8080
---
apiVersion: v1kind: Servicemetadata: namespace: my-namespace name: nginx-admin-server-servicespec: type: NodePort selector: app: nginx-pod ports: - protocol: TCP port: 8081 targetPort: 8081 nodePort: 8081

9、执行service：

kubectl apply -f nginx-service.yamlkubectl get service -Akubectl -n my-namespace describe service xxxxxkubectl -n my-namespace get events

---------- 正文结束 ----------

Java软件编程之家