streamsets k8s 部署试用

Posted 2020-12-31 rongfengliang

使用k8s 进行 streamsets的部署（没有使用持久化存储）

k8s deploy yaml 文件

deploy.yaml

apiVersion: extensions/v1beta1
kind: Deployment
metadata:  
  name: streamsets
  namespace: big-data
  labels:
    app: streamsets
spec:
  replicas: 1
  template:
    metadata:
      labels:
        app: streamsets
    spec:
      containers:
      - name: streamsets
        image: streamsets/datacollector
        imagePullPolicy: IfNotPresent
        ports:
        - containerPort: 18630
        - containerPort: 8000
---

apiVersion: v1
kind: Service
metadata:
  name: streamsets
  namespace: big-data
spec:
  selector:
    app: streamsets
  ports:
  - name: http-ui
    port: 18630
    protocol: TCP
  - name: http-server
    port: 8000
    protocol: TCP
  type: NodePort

---

apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: streamsets
  namespace: big-data
spec:
  rules:
  - host: s.data.com
    http:
      paths:
      - backend:
          serviceName: streamsets
          servicePort: 18630
        path: /

说明

上边部署文件使用deploy 进行streamsets 部署，同时暴露了一个http serevr 端口（测试 microservice pipeline）
同时添加了k8s ingress 访问，以及一个service （nodeport 类型）,namespace big-data

部署

kubectl apply -f deploy.yaml

效果

登陆

简单microservice pipeline