Operator-2从pod开始简单operator
Posted saynaihe
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Operator-2从pod开始简单operator相关的知识,希望对你有一定的参考价值。
背景:
前置内容:Operator-1初识Operator,从pod开始简单创建operator…
创建Pod
RedisSpec 增加Image字段
恩 强调一下 我故意在api/v1/redis_type.go中加一个字段。接下来该怎么操作呢?
先发布了一下crd
[zhangpeng@zhangpeng kube-oprator1]$ ./bin/controller-gen rbac:roleName=manager-role crd webhook paths="./..." output:crd:artifacts:config=config/crd/bases
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/crd | kubectl apply -f -
customresourcedefinition.apiextensions.k8s.io/redis.myapp1.zhangpeng.com configured
describe crd 配置里面已经有了Image字段!
[zhangpeng@zhangpeng kube-oprator1]$ kubectl describe crd redis.myapp1.zhangpeng.com
镜像要不要发布一下?
发布镜像的时候SetupWebhookWithManager打开了…不打开貌似发布了会报错
打包镜像image并发布
[zhangpeng@zhangpeng kube-oprator1]$ cd config/manager && kustomize edit set image controller=ccr.ccs.tencentyun.com/layatools/zpredis:v2
[zhangpeng@zhangpeng manager]$ cd ../../
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/default | kubectl apply -f -
注:当然了能使用原生的命令更好, 我这系统还是有问题的
继续强调一下SetupWebhookWithManager
发布完成继续关了main.go中 SetupWebhookWithManager,否则没法make run本地调试哦。
创建CreateRedis函数
helper/help_redis.go
package helper
import (
"context"
"fmt"
corev1 "k8s.io/api/core/v1"
v1 "kube-oprator1/api/v1"
"sigs.k8s.io/controller-runtime/pkg/client"
)
func CreateRedis(client client.Client, redisConfig *v1.Redis) error
newpod := &corev1.Pod
newpod.Name = podName
newpod.Namespace = redisConfig.Namespace
newpod.Spec.Containers = []corev1.Container
Name: redisConfig.Name,
Image: redisConfig.Spec.Image,
ImagePullPolicy: corev1.PullIfNotPresent,
Ports: []corev1.ContainerPort
ContainerPort: int32(redisConfig.Spec.Port),
,
,
,
return client.Create(context.Background(), newpod)
Reconcile调用CreateRedis函数
controlers/redis_controller.go
func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error)
_ = log.FromContext(ctx)
redis := &myapp1v1.Redis
if err := r.Get(ctx, req.NamespacedName, redis); err != nil
fmt.Println(err)
else
fmt.Println("object", redis)
err := helper.CreateRedis(r.Client, redis)
return ctrl.Result, err
return ctrl.Result, nil
make run test
注:其实也可以不make run了…都发布到集群中了, 可以到集群中查看operator日志了!
test/redis.go
apiVersion: myapp1.zhangpeng.com/v1
kind: Redis
metadata:
name: zhangpeng1
spec:
port: 6379
image: redis:latest
注意:特意搞了两个又创建了一个name为zhangpeng2的应用!
[zhangpeng@zhangpeng ~]$ kubectl get Redis
[zhangpeng@zhangpeng ~]$ kubectl get pods
创建成功!接着而来的是pod删除的问题:
[zhangpeng@zhangpeng ~]$ kubectl delete Redis zhangpeng2
[zhangpeng@zhangpeng ~]$ kubectl get pod
恩删除了zhangpeng2 Redis,but pod资源还存在,该怎么处理,让pod资源一起删除呢?
POD资源删除
参照:https://kubernetes.io/blog/2021/05/14/using-finalizers-to-control-deletion/
Finalizers
清理资源
清理一下资源删除webhook Redis 等相关资源
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get ValidatingWebhookConfiguration
NAME WEBHOOKS AGE
cert-manager-webhook 1 3d23h
kube-oprator1-validating-webhook-configuration 1 3d23h
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete ValidatingWebhookConfiguration
error: resource(s) were provided, but no name was specified
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete ValidatingWebhookConfiguration kube-oprator1-validating-webhook-configuration
validatingwebhookconfiguration.admissionregistration.k8s.io "kube-oprator1-validating-webhook-configuration" deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get MutatingWebhookConfiguration
NAME WEBHOOKS AGE
cert-manager-webhook 1 3d23h
kube-oprator1-mutating-webhook-configuration 1 3d23h
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete MutatingWebhookConfiguration kube-oprator1-mutating-webhook-configuration
mutatingwebhookconfiguration.admissionregistration.k8s.io "kube-oprator1-mutating-webhook-configuration" deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
NAME AGE
zhangpeng3 5m
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete Redis zhangpeng3
redis.myapp1.zhangpeng.com "zhangpeng3" deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete pods zhangpeng3
Error from server (NotFound): pods "zhangpeng3" not found
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
No resources found in default namespace.
这样作吧,还是为了本地调试方便,否则一些本地的修改,增加字段就要重新打包,发布,太麻烦了。老老实实make run 本地调试模式,待调试完成后再发布应用到集群,这才是正常的流程!
需求: 删除Redis 对应pod 可以删除,pod可以多副本。zhangpeng-0 zhangpeng-1 zhangpeng-3的顺序。更新策略,缩容策略。恩这是我想到的!当然了pod如果使用deployment 或者statefulset会更简单一些。这里还是拿pod演示了!
RedisSpec增加副本数量字段
修改api/v1/redis_types.go中RedisSpec struct,增加如下配置:
//+kubebuilder:validation:Minimum:=1
//+kubebuilder:validation:Maximum:=5
Num int `json:"num,omitempty"`
num字段为pod副本数量字段,依着port配置把副本数量做了一个1-5的限制!
继续发布一下crd:
[zhangpeng@zhangpeng kube-oprator1]$ ./bin/controller-gen rbac:roleName=manager-role crd webhook paths="./..." output:crd:artifacts:config=config/crd/bases
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/crd | kubectl apply -f -
customresourcedefinition.apiextensions.k8s.io/redis.myapp1.zhangpeng.com configured
[zhangpeng@zhangpeng kube-oprator1]$ kubectl describe crd redis.myapp1.zhangpeng.com
确认crd中产生对应字段:
help_redis.go
修改helper/help_redis.go如下:
package helper
import (
"context"
"fmt"
corev1 "k8s.io/api/core/v1"
v1 "kube-oprator1/api/v1"
"sigs.k8s.io/controller-runtime/pkg/client"
)
//拼装Pod名称列表
func GetRedisPodNames(redisConfig *v1.Redis) []string
podNames := make([]string, redisConfig.Spec.Num)
for i := 0; i < redisConfig.Spec.Num; i++
podNames[i] = fmt.Sprintf("%s-%d", redisConfig.Name, i)
fmt.Println("podnames:", podNames)
return podNames
//判断对应名称的pod在finalizer中是否存在
func IsExist(podName string, redis *v1.Redis) bool
for _, pod := range redis.Finalizers
if podName == pod
return true
return false
//创建pod
func CreateRedis(client client.Client, redisConfig *v1.Redis, podName string) (string, error)
if IsExist(podName, redisConfig)
return "", nil
newpod := &corev1.Pod
newpod.Name = podName
newpod.Namespace = redisConfig.Namespace
newpod.Spec.Containers = []corev1.Container
Name: podName,
Image: redisConfig.Spec.Image,
ImagePullPolicy: corev1.PullIfNotPresent,
Ports: []corev1.ContainerPort
ContainerPort: int32(redisConfig.Spec.Port),
,
,
,
return podName, client.Create(context.Background(), newpod)
修改controllers/redis_controller.go:
import (
"context"
"fmt"
v1 "k8s.io/api/core/v1"
"k8s.io/apimachinery/pkg/api/errors"
metav1 "k8s.io/apimachinery/pkg/apis/meta/v1"
"k8s.io/apimachinery/pkg/runtime"
"k8s.io/client-go/tools/record"
myapp1v1 "kube-oprator1/api/v1"
"kube-oprator1/helper"
ctrl "sigs.k8s.io/controller-runtime"
"sigs.k8s.io/controller-runtime/pkg/client"
"sigs.k8s.io/controller-runtime/pkg/log"
)
func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error)
_ = log.FromContext(ctx)
// TODO(user): your logic here
redis := &myapp1v1.Redis
if err := r.Client.Get(ctx, req.NamespacedName, redis); err != nil
if errors.IsNotFound(err)
return ctrl.Result, nil
return ctrl.Result, err
//取得需要创建的POD副本的名称
podNames := helper.GetRedisPodNames(redis)
fmt.Println("podNames,", podNames)
updateFlag := false
//删除POD,删除Kind:Redis过程中,会自动加上DeletionTimestamp字段,据此判断是否删除了自定义资源
if !redis.DeletionTimestamp.IsZero()
fmt.Println(ctrl.Result, r.clearRedis(ctx, redis))
return ctrl.Result, r.clearRedis(ctx, redis)
//创建POD
for _, podName := range podNames
finalizerPodName, err := helper.CreateRedis(r.Client, redis, podName)
if err != nil
fmt.Println("create pod failue,", err)
return ctrl.Result, err
if finalizerPodName == ""
continue
//若该pod已经不在finalizers中,则添加
redis.Finalizers = append(redis.Finalizers, finalizerPodName)
updateFlag = true
//更新Kind Redis状态
if updateFlag
err := r.Client.Update(ctx, redis)
if err != nil
return ctrl.Result, err
return ctrl.Result, nil
//删除POD逻辑
func (r *RedisReconciler) clearRedis(ctx context.Context, redis *myapp1v1.Redis) error
//从finalizers中取出podName,然后执行删除
for _, finalizer := range redis.Finalizers
//删除pod
err := r.Client.Delete(ctx, &v1.Pod
ObjectMeta: metav1.ObjectMeta
Name: finalizer,
Namespace: redis.Namespace,
,
)
if err != nil
return err
//清空finializers,只要它有值,就无法删除Kind
redis.Finalizers = []string
return r.Client.Update(ctx, redis)
make run & test
控制台运行make run&&控制台2运行apply命令:
[zhangpeng@zhangpeng kube-oprator1]$ kubectl apply -f test/redis.yaml
redis.myapp1.zhangpeng.com/zhangpeng3 configured
test/redis.yaml
apiVersion: myapp1.zhangpeng.com/v1
kind: Redis
metadata:
name: zhangpeng3
spec:
port: 6379
num: 2
image: redis:latest
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
[zhangpeng@zhangpeng kube-oprator1]$ kubectl apply -f test/redis.yaml
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis/zhangpeng3 -o yaml
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete test/redis.yaml
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
紧接着问题又来了:
创建副本为2:
修改副本数为3:
紧接着缩容副本为2,会出现怎么操作呢?
没有自动去调度,现在需要一个自动缩容的方法…
Pod资源缩容
pod的标签定义的是zhangpeng-0 zhangpeng-1 zhangpeng-2的类型,扩容是 0 1 2 3 4的递增模式,缩容也从4 3 2 1 0依次去删除 pod
注意:默认情况下前面一步的Redis资源已经删除(kubectl delete -f test/redis.yaml)
Reconcile修改
controllers/redis_controller.go 中Reconcile修改为如下:
func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error)
_ = log.FromContext(ctx)
// TODO(user): your logic here
redis := &myapp1v1.Redis
if err := r.Client.Get(ctx, req.NamespacedName, redis); err != nil
if errors.IsNotFound(err)
return ctrl.Result, nil
fmt.Println("object", redis)
if !redis.DeletionTimestamp.IsZero() || len(redis.Finalizers) > redis.Spec.Num
return ctrl.Result, r.clearRedis(ctx, redis)
if !redis.DeletionTimestamp.IsZero() || len(redis.Finalizers) > redis.Spec.Num
return ctrl.Result, r.clearRedis(ctx, redis)
podNames := helper.GetRedisPodNames(redis)
fmt.Println("podNames,", podNames)
updateFlag := false
for _, podName := range podNames
finalizerPodName, err := helper.CreateRedis(r.Client, redis, podName)
if err != nil
fmt.Println("create pod failue,", err)
return ctrl.Result, err
if finalizerPodName == ""
continue
redis.Finalizers = append(redis.Finalizers, finalizerPodName)
updateFlag = true
//更新Kind Redis状态
if updateFlag
err := r.Client.Update(ctx, redis)
if err != nil
return ctrl.Result, err
return ctrl.Result, nil
func (r *RedisReconciler) clearRedis(ctx context.Context, redis *myapp1v1.Redis) error
/*
//finalizers > num 可能出现,删除差值部分
//finalizers = num 可能出现,删除全部
//finalizers < num 不可能出现
*/
var deletedPodNames []string
//删除finalizers切片的最后的指定元素
position := redis.Spec.Num
if (len(redis.Finalizers) - redis.Spec.Num) > 0
deletedPodNames = redis.Finalizers[position:]
redis.Finalizers = redis.Finalizers[:position]
else
deletedPodNames = redis.Finalizers[:position]
redis.Finalizers = []string
fmt.Println("deletedPodNames", deletedPodNames)
fmt.Println("redis.Finalizers", redis.Finalizers)
for _, finalizer := range deletedPodNames
//删除pod
err := r.Client.Delete(ctx, &v1.Pod
ObjectMeta: metav1.ObjectMeta
Name: finalizer,
Namespace: redis.Namespace,
,
)
if err != nil
return err
redis.Finalizers = []string
return r.Client.Update(ctx, redis)
make run 开始测试
控制台执行make run…控制台2 执行apply -f test/redis.yaml创建3个副本pod
apiVersion: myapp1.zhangpeng.com/v1
kind: Redis
metadata:
name: zhangpeng3
spec:
port: 6379
num: 3
image: redis:latest
修改yaml副本数量为2,缩容pod apply yaml文件,缩容成功,删除了zhangpeng3-2pod!
but!问题来了我接着想扩容副本数量到3…不能正常操作了…不能生成新的pod
观查一下make run报错…
删除这几个资源重新来一遍,仔细观察一下步骤看看缺少了什么:
删除资源的时候明显发现绑定到pod跟Redis的资源没有绑定了?
apply yaml 副本数量为2, Finalizers中数据:
修改副本数为2…这 标签就没有了?
继续修改副本数为3…恩问题应该还是出在绑定finalizers这里…
最终代码如下:
以下代码摘抄自https://github.com/ls-2018/k8s-kustomize
实现扩容缩容删除恢复:
helper/redis_help.redis
package helper
import (
"context"
"fmt"
corev1 "k8s.io/api/core/v1"
"k8s.io/apimachinery/pkg/runtime"
"k8s.io/apimachinery/pkg/types"
v1 "kube-oprator1/api/v1"
"sigs.k8s.io/controller-runtime/pkg/client"
"sigs.k8s.io/controller-runtime/pkg/controller/controllerutil"
)
func GetRedisPodNames(redisConfig *v1.Redis) []string
podNames := make([]string, redisConfig.Spec.Num)
fmt.Printf("%+v", redisConfig)
for i := 0; i < redisConfig.Spec.Num; i++
podNames[i] = fmt.Sprintf("%s-%d", redisConfig.Name, i)
fmt.Println("PodNames: ", podNames)
return podNames
// 判断 redis pod 是否能获取
func IsExistPod(podName string, redis *v1.Redis, client client.Client) bool
err := client.Get(context.Background(), types.NamespacedName
Namespace: redis.Namespace,
Name: podName,
,
&corev1.Pod,
)
if err != nil
return false
return true
func IsExistInFinalizers(podName string, redis *v1.Redis) bool
for _, fPodName := range redis.Finalizers
if podName == fPodName
return true
return false
func CreateRedis(client client.Client, redisConfig *v1.Redis, podName string, schema *runtime.Scheme) (string, error)
if IsExistPod(podName, redisConfig, client)
return podName, nil
newPod := &corev1.Pod
newPod.Name = podName
newPod.Namespace = redisConfig.Namespace
newPod.Spec.Containers =append(newPod.Spec.Containers, []corev1.Container
Name: redisConfig.Name,
Image: redisConfig.Spec.Image,
ImagePullPolicy: corev1.PullIfNotPresent,
Ports: []corev1.ContainerPort
ContainerPort: int32(redisConfig.Spec.Port),
,
,
)
// set owner reference
err := controllerutil.SetControllerReference(redisConfig, newPod, schema)
if err != nil
return "", err
return podName, client.Create(context.Background(), newPod)
controllers/redis_controller.go
/*
Copyright 2022 zhang peng.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
*/
package controllers
import (
"context"
"fmt"
corev1 "k8s.io/api/core/v1"
metav1 "k8s.io/apimachinery/pkg/apis/meta/v1"
"k8s.io/apimachinery/pkg/runtime"
"k8s.io/apimachinery/pkg/types"
"k8s.io/client-go/tools/record"
"k8s.io/client-go/util/workqueue"
myapp1v1 "kube-oprator1/api/v1"
"kube-oprator1/helper"
ctrl "sigs.k8s.io/controller-runtime"
"sigs.k8s.io/controller-runtime/pkg/client"
"sigs.k8s.io/controller-runtime/pkg/controller/controllerutil"
"sigs.k8s.io/controller-runtime/pkg/event"
"sigs.k8s.io/controller-runtime/pkg/handler"
"sigs.k8s.io/controller-runtime/pkg/log"
"sigs.k8s.io/controller-runtime/pkg/reconcile"
"sigs.k8s.io/controller-runtime/pkg/source"
)
// RedisReconciler reconciles a Redis object
type RedisReconciler struct
client.Client
Scheme *runtime.Scheme
EventRecord record.EventRecorder
//+kubebuilder:rbac:groups=myapp1.zhangpeng.com,resources=redis,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=myapp1.zhangpeng.com,resources=redis/status,verbs=get;update;patch
//+kubebuilder:rbac:groups=myapp1.zhangpeng.com,resources=redis/finalizers,verbs=update
// Reconcile is part of the main kubernetes reconciliation loop which aims to
// move the current state of the cluster closer to the desired state.
// TODO(user): Modify the Reconcile function to compare the state specified by
// the Redis object against the actual cluster state, and then
// perform operations to make the cluster state reflect the state specified by
// the user.
//
// For more details, check Reconcile and its Result here:
// - https://pkg.go.dev/sigs.k8s.io/controller-runtime@v0.11.2/pkg/reconcile
func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error)
_ = log.FromContext(ctx)
redis := &myapp1v1.Redis
// 删除后会往这发一个请求,只有NamespacedName数据,别的都没有
if err := r.Get(ctx, req.NamespacedName, redis); err != nil
return ctrl.Result, nil
// 正在删除
if !redis.DeletionTimestamp.IsZero()
return ctrl.Result, r.clearPods(context.Background(), redis)
// TODO pod 个数变动
podNames := helper.GetRedisPodNames(redis)
var err error
if redis.Spec.Num > len(redis.Finalizers)
err = r.UpPods(ctx, podNames, redis)
if err == nil
fmt.Printf("%d", redis.Spec.Num)
//r.EventRecord.Event(redis, corev1.EventTypeNormal, "UpPods", fmt.Sprintf("%d", redis.Spec.Num))
else
// r.EventRecord.Event(redis, corev1.EventTypeWarning, "DownPods", fmt.Sprintf("%d", redis.Spec.Num))
else if redis.Spec.Num < len(redis.Finalizers)
err = r.DownPods(ctx, podNames, redis)
if err == nil
// r.EventRecord.Event(redis, corev1.EventTypeNormal, "DownPods", fmt.Sprintf("%d", redis.Spec.Num))
else
// r.EventRecord.Event(redis, corev1.EventTypeWarning, "DownPods", fmt.Sprintf("%d", redis.Spec.Num))
redis.Status.RedisNum = len(redis.Finalizers)
else
for _, podName := range redis.Finalizers
if helper.IsExistPod(podName, redis, r.Client)
continue
else
// 重建此pod
err = r.UpPods(ctx, []stringpodName, redis)
if err != nil
return ctrl.Result, err
r.Status().Update(ctx, redis)
return ctrl.Result, err
// SetupWithManager sets up the controller with the Manager.
func (r *RedisReconciler) SetupWithManager(mgr ctrl.Manager) error
return ctrl.NewControllerManagedBy(mgr).
For(&myapp1v1.Redis).
Watches(&source.KindType: &corev1.Pod, handler.Funcs
CreateFunc: nil,
UpdateFunc: nil,
DeleteFunc: r.podDeleteHandler,
GenericFunc: nil,
).
Complete(r)
// 对于用户主动 删除的pod 需要重新创建
func (r *RedisReconciler) podDeleteHandler(event event.DeleteEvent, limitingInterface workqueue.RateLimitingInterface)
fmt.Printf(`######################
%s
######################
`, event.Object.GetName())
for _, ref := range event.Object.GetOwnerReferences()
if ref.Kind == r.kind() && ref.APIVersion == r.apiVersion()
//触发 Reconcile
limitingInterface.Add(reconcile.Request
NamespacedName: types.NamespacedName
Namespace: event.Object.GetNamespace(),
Name: ref.Name,
,
)
func (r *RedisReconciler) kind() string
return "Redis"
func (r *RedisReconciler) apiVersion() string
return "myapp1.zhangpeng.com/v1"
func (r *RedisReconciler) clearPods(ctx context.Context, redis *myapp1v1.Redis) error
for _, podName := range redis.Finalizers
err := r.Client.Delete(ctx, &corev1.Pod
ObjectMeta: metav1.ObjectMeta
Name: podName,
Namespace: redis.Namespace,
,
)
//TODO 如果pod已经被删除、
if err != nil
return err
redis.Finalizers = []string
return r.Client.Update(ctx, redis)
func (r *RedisReconciler) DownPods(ctx context.Context, podNames []string, redis *myapp1v1.Redis) error
for i := len(redis.Finalizers) - 1; i >= len(podNames); i--
if !helper.IsExistPod(redis.Finalizers[i], redis, r.Client)
continue
err := r.Client.Delete(ctx, &corev1.Pod
ObjectMeta: metav1.ObjectMeta
Name: redis.Finalizers[i],
Namespace: redis.Namespace,
,
)
if err != nil
return err
redis.Finalizers = append(redis.Finalizers[:0], redis.Finalizers[:len(podNames)]...)
return r.Client.Update(ctx, redis)
func (r *RedisReconciler) UpPods(ctx context.Context, podNames []string, redis *myapp1v1.Redis) error
for _, podName := range podNames
podName, err := helper.CreateRedis(r.Client, redis, podName, r.Scheme)
if err != nil
return err
if controllerutil.ContainsFinalizer(redis, podName)
continue
redis.Finalizers = append(redis.Finalizers, podName)
err := r.Client.Update(ctx, redis)
return err
删除zhangpeng3 Redis
基本功能算是完成了,测试一下Pod重建:
其他的
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
api/v1/redis_types.go
// RedisStatus defines the observed state of Redis
type RedisStatus struct
RedisNum int `json:"num,omitempty"`
//下面两个注释对应的是 kubectl get Redis 看到的状态
//+kubebuilder:printcolumn:JSONPath=".status.num",name=NUM,type=integer
//+kubebuilder:printcolumn:JSONPath=".metadata.creationTimestamp",name=AGE,type=date
//+kubebuilder:object:root=true
//+kubebuilder:subresource:status
[zhangpeng@zhangpeng kube-oprator1]$ make install
[zhangpeng@zhangpeng kube-oprator1]$ make run
看一下config/crd/bases/myapp1.zhangpeng.com_redis.yaml
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
增加Event事件支持
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
NAME NUM AGE
zhangpeng3 2 82m
[zhangpeng@zhangpeng kube-oprator1]$ kubectl describe Redis zhangpeng3
观察我redis_controller.go代码的时候发现我注释了这些代码…这些其实就是event的输出,不知道怎么会事情就空指针报错了 ,就注释掉了!
什么原因呢?参照:https://github.com/767829413/learn-to-apply/blob/3621065003918070635880c3348f1d72bf6ead88/docs/Kubernetes/kubernetes-secondary-development.md
修改main.go
if err = (&controllers.RedisReconciler
Client: mgr.GetClient(),
Scheme: mgr.GetScheme(),
EventRecord: mgr.GetEventRecorderFor("myapp1.zhangpeng.com"), //名称任意
).SetupWithManager(mgr); err != nil
setupLog.Error(err, "unable to create controller", "controller", "Redis")
os.Exit(1)
注:刚才修改副本为2了,又修改成4进行测试的!
最终打包发布:
webhook
打包发布第一步骤如果开启webhook
IMG build
[zhangpeng@zhangpeng kube-oprator1]$ make install
[zhangpeng@zhangpeng kube-oprator1]$ make docker-build docker-push IMG=ccr.ccs.tencentyun.com/layatools/zpredis:v5
Dockerfile中增加一下配置:
COPY helper/ helper/
继续执行构建上传镜像:
[zhangpeng@zhangpeng kube-oprator1]$ make docker-build docker-push IMG=ccr.ccs.tencentyun.com/layatools/zpredis:v5
发布
正常流程:
[zhangpeng@zhangpeng kube-oprator1]$ make deploy IMG=ccr.ccs.tencentyun.com/layatools/zpredis:v5
由于 我的环境问题还要拆解一下命令:
[zhangpeng@zhangpeng kube-oprator1]$ cd config/manager && kustomize edit set image controller=ccr.ccs.tencentyun.com/layatools/zpredis:v5
[zhangpeng@zhangpeng manager]$ cd ../../
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/default | kubectl apply -f -
权限
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods -n kube-oprator1-system
NAME READY STATUS RESTARTS AGE
kube-oprator1-controller-manager-84c7dcf9fc-xxnk8 2/2 Running
[zhangpeng@zhangpeng kube-oprator1]$ kubectl logs -f kube-oprator1-controller-manager-84c7dcf9fc-xxnk8 -n kube-oprator1-system
恩 权限不够 临时搞一个clusterrolebinding :
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get sa kube-oprator1-controller-manager -n kube-oprator1-system -o yaml
apiVersion: v1
kind: ServiceAccount
metadata:
annotations:
kubectl.kubernetes.io/last-applied-configuration: |
"apiVersion":"v1","kind":"ServiceAccount","metadata":"annotations":,"name":"kube-oprator1-controller-manager","namespace":"kube-oprator1-system"
creationTimestamp: "2022-06-30T以上是关于Operator-2从pod开始简单operator的主要内容,如果未能解决你的问题,请参考以下文章