Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] apecloud mysql hscale pod crash upgrade from 0.8.3 to 0.9.0 #7537

Closed
JashBook opened this issue Jun 13, 2024 · 1 comment · Fixed by apecloud/kubeblocks-addons#696
Closed

[BUG] apecloud mysql hscale pod crash upgrade from 0.8.3 to 0.9.0 #7537

JashBook opened this issue Jun 13, 2024 · 1 comment · Fixed by apecloud/kubeblocks-addons#696
Assignees
@xuriwuyun
Labels
area/upgrade kind/bug Something isn't working severity/major Great chance user will encounter the same problem
Milestone
Release 0.8.4

Comments

@JashBook
Copy link
Collaborator

JashBook commented Jun 13, 2024 •
edited
Loading

Describe the bug

kbcli version
Kubernetes: v1.27.13-gke.1000000
KubeBlocks: 0.9.0-beta.32
kbcli: 0.9.0-beta.24

To Reproduce
Steps to reproduce the behavior:

  1. install kb 0.8.3
  2. create apecloud mysql
  3. upgrade kb to 0.9.0
  4. hscale mysql component 3 to 4
kbcli cluster hscale scale-jwsbig --auto-approve --force=true --components mysql --replicas 4
  1. see error
➜  ~ kubectl get cluster scale-jwsbig 
NAME           CLUSTER-DEFINITION   VERSION           TERMINATION-POLICY   STATUS     AGE
scale-jwsbig   apecloud-mysql       ac-mysql-8.0.30   DoNotTerminate       Abnormal   7h34m
➜  ~ 
➜  ~ kubectl get pod -l app.kubernetes.io/instance=scale-jwsbig
NAME                          READY   STATUS             RESTARTS        AGE
scale-jwsbig-mysql-0          5/5     Running            3 (4h13m ago)   7h34m
scale-jwsbig-mysql-1          5/5     Running            1 (4h13m ago)   4h14m
scale-jwsbig-mysql-2          5/5     Running            0               4h14m
scale-jwsbig-mysql-3          3/5     CrashLoopBackOff   92 (2m1s ago)   3h33m
scale-jwsbig-vtcontroller-0   3/3     Running            0               4h14m
scale-jwsbig-vtgate-0         1/1     Running            0               7h34m

kbcli cluster list-instances scale-jwsbig --namespace default 
    
NAME                          NAMESPACE   CLUSTER        COMPONENT      STATUS             ROLE       ACCESSMODE   AZ              CPU(REQUEST/LIMIT)   MEMORY(REQUEST/LIMIT)   STORAGE     NODE                                                               CREATED-TIME                 
scale-jwsbig-mysql-0          default     scale-jwsbig   mysql          Running            leader     <none>       us-central1-a   500m / 500m          1Gi / 1Gi               data:20Gi   gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-2aca1de0-304m/10.128.0.103   Jun 13,2024 13:18 UTC+0800   
scale-jwsbig-mysql-1          default     scale-jwsbig   mysql          Running            follower   <none>       us-central1-b   500m / 500m          1Gi / 1Gi               data:20Gi   gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-00d21d2d-km13/10.128.0.50    Jun 13,2024 16:38 UTC+0800   
scale-jwsbig-mysql-2          default     scale-jwsbig   mysql          Running            follower   <none>       us-central1-c   500m / 500m          1Gi / 1Gi               data:20Gi   gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-a41dac87-ktx5/10.128.0.102   Jun 13,2024 16:38 UTC+0800   
scale-jwsbig-mysql-3          default     scale-jwsbig   mysql          CrashLoopBackOff   <none>     <none>       us-central1-a   500m / 500m          1Gi / 1Gi               data:20Gi   gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-2aca1de0-0b6m/10.128.0.104   Jun 13,2024 17:19 UTC+0800   
scale-jwsbig-vtcontroller-0   default     scale-jwsbig   vtcontroller   Running            <none>     <none>       us-central1-c   500m / 500m          128Mi / 128Mi           data:20Gi   gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-a41dac87-ktx5/10.128.0.102   Jun 13,2024 16:37 UTC+0800   
scale-jwsbig-vtgate-0         default     scale-jwsbig   vtgate         Running            <none>     <none>       us-central1-c   500m / 500m          500Mi / 500Mi           <none>      gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-a41dac87-f632/10.128.0.100   Jun 13,2024 13:18 UTC+0800

descrobe pod

kubectl describe pod scale-jwsbig-mysql-3 
Name:         scale-jwsbig-mysql-3
Namespace:    default
Priority:     0
Node:         gke-cicd-gke-ed5hltz-cicd-gke-ed5hltz-2aca1de0-0b6m/10.128.0.104
Start Time:   Thu, 13 Jun 2024 17:19:21 +0800
Labels:       app.kubernetes.io/component=mysql
              app.kubernetes.io/instance=scale-jwsbig
              app.kubernetes.io/managed-by=kubeblocks
              app.kubernetes.io/name=apecloud-mysql
              app.kubernetes.io/version=
              apps.kubeblocks.io/cluster-uid=f82e85ef-1ed2-4918-ad47-412457faaf4a
              apps.kubeblocks.io/component-name=mysql
              apps.kubeblocks.io/pod-name=scale-jwsbig-mysql-3
              clusterdefinition.kubeblocks.io/name=apecloud-mysql
              clusterversion.kubeblocks.io/name=ac-mysql-8.0.30
              controller-revision-hash=5f6f777ccd
              helm.sh/chart=apecloud-mysql-cluster-0.8.0
              workloads.kubeblocks.io/instance=scale-jwsbig-mysql
              workloads.kubeblocks.io/managed-by=InstanceSet
Annotations:  apps.kubeblocks.io/component-replicas: 4
Status:       Running
IP:           10.92.7.30
IPs:
  IP:           10.92.7.30
Controlled By:  InstanceSet/scale-jwsbig-mysql
Containers:
  mysql:
    Container ID:  containerd://580443d359b1ff8884c786c53c7a5d386de89e0b5f062d405725705b31b2d806
    Image:         infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/apecloud-mysql-server:8.0.30-5.beta3.20240330.g94d1caf.15
    Image ID:      infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/apecloud-mysql-server@sha256:6e2c0daa38d2fc38d38c702d27eca1ec89d18eb3a15a349acadebed8661358eb
    Ports:         3306/TCP, 13306/TCP
    Host Ports:    0/TCP, 0/TCP
    Command:
      /scripts/setup.sh
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Thu, 13 Jun 2024 20:50:39 +0800
      Finished:     Thu, 13 Jun 2024 20:50:39 +0800
    Ready:          False
    Restart Count:  46
    Limits:
      cpu:     500m
      memory:  1Gi
    Requests:
      cpu:     500m
      memory:  1Gi
    Environment Variables from:
      scale-jwsbig-mysql-env      ConfigMap  Optional: false
      scale-jwsbig-mysql-rsm-env  ConfigMap  Optional: false
    Environment:
      KB_POD_NAME:            scale-jwsbig-mysql-3 (v1:metadata.name)
      KB_POD_UID:              (v1:metadata.uid)
      KB_NAMESPACE:           default (v1:metadata.namespace)
      KB_SA_NAME:              (v1:spec.serviceAccountName)
      KB_NODENAME:             (v1:spec.nodeName)
      KB_HOST_IP:              (v1:status.hostIP)
      KB_POD_IP:               (v1:status.podIP)
      KB_POD_IPS:              (v1:status.podIPs)
      KB_HOSTIP:               (v1:status.hostIP)
      KB_PODIP:                (v1:status.podIP)
      KB_PODIPS:               (v1:status.podIPs)
      KB_POD_FQDN:            $(KB_POD_NAME).scale-jwsbig-mysql-headless.$(KB_NAMESPACE).svc
      SERVICE_PORT:           3306
      MYSQL_ROOT_HOST:        %
      MYSQL_ROOT_USER:        <set to the key 'username' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      MYSQL_ROOT_PASSWORD:    <set to the key 'password' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      MYSQL_DATABASE:         mydb
      MYSQL_USER:             u1
      MYSQL_PASSWORD:         u1
      CLUSTER_ID:             1
      CLUSTER_START_INDEX:    1
      REPLICATION_USER:       replicator
      REPLICATION_PASSWORD:   
      MYSQL_TEMPLATE_CONFIG:  
      MYSQL_CUSTOM_CONFIG:    
      MYSQL_DYNAMIC_CONFIG:   
      KB_EMBEDDED_WESQL:      1
    Mounts:
      /data/mysql from data (rw)
      /etc/annotations from annotations (rw)
      /opt/mysql from mysql-config (rw)
      /scripts from scripts (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-95htp (ro)
  metrics:
    Container ID:  containerd://d72ed100201fcd95f69d198353fd215895852f27297619c67892da2db6a1e24c
    Image:         infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/agamotto:0.1.2-beta.1
    Image ID:      infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/agamotto@sha256:cbab349b90490807a8d5039bf01bc7e37334f20c98c7dd75bc7fc4cf9e5b10ee
    Port:          9104/TCP
    Host Port:     0/TCP
    Command:
      /scripts/agamotto.sh
    State:          Running
      Started:      Thu, 13 Jun 2024 17:19:24 +0800
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     0
      memory:  0
    Requests:
      cpu:     0
      memory:  0
    Environment Variables from:
      scale-jwsbig-mysql-env      ConfigMap  Optional: false
      scale-jwsbig-mysql-rsm-env  ConfigMap  Optional: false
    Environment:
      KB_POD_NAME:     scale-jwsbig-mysql-3 (v1:metadata.name)
      KB_POD_UID:       (v1:metadata.uid)
      KB_NAMESPACE:    default (v1:metadata.namespace)
      KB_SA_NAME:       (v1:spec.serviceAccountName)
      KB_NODENAME:      (v1:spec.nodeName)
      KB_HOST_IP:       (v1:status.hostIP)
      KB_POD_IP:        (v1:status.podIP)
      KB_POD_IPS:       (v1:status.podIPs)
      KB_HOSTIP:        (v1:status.hostIP)
      KB_PODIP:         (v1:status.podIP)
      KB_PODIPS:        (v1:status.podIPs)
      KB_POD_FQDN:     $(KB_POD_NAME).scale-jwsbig-mysql-headless.$(KB_NAMESPACE).svc
      DB_TYPE:         MySQL
      ENDPOINT:        localhost:3306
      MYSQL_USER:      <set to the key 'username' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      MYSQL_PASSWORD:  <set to the key 'password' in secret 'scale-jwsbig-conn-credential'>  Optional: false
    Mounts:
      /data/mysql from data (rw)
      /opt/agamotto from agamotto-configuration (rw)
      /scripts from scripts (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-95htp (ro)
  vttablet:
    Container ID:  containerd://476ef473ffa3865b857d63159f67e936457319f58efef98ea8676a1290757c0c
    Image:         infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/apecloud-mysql-scale:0.2.6
    Image ID:      infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/apecloud-mysql-scale@sha256:131853e6f52acb0fd9d8715d022aaedc5373d87f71db5b5677fde42434807013
    Ports:         15100/TCP, 16100/TCP
    Host Ports:    0/TCP, 0/TCP
    Command:
      /scripts/vttablet.sh
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Thu, 13 Jun 2024 20:50:39 +0800
      Finished:     Thu, 13 Jun 2024 20:50:39 +0800
    Ready:          False
    Restart Count:  46
    Limits:
      cpu:     0
      memory:  0
    Requests:
      cpu:     0
      memory:  0
    Environment Variables from:
      scale-jwsbig-mysql-env      ConfigMap  Optional: false
      scale-jwsbig-mysql-rsm-env  ConfigMap  Optional: false
    Environment:
      KB_POD_NAME:          scale-jwsbig-mysql-3 (v1:metadata.name)
      KB_POD_UID:            (v1:metadata.uid)
      KB_NAMESPACE:         default (v1:metadata.namespace)
      KB_SA_NAME:            (v1:spec.serviceAccountName)
      KB_NODENAME:           (v1:spec.nodeName)
      KB_HOST_IP:            (v1:status.hostIP)
      KB_POD_IP:             (v1:status.podIP)
      KB_POD_IPS:            (v1:status.podIPs)
      KB_HOSTIP:             (v1:status.hostIP)
      KB_PODIP:              (v1:status.podIP)
      KB_PODIPS:             (v1:status.podIPs)
      KB_POD_FQDN:          $(KB_POD_NAME).scale-jwsbig-mysql-headless.$(KB_NAMESPACE).svc
      CELL:                 zone1
      ETCD_SERVER:          $(KB_CLUSTER_NAME)-vtcontroller-headless
      ETCD_PORT:            2379
      TOPOLOGY_FLAGS:       --topo_implementation etcd2 --topo_global_server_address $(ETCD_SERVER):$(ETCD_PORT) --topo_global_root /vitess/global
      VTTABLET_PORT:        15100
      VTTABLET_GRPC_PORT:   16100
      VTCTLD_HOST:          $(KB_CLUSTER_NAME)-vtcontroller-headless
      VTCTLD_WEB_PORT:      15000
      SERVICE_PORT:         $(VTTABLET_PORT)
      MYSQL_ROOT_USER:      <set to the key 'username' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      MYSQL_ROOT_PASSWORD:  <set to the key 'password' in secret 'scale-jwsbig-conn-credential'>  Optional: false
    Mounts:
      /conf from mysql-scale-config (rw)
      /scripts from scripts (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-95htp (ro)
      /vtdataroot from data (rw)
  lorry:
    Container ID:  containerd://a5b95ec9851faf3efbcdb7df7ea759119d4896560dd8ed464a520e78437f3f22
    Image:         docker.io/apecloud/kubeblocks-tools:0.9.0-beta.32
    Image ID:      docker.io/apecloud/kubeblocks-tools@sha256:1fb4df7d54b5ce8efe3b9fad236169567ee331960bc982ab59a4b05ece78a9dc
    Ports:         3501/TCP, 50001/TCP
    Host Ports:    0/TCP, 0/TCP
    Command:
      lorry
      --port
      3501
      --grpcport
      50001
    State:          Running
      Started:      Thu, 13 Jun 2024 17:19:25 +0800
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     0
      memory:  0
    Requests:
      cpu:      0
      memory:   0
    Readiness:  http-get http://:3501/v1.0/checkrole delay=0s timeout=1s period=1s #success=1 #failure=3
    Startup:    tcp-socket :3501 delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment Variables from:
      scale-jwsbig-mysql-env      ConfigMap  Optional: false
      scale-jwsbig-mysql-rsm-env  ConfigMap  Optional: false
    Environment:
      KB_POD_NAME:                   scale-jwsbig-mysql-3 (v1:metadata.name)
      KB_POD_UID:                     (v1:metadata.uid)
      KB_NAMESPACE:                  default (v1:metadata.namespace)
      KB_SA_NAME:                     (v1:spec.serviceAccountName)
      KB_NODENAME:                    (v1:spec.nodeName)
      KB_HOST_IP:                     (v1:status.hostIP)
      KB_POD_IP:                      (v1:status.podIP)
      KB_POD_IPS:                     (v1:status.podIPs)
      KB_HOSTIP:                      (v1:status.hostIP)
      KB_PODIP:                       (v1:status.podIP)
      KB_PODIPS:                      (v1:status.podIPs)
      KB_POD_FQDN:                   $(KB_POD_NAME).scale-jwsbig-mysql-headless.$(KB_NAMESPACE).svc
      KB_RSM_ROLE_PROBE_PERIOD:      1
      KB_BUILTIN_HANDLER:            wesql
      KB_SERVICE_USER:               <set to the key 'username' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      KB_SERVICE_PASSWORD:           <set to the key 'password' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      KB_SERVICE_PORT:               3306
      KB_DATA_PATH:                  /data/mysql
      KB_RSM_ACTION_SVC_LIST:        null
      KB_RSM_ROLE_UPDATE_MECHANISM:  DirectAPIServerEventUpdate
      KB_RSM_ROLE_PROBE_TIMEOUT:     1
      KB_CLUSTER_NAME:                (v1:metadata.labels['app.kubernetes.io/instance'])
      KB_COMP_NAME:                   (v1:metadata.labels['apps.kubeblocks.io/component-name'])
      KB_SERVICE_CHARACTER_TYPE:     wesql
    Mounts:
      /data/mysql from data (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-95htp (ro)
  config-manager:
    Container ID:  containerd://dfac85ef2a3eb8f9835a4f8da45785f0c6fac2b7ec46ccaf3afb2d26e12e9ae7
    Image:         docker.io/apecloud/kubeblocks-tools:0.9.0-beta.32
    Image ID:      docker.io/apecloud/kubeblocks-tools@sha256:1fb4df7d54b5ce8efe3b9fad236169567ee331960bc982ab59a4b05ece78a9dc
    Port:          9901/TCP
    Host Port:     0/TCP
    Command:
      env
    Args:
      PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:$(TOOLS_PATH)
      /bin/reloader
      --log-level
      info
      --operator-update-enable
      --tcp
      9901
      --config
      /opt/config-manager/config-manager.yaml
    State:          Running
      Started:      Thu, 13 Jun 2024 17:19:25 +0800
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     0
      memory:  0
    Requests:
      cpu:     0
      memory:  0
    Environment Variables from:
      scale-jwsbig-mysql-env      ConfigMap  Optional: false
      scale-jwsbig-mysql-rsm-env  ConfigMap  Optional: false
    Environment:
      KB_POD_NAME:            scale-jwsbig-mysql-3 (v1:metadata.name)
      KB_POD_UID:              (v1:metadata.uid)
      KB_NAMESPACE:           default (v1:metadata.namespace)
      KB_SA_NAME:              (v1:spec.serviceAccountName)
      KB_NODENAME:             (v1:spec.nodeName)
      KB_HOST_IP:              (v1:status.hostIP)
      KB_POD_IP:               (v1:status.podIP)
      KB_POD_IPS:              (v1:status.podIPs)
      KB_HOSTIP:               (v1:status.hostIP)
      KB_PODIP:                (v1:status.podIP)
      KB_PODIPS:               (v1:status.podIPs)
      KB_POD_FQDN:            $(KB_POD_NAME).scale-jwsbig-mysql-headless.$(KB_NAMESPACE).svc
      CONFIG_MANAGER_POD_IP:   (v1:status.podIP)
      DB_TYPE:                mysql
      MYSQL_USER:             <set to the key 'username' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      MYSQL_PASSWORD:         <set to the key 'password' in secret 'scale-jwsbig-conn-credential'>  Optional: false
      DATA_SOURCE_NAME:       $(MYSQL_USER):$(MYSQL_PASSWORD)@(localhost:3306)/
      TOOLS_PATH:             /opt/kb-tools/reload/mysql-consensusset-config:/opt/config-manager
    Mounts:
      /conf from mysql-scale-config (rw)
      /opt/config-manager from config-manager-config (rw)
      /opt/kb-tools/reload/mysql-consensusset-config from cm-script-mysql-consensusset-config (rw)
      /opt/mysql from mysql-config (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-95htp (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  annotations:
    Type:  DownwardAPI (a volume populated by information about the pod)
    Items:
      metadata.annotations['cs.apps.kubeblocks.io/leader'] -> leader
      metadata.annotations['apps.kubeblocks.io/component-replicas'] -> component-replicas
  agamotto-configuration:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      scale-jwsbig-mysql-agamotto-configuration
    Optional:  false
  scripts:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      scale-jwsbig-mysql-apecloud-mysql-scripts
    Optional:  false
  mysql-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      scale-jwsbig-mysql-mysql-consensusset-config
    Optional:  false
  mysql-scale-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      scale-jwsbig-mysql-vttablet-config
    Optional:  false
  cm-script-mysql-consensusset-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      sidecar-mysql-reload-script-scale-jwsbig
    Optional:  false
  config-manager-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      sidecar-scale-jwsbig-mysql-config-manager-config
    Optional:  false
  data:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  data-scale-jwsbig-mysql-3
    ReadOnly:   false
  kube-api-access-95htp:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   Burstable
Node-Selectors:              <none>
Tolerations:                 kb-data=true:NoSchedule
                             node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason   Age                      From     Message
  ----     ------   ----                     ----     -------
  Normal   Pulled   48m (x38 over 3h33m)     kubelet  Container image "infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/apecloud-mysql-server:8.0.30-5.beta3.20240330.g94d1caf.15" already present on machine
  Warning  BackOff  3m43s (x994 over 3h33m)  kubelet  Back-off restarting failed container mysql in pod scale-jwsbig-mysql-3_default(5a46e8bf-797d-437d-9a9d-77dffa868c78)

logs pod

kubectl logs scale-jwsbig-mysql-3 mysql
2024-06-13 12:50:39+00:00 [Note] [MySQL]: Entrypoint script for MySQL Server  started.
2024-06-13 12:50:39+00:00 [Note] [MySQL]: KB_EMBEDDED_WESQL=1
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: 
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_VOLUME_DIR=
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_CLUSTER_UID=71848fca-616a-48bf-aa89-3c9e1c21a913
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_CONF_FILE=
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_N=3
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_CLUSTER_MEMBERS=
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_0_HOSTNAME=scale-jwsbig-mysql-0.scale-jwsbig-mysql-headless
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_1_HOSTNAME=scale-jwsbig-mysql-1.scale-jwsbig-mysql-headless
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_2_HOSTNAME=scale-jwsbig-mysql-2.scale-jwsbig-mysql-headless
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_CLUSTER_MEMBER_INDEX=
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_CLUSTER_MEMBER_HOST=
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_POD_NAME=scale-jwsbig-mysql-3
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_CLUSTER_LEADER_HOST=
2024-06-13 12:50:39+00:00 [Note] [Kubeblocks]: KB_MYSQL_LEADER=scale-jwsbig-mysql-0
/apecloud/mysql/scripts/libkbenv.sh: line 65: !pod_host: missing current member hostname

mysql error log

tail -f mysqld-error.log -n 200
[2024-06-13 09:28:56.510808] [Info] Server 1 : msgId(4581) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7781)
[2024-06-13 09:28:56.510808] [Info] Server 1 : msgId(4581) receive log has 1 entries, plt:41, pli:7781, commitIndex:7780
[2024-06-13 09:28:56.510808] [Info] Server 1 : Follower commitIndex change from 7778 to 7780
[2024-06-13 09:28:56.510808] [Info] Server 1 : msgId(4581) onAppendLog end, is_success 1
[2024-06-13 09:28:56.510822] [Info] Server 1 : msgId(4584) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7782)
[2024-06-13 09:28:56.510822] [Warning] Server 1 : receive uncontinue log local lastLogIndex(7782, term:41); msgId(4584) msg prevlogindex(7784, term:41) has 1 entries firstIndex(7785) lastIndex(7785); put it in cache.
[2024-06-13 09:28:56.510822] [Info] Server 1 : msgId(4584) onAppendLog end, is_success 1
[2024-06-13 09:28:56.510837] [Info] Server 1 : msgId(4585) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7782)
[2024-06-13 09:28:56.510837] [Warning] Server 1 : receive uncontinue log local lastLogIndex(7782, term:41); msgId(4585) msg prevlogindex(7785, term:41) has 1 entries firstIndex(7786) lastIndex(7786); put it in cache.
[2024-06-13 09:28:56.510837] [Info] Server 1 : msgId(4585) onAppendLog end, is_success 1
[2024-06-13 09:28:56.510838] [Info] Server 1 : msgId(4583) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7782)
[2024-06-13 09:28:56.510838] [Warning] Server 1 : receive uncontinue log local lastLogIndex(7782, term:41); msgId(4583) msg prevlogindex(7783, term:41) has 1 entries firstIndex(7784) lastIndex(7784); put it in cache.
[2024-06-13 09:28:56.510838] [Info] Server 1 : msgId(4583) onAppendLog end, is_success 1
[2024-06-13 09:28:56.510853] [Info] Server 1 : msgId(4582) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7782)
[2024-06-13 09:28:56.510853] [Info] Server 1 : msgId(4582) receive log has 1 entries, plt:41, pli:7782, commitIndex:7782
[2024-06-13 09:28:56.510853] [Info] Server 1 : Get log from cache, beginIndex(7784) endIndex(7786) term(41)
[2024-06-13 09:28:56.510853] [Info] Server 1 : Follower commitIndex change from 7780 to 7782
[2024-06-13 09:28:56.510853] [Info] Server 1 : msgId(4582) onAppendLog end, is_success 1
[2024-06-13 09:28:56.610753] [Info] Server 1 : msgId(4586) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7786)
[2024-06-13 09:28:56.610753] [Info] Server 1 : msgId(4586) receive log has 1 entries, plt:41, pli:7786, commitIndex:7783
[2024-06-13 09:28:56.610753] [Info] Server 1 : Follower commitIndex change from 7782 to 7783
[2024-06-13 09:28:56.610753] [Info] Server 1 : msgId(4586) onAppendLog end, is_success 1
[2024-06-13 09:28:56.610770] [Info] Server 1 : msgId(4592) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7787)
[2024-06-13 09:28:56.610770] [Info] Server 1 : msgId(4592) receive log has 1 entries, plt:41, pli:7787, commitIndex:7787
[2024-06-13 09:28:56.610770] [Info] Server 1 : Follower commitIndex change from 7783 to 7787
[2024-06-13 09:28:56.610770] [Info] Server 1 : msgId(4592) onAppendLog end, is_success 1
[2024-06-13 09:28:56.610781] [Info] Server 1 : msgId(4593) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7788)
[2024-06-13 09:28:56.610781] [Info] Server 1 : msgId(4593) receive log has 1 entries, plt:41, pli:7788, commitIndex:7787
[2024-06-13 09:28:56.610781] [Info] Server 1 : msgId(4593) onAppendLog end, is_success 1
[2024-06-13 09:28:56.610770] [Info] Server 1 : msgId(4594) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7789)
[2024-06-13 09:28:56.610770] [Info] Server 1 : msgId(4594) receive log has 1 entries, plt:41, pli:7789, commitIndex:7789
[2024-06-13 09:28:56.610770] [Info] Server 1 : Follower commitIndex change from 7787 to 7789
[2024-06-13 09:28:56.610770] [Info] Server 1 : msgId(4594) onAppendLog end, is_success 1
[2024-06-13 09:28:56.710798] [Info] Server 1 : msgId(4595) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7790)
[2024-06-13 09:28:56.710798] [Info] Server 1 : msgId(4595) receive log has 1 entries, plt:41, pli:7790, commitIndex:7789
[2024-06-13 09:28:56.710798] [Info] Server 1 : msgId(4595) onAppendLog end, is_success 1
[2024-06-13 09:28:56.710978] [Info] Server 1 : msgId(4597) onAppendLog start, receive logs from leader(3), msg.term(41) lli(7791)
[2024-06-13 09:28:56.710978] [Info] Server 1 : msgId(4597) receive log has 1 entries, plt:41, pli:7791, commitIndex:7790
[2024-06-13 09:28:56.710978] [Info] Server 1 : Follower commitIndex change from 7789 to 7790
[2024-06-13 09:28:56.710978] [Info] Server 1 : msgId(4597) onAppendLog end, is_success 1

mysql log

tail -f mysqld.log -n 200
2024-06-13T09:28:56.715873Z	   76 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 305 and row_id < 2751
2024-06-13T09:28:56.715934Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id <= 78
2024-06-13T09:28:56.716106Z	   77 Query	select sum(v1) from scan_check force index(primary) where group_id = 35 and trx_id <= 321 group by trx_id order by trx_id desc
2024-06-13T09:28:56.716275Z	   71 Query	select v4 from scan_check force index(primary) where group_id = 22 and trx_id = 206 and row_id = 1861
2024-06-13T09:28:56.716376Z	   70 Query	select * from scan_check where group_id = 49 and trx_id = 449 lock in share mode
2024-06-13T09:28:56.716389Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17
2024-06-13T09:28:56.716470Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3026
2024-06-13T09:28:56.716667Z	   68 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 532 and row_id = 4791
2024-06-13T09:28:56.716750Z	   74 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 533 and row_id = 4802
2024-06-13T09:28:56.716925Z	   75 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 46 and row_id > 3782
2024-06-13T09:28:56.717035Z	   76 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 305 and row_id >= 2748
2024-06-13T09:28:56.717039Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id > 75 and trx_id < 78
2024-06-13T09:28:56.717272Z	   71 Query	select v4 from scan_check force index(primary) where group_id = 22 and trx_id = 206 and row_id = 1862
2024-06-13T09:28:56.717320Z	   77 Query	select sum(v1) from scan_check force index(primary) where group_id = 35 and trx_id > 318 and trx_id < 321 group by trx_id order by trx_id desc
2024-06-13T09:28:56.717439Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3027
2024-06-13T09:28:56.717694Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id > 156
2024-06-13T09:28:56.717736Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4041
2024-06-13T09:28:56.717782Z	   68 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 532 and row_id = 4792
2024-06-13T09:28:56.717857Z	   74 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 533 and row_id = 4803
2024-06-13T09:28:56.718111Z	   75 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 46 and row_id < 3786
2024-06-13T09:28:56.718143Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id >= 75 and trx_id <= 78
2024-06-13T09:28:56.718194Z	   76 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 305 and row_id <= 2750
2024-06-13T09:28:56.718235Z	   71 Query	select sum(v4) from scan_check force index(primary) where group_id = 22 and trx_id = 206
2024-06-13T09:28:56.718383Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3028
2024-06-13T09:28:56.718428Z	   77 Query	select sum(v1) from scan_check force index(primary) where group_id = 35 and trx_id >= 318 and trx_id <= 321 group by trx_id order by trx_id desc
2024-06-13T09:28:56.718761Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4042
2024-06-13T09:28:56.718869Z	   68 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 532 and row_id = 4793
2024-06-13T09:28:56.718886Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id < 159
2024-06-13T09:28:56.718907Z	   74 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 533 and row_id = 4804
2024-06-13T09:28:56.719017Z	   31 Query	BEGIN
2024-06-13T09:28:56.719079Z	   32 Query	BEGIN
2024-06-13T09:28:56.719322Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id in (72, 75, 78)
2024-06-13T09:28:56.719325Z	   71 Query	select sum(v4) from scan_check force index(scan_check_sk4) where trx_id = 206
2024-06-13T09:28:56.719430Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3029
2024-06-13T09:28:56.719433Z	   76 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 305 and row_id > 2747 and row_id < 2751
2024-06-13T09:28:56.719580Z	   77 Query	select sum(v1) from scan_check force index(primary) where group_id = 35 and trx_id in (315, 318, 321) group by trx_id order by trx_id desc
2024-06-13T09:28:56.719685Z	   75 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 46 and row_id >= 3783
2024-06-13T09:28:56.719820Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4043
2024-06-13T09:28:56.719956Z	   74 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 533 and row_id = 4805
2024-06-13T09:28:56.719956Z	   68 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 532 and row_id = 4794
2024-06-13T09:28:56.719958Z	   32 Query	COMMIT /* implicit, from Xid_log_event */
2024-06-13T09:28:56.720056Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id >= 156
2024-06-13T09:28:56.720059Z	   31 Query	COMMIT /* implicit, from Xid_log_event */
2024-06-13T09:28:56.720393Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3030
2024-06-13T09:28:56.720468Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id not in (72, 75, 78)
2024-06-13T09:28:56.720478Z	   71 Query	select sum(v4) from scan_check force index(scan_check_uk4) where group_id = 22 and trx_id = 206
2024-06-13T09:28:56.720641Z	   76 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 305 and row_id >= 2748 and row_id <= 2750
2024-06-13T09:28:56.720785Z	   77 Query	select sum(v1) from scan_check force index(primary) where group_id = 35 and trx_id not in (315, 318, 321) group by trx_id order by trx_id desc
2024-06-13T09:28:56.720825Z	   75 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 46 and row_id <= 3785
2024-06-13T09:28:56.720839Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4044
2024-06-13T09:28:56.720995Z	   68 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 532 and row_id = 4795
2024-06-13T09:28:56.721021Z	   74 Query	commit
2024-06-13T09:28:56.721163Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id <= 159
2024-06-13T09:28:56.721349Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3031
2024-06-13T09:28:56.721569Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 group by trx_id order by trx_id desc
2024-06-13T09:28:56.721798Z	   71 Query	commit
2024-06-13T09:28:56.721798Z	   76 Query	select sum(v2) from scan_check force index(scan_check_sk3) where trx_id = 305 and row_id in (2745, 2748, 2751)
2024-06-13T09:28:56.721920Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4045
2024-06-13T09:28:56.721955Z	   74 Query	select sum(v1) from scan_check force index(primary) where group_id = 59
2024-06-13T09:28:56.722044Z	   75 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 46 and row_id > 3782 and row_id < 3786
2024-06-13T09:28:56.722068Z	   68 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 59 and trx_id = 532 and row_id = 4796
2024-06-13T09:28:56.722097Z	   77 Query	select sum(v1) + sum(v3) from scan_check force index(scan_check_sk1) where trx_id = 318
2024-06-13T09:28:56.722259Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id > 156 and trx_id < 159
2024-06-13T09:28:56.722299Z	   69 Query	select v5 from scan_check force index(primary) where group_id = 37 and trx_id = 336 and row_id = 3032
2024-06-13T09:28:56.722695Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id > 75 group by trx_id order by trx_id desc
2024-06-13T09:28:56.722725Z	   71 Query	begin
2024-06-13T09:28:56.722918Z	   31 Query	BEGIN
2024-06-13T09:28:56.722932Z	   76 Query	select sum(v2) from scan_check force index(scan_check_sk3) where trx_id = 305 and row_id not in (2745, 2748, 2751)
2024-06-13T09:28:56.723058Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4046
2024-06-13T09:28:56.723059Z	   74 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id > 534
2024-06-13T09:28:56.723066Z	   32 Query	BEGIN
2024-06-13T09:28:56.723135Z	   75 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 46 and row_id >= 3783 and row_id <= 3785
2024-06-13T09:28:56.723068Z	   68 Query	commit
2024-06-13T09:28:56.723235Z	   69 Query	select sum(v5) from scan_check force index(primary) where group_id = 37 and trx_id = 336
2024-06-13T09:28:56.723251Z	   77 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 318 and row_id > 2864
2024-06-13T09:28:56.723337Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id >= 156 and trx_id <= 159
2024-06-13T09:28:56.723636Z	   71 Query	select * from scan_check where group_id = 22 and trx_id = 206 lock in share mode
2024-06-13T09:28:56.723779Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id < 78 group by trx_id order by trx_id desc
2024-06-13T09:28:56.723853Z	   31 Query	COMMIT /* implicit, from Xid_log_event */
2024-06-13T09:28:56.724016Z	   76 Query	select sum(v1) + sum(v3) from scan_check force index(scan_check_uk1) where group_id = 33
2024-06-13T09:28:56.724092Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4047
2024-06-13T09:28:56.724093Z	   32 Query	COMMIT /* implicit, from Xid_log_event */
2024-06-13T09:28:56.724114Z	   74 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id < 537
2024-06-13T09:28:56.724128Z	   68 Query	select sum(v1) from scan_check force index(primary) where group_id = 59
2024-06-13T09:28:56.724184Z	   75 Query	select sum(v2) from scan_check force index(scan_check_uk3) where group_id = 46 and row_id in (3780, 3783, 3786)
2024-06-13T09:28:56.724251Z	   69 Query	select sum(v5) from scan_check force index(scan_check_sk5) where trx_id = 336
2024-06-13T09:28:56.724383Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id in (153, 156, 159)
2024-06-13T09:28:56.724385Z	   77 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 318 and row_id < 2868
2024-06-13T09:28:56.724836Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id >= 75 group by trx_id order by trx_id desc
2024-06-13T09:28:56.724845Z	   71 Query	select v5 from scan_check force index(primary) where group_id = 22 and trx_id = 206 and row_id = 1854
2024-06-13T09:28:56.725148Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4048
2024-06-13T09:28:56.725192Z	   74 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id >= 534
2024-06-13T09:28:56.725307Z	   76 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 33 and row_id > 2747
2024-06-13T09:28:56.725324Z	   68 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id > 534
2024-06-13T09:28:56.725352Z	   75 Query	select sum(v2) from scan_check force index(scan_check_uk3) where group_id = 46 and row_id not in (3780, 3783, 3786)
2024-06-13T09:28:56.725308Z	   69 Query	select sum(v5) from scan_check force index(scan_check_uk5) where group_id = 37 and trx_id = 336
2024-06-13T09:28:56.725516Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id not in (153, 156, 159)
2024-06-13T09:28:56.725569Z	   77 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 318 and row_id >= 2865
2024-06-13T09:28:56.725866Z	   71 Query	select v5 from scan_check force index(primary) where group_id = 22 and trx_id = 206 and row_id = 1855
2024-06-13T09:28:56.725903Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id <= 78 group by trx_id order by trx_id desc
2024-06-13T09:28:56.726200Z	   70 Query	select v5 from scan_check force index(primary) where group_id = 49 and trx_id = 449 and row_id = 4049
2024-06-13T09:28:56.726348Z	   74 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id <= 537
2024-06-13T09:28:56.726418Z	   68 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id < 537
2024-06-13T09:28:56.726500Z	   76 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 33 and row_id < 2751
2024-06-13T09:28:56.726544Z	   69 Query	commit
2024-06-13T09:28:56.726720Z	   31 Query	BEGIN
2024-06-13T09:28:56.726734Z	   75 Query	begin
2024-06-13T09:28:56.726749Z	   77 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 318 and row_id <= 2867
2024-06-13T09:28:56.726777Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 group by trx_id order by trx_id desc
2024-06-13T09:28:56.726885Z	   71 Query	select v5 from scan_check force index(primary) where group_id = 22 and trx_id = 206 and row_id = 1856
2024-06-13T09:28:56.726898Z	   31 Query	COMMIT /* implicit, from Xid_log_event */
2024-06-13T09:28:56.726942Z	   72 Query	select sum(v1) from scan_check force index(primary) where group_id = 8 and trx_id > 75 and trx_id < 78 group by trx_id order by trx_id desc
2024-06-13T09:28:56.727223Z	   70 Query	select sum(v5) from scan_check force index(primary) where group_id = 49 and trx_id = 449
2024-06-13T09:28:56.727402Z	   74 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id > 534 and trx_id < 537
2024-06-13T09:28:56.727518Z	   69 Query	begin
2024-06-13T09:28:56.727650Z	   68 Query	select sum(v1) from scan_check force index(primary) where group_id = 59 and trx_id >= 534
2024-06-13T09:28:56.727663Z	   75 Query	select update_num from scan_check_update where trx_id = 420 lock in share mode
2024-06-13T09:28:56.727847Z	   76 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 33 and row_id >= 2748
2024-06-13T09:28:56.727914Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id > 156 group by trx_id order by trx_id desc
2024-06-13T09:28:56.727942Z	   77 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 318 and row_id > 2864 and row_id < 2868
2024-06-13T09:28:56.727980Z	   71 Query	select v5 from scan_check force index(primary) where group_id = 22 and trx_id = 206 and row_id = 1857
2024-06-13T09:28:56.728296Z	   70 Query	select sum(v5) from scan_check force index(scan_check_sk5) where trx_id = 449
2024-06-13T09:28:56.728469Z	   69 Query	select * from scan_check where group_id = 38 and trx_id = 348 lock in share mode
2024-06-13T09:28:56.728764Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3780
2024-06-13T09:28:56.729018Z	   76 Query	select sum(v3) from scan_check force index(scan_check_uk2) where group_id = 33 and row_id <= 2750
2024-06-13T09:28:56.729059Z	   73 Query	select sum(v1) from scan_check force index(primary) where group_id = 17 and trx_id < 159 group by trx_id order by trx_id desc
2024-06-13T09:28:56.729023Z	   77 Query	select sum(v3) from scan_check force index(scan_check_sk2) where trx_id = 318 and row_id >= 2865 and row_id <= 2867
2024-06-13T09:28:56.729660Z	   69 Query	select v1, v1_verify, v2, v2_verify, v3, v3_verify from scan_check where group_id = 38 and trx_id = 348 and row_id = 3132
2024-06-13T09:28:56.729812Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3781
2024-06-13T09:28:56.730774Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3782
2024-06-13T09:28:56.731751Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3783
2024-06-13T09:28:56.732705Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3784
2024-06-13T09:28:56.733673Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3785
2024-06-13T09:28:56.734676Z	   75 Query	select v4 from scan_check force index(primary) where group_id = 46 and trx_id = 420 and row_id = 3786

mysql.log.txt
mysql-error.log.txt

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.
@JashBook JashBook added the kind/bug Something isn't working label Jun 13, 2024
@JashBook JashBook added the severity/major Great chance user will encounter the same problem label Jun 20, 2024
@xuriwuyun xuriwuyun linked a pull request Jun 26, 2024 that will close this issue
fix: adapt wesql script for specify instance offline apecloud/kubeblocks-addons#696
Merged
@github-actions github-actions bot added this to the Release 0.8.4 milestone Jun 26, 2024
@ahjing99
Copy link
Collaborator

still failed when upgrade kb from 0.8.3 to 0.9.0-beta.41

@ahjing99 ahjing99 reopened this Jun 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@xuriwuyun xuriwuyun

Labels
area/upgrade kind/bug Something isn't working severity/major Great chance user will encounter the same problem
Projects
None yet
Milestone
Release 0.8.4
Development

Successfully merging a pull request may close this issue.

fix: adapt wesql script for specify instance offline apecloud/kubeblocks-addons
3 participants
@xuriwuyun @ahjing99 @JashBook