-
Bug
-
Resolution: Unresolved
-
Undefined
-
None
-
4.20
-
None
-
Quality / Stability / Reliability
-
False
-
-
None
-
Moderate
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Description of problem:
machine cannot be deleted when the machineset (authoritativeAPI is ClusterAPI) create failed
Version-Release number of selected component (if applicable):
4.20.0-0.ci-2025-05-26-215432
How reproducible:
always
Steps to Reproduce:
1.Create a new machineset with authoritativeAPI:ClusterAPI, but machineset label is mismatch
liuhuali@Lius-MacBook-Pro huali-test % cat ms2.yaml
apiVersion: machine.openshift.io/v1beta1
kind: MachineSet
metadata:
name: huliu-aws27a-kg4c9-worker-us-east-2bc
namespace: openshift-machine-api
spec:
authoritativeAPI: ClusterAPI
deletePolicy: Random
replicas: 1
selector:
matchLabels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2bc
template:
metadata:
labels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machine-role: worker
machine.openshift.io/cluster-api-machine-type: worker
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2bc
spec:
authoritativeAPI: ClusterAPI
lifecycleHooks: {}
metadata:
labels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2b
node-role.kubernetes.io/worker: ""
providerSpec:
value:
ami:
id: ami-0d4a7b7677c0c883f
apiVersion: machine.openshift.io/v1beta1
blockDevices:
- ebs:
deleteOnTermination: true
encrypted: true
kmsKey:
id: ""
volumeSize: 120
volumeType: gp3
capacityReservationId: ""
credentialsSecret:
name: aws-cloud-credentials
deviceIndex: 0
iamInstanceProfile:
id: huliu-aws27a-kg4c9-worker-profile
instanceType: m6i.xlarge
kind: AWSMachineProviderConfig
metadata:
creationTimestamp: null
metadataServiceOptions:
authentication: Optional
placement:
availabilityZone: us-east-2b
region: us-east-2
securityGroups:
- filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-node
- filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-lb
spotMarketOptions: {}
subnet:
filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-subnet-private-us-east-2b
tags:
- name: kubernetes.io/cluster/huliu-aws27a-kg4c9
value: owned
userDataSecret:
name: worker-user-data
liuhuali@Lius-MacBook-Pro huali-test %
2. It shows sync error in the machineset and machine
liuhuali@Lius-MacBook-Pro huali-test % oc get machineset huliu-aws27a-kg4c9-worker-us-east-2bc -oyaml
apiVersion: machine.openshift.io/v1beta1
kind: MachineSet
metadata:
annotations:
capacity.cluster-autoscaler.kubernetes.io/labels: kubernetes.io/arch=amd64
machine.openshift.io/GPU: "0"
machine.openshift.io/memoryMb: "16384"
machine.openshift.io/vCPU: "4"
creationTimestamp: "2025-05-27T08:02:50Z"
finalizers:
- sync.machine.openshift.io/finalizer
generation: 1
name: huliu-aws27a-kg4c9-worker-us-east-2bc
namespace: openshift-machine-api
resourceVersion: "82770"
uid: 93b61cc8-c275-4120-b3e0-a5d11d1a7bd0
spec:
authoritativeAPI: ClusterAPI
deletePolicy: Random
replicas: 1
selector:
matchLabels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2bc
template:
metadata:
labels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machine-role: worker
machine.openshift.io/cluster-api-machine-type: worker
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2bc
spec:
authoritativeAPI: ClusterAPI
lifecycleHooks: {}
metadata:
labels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2b
node-role.kubernetes.io/worker: ""
providerSpec:
value:
ami:
id: ami-0d4a7b7677c0c883f
apiVersion: machine.openshift.io/v1beta1
blockDevices:
- ebs:
deleteOnTermination: true
encrypted: true
kmsKey:
id: ""
volumeSize: 120
volumeType: gp3
capacityReservationId: ""
credentialsSecret:
name: aws-cloud-credentials
deviceIndex: 0
iamInstanceProfile:
id: huliu-aws27a-kg4c9-worker-profile
instanceType: m6i.xlarge
kind: AWSMachineProviderConfig
metadata:
creationTimestamp: null
metadataServiceOptions:
authentication: Optional
placement:
availabilityZone: us-east-2b
region: us-east-2
securityGroups:
- filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-node
- filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-lb
spotMarketOptions: {}
subnet:
filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-subnet-private-us-east-2b
tags:
- name: kubernetes.io/cluster/huliu-aws27a-kg4c9
value: owned
userDataSecret:
name: worker-user-data
status:
authoritativeAPI: ClusterAPI
conditions:
- lastTransitionTime: "2025-05-27T08:02:51Z"
message: The AuthoritativeAPI is set to ClusterAPI
reason: AuthoritativeAPINotMachineAPI
status: "True"
type: Paused
- lastTransitionTime: "2025-05-27T08:02:51Z"
message: 'failed to create CAPI machine set: admission webhook "validation.machineset.cluster.x-k8s.io"
denied the request: MachineSet.cluster.x-k8s.io "huliu-aws27a-kg4c9-worker-us-east-2bc"
is invalid: spec.template.metadata.labels: Invalid value: map[string]string{"cluster.x-k8s.io/cluster-name":"huliu-aws27a-kg4c9",
"machine.openshift.io/cluster-api-cluster":"huliu-aws27a-kg4c9", "machine.openshift.io/cluster-api-machineset":"huliu-aws27a-kg4c9-worker-us-east-2b",
"node-role.kubernetes.io/worker":""}: must match spec.selector "machine.openshift.io/cluster-api-cluster=huliu-aws27a-kg4c9,machine.openshift.io/cluster-api-machineset=huliu-aws27a-kg4c9-worker-us-east-2bc"'
reason: FailedToCreateCAPIMachineSet
severity: Error
status: "False"
type: Synchronized
observedGeneration: 1
synchronizedGeneration: 0
liuhuali@Lius-MacBook-Pro huali-test % oc get machine huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr -oyaml
apiVersion: machine.openshift.io/v1beta1
kind: Machine
metadata:
creationTimestamp: "2025-05-27T08:02:51Z"
finalizers:
- machine.machine.openshift.io
- sync.machine.openshift.io/finalizer
generateName: huliu-aws27a-kg4c9-worker-us-east-2bc-
generation: 1
labels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machine-role: worker
machine.openshift.io/cluster-api-machine-type: worker
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2bc
name: huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr
namespace: openshift-machine-api
ownerReferences:
- apiVersion: machine.openshift.io/v1beta1
blockOwnerDeletion: true
controller: true
kind: MachineSet
name: huliu-aws27a-kg4c9-worker-us-east-2bc
uid: 93b61cc8-c275-4120-b3e0-a5d11d1a7bd0
resourceVersion: "82774"
uid: a8a9dfdb-c811-49d5-a735-9bb60de9b191
spec:
authoritativeAPI: ClusterAPI
lifecycleHooks: {}
metadata:
labels:
machine.openshift.io/cluster-api-cluster: huliu-aws27a-kg4c9
machine.openshift.io/cluster-api-machineset: huliu-aws27a-kg4c9-worker-us-east-2b
node-role.kubernetes.io/worker: ""
providerSpec:
value:
ami:
id: ami-0d4a7b7677c0c883f
apiVersion: machine.openshift.io/v1beta1
blockDevices:
- ebs:
deleteOnTermination: true
encrypted: true
kmsKey:
id: ""
volumeSize: 120
volumeType: gp3
capacityReservationId: ""
credentialsSecret:
name: aws-cloud-credentials
deviceIndex: 0
iamInstanceProfile:
id: huliu-aws27a-kg4c9-worker-profile
instanceType: m6i.xlarge
kind: AWSMachineProviderConfig
metadata:
creationTimestamp: null
metadataServiceOptions:
authentication: Optional
placement:
availabilityZone: us-east-2b
region: us-east-2
securityGroups:
- filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-node
- filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-lb
spotMarketOptions: {}
subnet:
filters:
- name: tag:Name
values:
- huliu-aws27a-kg4c9-subnet-private-us-east-2b
tags:
- name: kubernetes.io/cluster/huliu-aws27a-kg4c9
value: owned
userDataSecret:
name: worker-user-data
status:
authoritativeAPI: ClusterAPI
conditions:
- lastTransitionTime: "2025-05-27T08:02:51Z"
status: "True"
type: Drainable
- lastTransitionTime: "2025-05-27T08:02:51Z"
message: The AuthoritativeAPI is set to ClusterAPI
reason: AuthoritativeAPINotMachineAPI
status: "True"
type: Paused
- lastTransitionTime: "2025-05-27T08:02:51Z"
message: 'failed to convert Machine API machine owner references to Cluster API:
could not find Cluster API machine set: MachineSet.cluster.x-k8s.io "huliu-aws27a-kg4c9-worker-us-east-2bc"
not found'
reason: FailedToConvertMAPIMachineToCAPI
severity: Error
status: "False"
type: Synchronized
- lastTransitionTime: "2025-05-27T08:02:51Z"
status: "True"
type: Terminable
lastUpdated: "2025-05-27T08:02:51Z"
phase: ""
synchronizedGeneration: 0
3.Delete the machineset, the machineset is deleted, but the machine is still there
liuhuali@Lius-MacBook-Pro huali-test % oc get machineset
NAME DESIRED CURRENT READY AVAILABLE AGE
huliu-aws27a-kg4c9-worker-us-east-2a 1 1 166m
huliu-aws27a-kg4c9-worker-us-east-2b 1 1 1 1 166m
huliu-aws27a-kg4c9-worker-us-east-2bb 1 82m
huliu-aws27a-kg4c9-worker-us-east-2bc 1 37m
huliu-aws27a-kg4c9-worker-us-east-2c 1 1 1 1 166m
liuhuali@Lius-MacBook-Pro huali-test % oc get machine
NAME PHASE TYPE REGION ZONE AGE
huliu-aws27a-kg4c9-master-0 Running m6i.xlarge us-east-2 us-east-2a 167m
huliu-aws27a-kg4c9-master-1 Running m6i.xlarge us-east-2 us-east-2b 167m
huliu-aws27a-kg4c9-master-2 Running m6i.xlarge us-east-2 us-east-2c 167m
huliu-aws27a-kg4c9-worker-us-east-2a-v7mc2 86m
huliu-aws27a-kg4c9-worker-us-east-2b-mhj8n Provisioning 85m
huliu-aws27a-kg4c9-worker-us-east-2ba-8nrtl 106m
huliu-aws27a-kg4c9-worker-us-east-2bb-qhfhw Provisioning 59m
huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr 37m
huliu-aws27a-kg4c9-worker-us-east-2c-d4xbn Provisioning 90m
liuhuali@Lius-MacBook-Pro huali-test % oc delete machineset huliu-aws27a-kg4c9-worker-us-east-2bc
machineset.machine.openshift.io "huliu-aws27a-kg4c9-worker-us-east-2bc" deleted
liuhuali@Lius-MacBook-Pro huali-test % oc get machine
NAME PHASE TYPE REGION ZONE AGE
huliu-aws27a-kg4c9-master-0 Running m6i.xlarge us-east-2 us-east-2a 171m
huliu-aws27a-kg4c9-master-1 Running m6i.xlarge us-east-2 us-east-2b 171m
huliu-aws27a-kg4c9-master-2 Running m6i.xlarge us-east-2 us-east-2c 171m
huliu-aws27a-kg4c9-worker-us-east-2a-v7mc2 91m
huliu-aws27a-kg4c9-worker-us-east-2b-mhj8n Provisioning 90m
huliu-aws27a-kg4c9-worker-us-east-2ba-8nrtl 110m
huliu-aws27a-kg4c9-worker-us-east-2bb-qhfhw Provisioning 64m
huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr 42m
huliu-aws27a-kg4c9-worker-us-east-2c-d4xbn Provisioning 94m
liuhuali@Lius-MacBook-Pro huali-test % oc get machineset
NAME DESIRED CURRENT READY AVAILABLE AGE
huliu-aws27a-kg4c9-worker-us-east-2a 1 1 171m
huliu-aws27a-kg4c9-worker-us-east-2b 1 1 1 1 171m
huliu-aws27a-kg4c9-worker-us-east-2bb 1 87m
huliu-aws27a-kg4c9-worker-us-east-2c 1 1 1 1 171m
4. Delete the machine, but the machine is still there
liuhuali@Lius-MacBook-Pro huali-test % oc delete machine huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr
machine.machine.openshift.io "huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr" deleted
^C
liuhuali@Lius-MacBook-Pro huali-test % oc get machine
NAME PHASE TYPE REGION ZONE AGE
huliu-aws27a-kg4c9-master-0 Running m6i.xlarge us-east-2 us-east-2a 3h5m
huliu-aws27a-kg4c9-master-1 Running m6i.xlarge us-east-2 us-east-2b 3h5m
huliu-aws27a-kg4c9-master-2 Running m6i.xlarge us-east-2 us-east-2c 3h5m
huliu-aws27a-kg4c9-worker-us-east-2a-v7mc2 104m
huliu-aws27a-kg4c9-worker-us-east-2b-mhj8n Provisioning 103m
huliu-aws27a-kg4c9-worker-us-east-2ba-8nrtl 124m
huliu-aws27a-kg4c9-worker-us-east-2bb-qhfhw Provisioning 78m
huliu-aws27a-kg4c9-worker-us-east-2bc-s4dkr 55m
huliu-aws27a-kg4c9-worker-us-east-2c-d4xbn Provisioning 108m
Actual results:
the machine cannot be deleted
Expected results:
the machine can be deleted
Additional info:
must-gather: https://drive.google.com/file/d/1AJIIWB2Z4gzk5_YcA7cA90JaRYJBmWcA/view?usp=sharing