Loading...

Type: Bug
Resolution: Done
Priority: Normal
Fix Version/s: ACM 2.12.0
Affects Version/s: None
Component/s: SiteConfig Operator
Labels:
- bug_approved_2.12

Blocked:
False
Blocked Reason:
None
Ready:
False
Git Pull Request:
https://github.com/stolostron/siteconfig/pull/115
Intelligence Requested:
Market:
RH Private Keywords:

Severity:
Moderate

Regression:
None

SFDC Cases Links:
SFDC Cases Counter:
SFDC Cases Open:

advanced-cluster-management.v2.12.0-92
multicluster-engine.v2.7.0

used IBIO with siteconfig

siteconfig logs:

oc logs -n rhacm                                              siteconfig-controller-manager-b94fb5855-jcwqf  -c manager
2024-10-02T22:29:08Z	INFO	setup	created default reference template ConfigMap rhacm/ai-cluster-templates-v1
2024-10-02T22:29:08Z	INFO	setup	created default reference template ConfigMap rhacm/ai-node-templates-v1
2024-10-02T22:29:08Z	INFO	setup	created default reference template ConfigMap rhacm/ibi-cluster-templates-v1
2024-10-02T22:29:08Z	INFO	setup	created default reference template ConfigMap rhacm/ibi-node-templates-v1
2024-10-02T22:29:08Z	INFO	setup	starting manager
2024-10-02T22:29:08Z	INFO	controller-runtime.metrics	Starting metrics server
2024-10-02T22:29:08Z	INFO	starting server	{"kind": "health probe", "addr": "[::]:8081"}
2024-10-02T22:29:08Z	INFO	controller-runtime.metrics	Serving metrics server	{"bindAddress": "127.0.0.1:8080", "secure": false}
I1002 22:29:08.080385       1 leaderelection.go:250] attempting to acquire leader lease rhacm/manager.siteconfig.open-cluster-management.io...
I1002 22:29:23.750847       1 leaderelection.go:260] successfully acquired lease rhacm/manager.siteconfig.open-cluster-management.io
2024-10-02T22:29:23Z	DEBUG	events	siteconfig-controller-manager-b94fb5855-jcwqf_71a7c4ca-b9ef-4cd4-a9c4-7da60db117b1 became leader	{"type": "Normal", "object": {"kind":"Lease","namespace":"rhacm","name":"manager.siteconfig.open-cluster-management.io","uid":"641286e9-2e71-45bb-b753-964c78221782","apiVersion":"coordination.k8s.io/v1","resourceVersion":"803931"}, "reason": "LeaderElection"}
2024-10-02T22:29:23Z	INFO	Starting EventSource	{"controller": "clusterDeploymentReconciler", "controllerGroup": "hive.openshift.io", "controllerKind": "ClusterDeployment", "source": "kind source: *v1.ClusterDeployment"}
2024-10-02T22:29:23Z	INFO	Starting EventSource	{"controller": "clusterDeploymentReconciler", "controllerGroup": "hive.openshift.io", "controllerKind": "ClusterDeployment", "source": "kind source: *v1alpha1.ClusterInstance"}
2024-10-02T22:29:23Z	INFO	Starting Controller	{"controller": "clusterDeploymentReconciler", "controllerGroup": "hive.openshift.io", "controllerKind": "ClusterDeployment"}
2024-10-02T22:29:23Z	INFO	Starting EventSource	{"controller": "clusterinstance", "controllerGroup": "siteconfig.open-cluster-management.io", "controllerKind": "ClusterInstance", "source": "kind source: *v1alpha1.ClusterInstance"}
2024-10-02T22:29:23Z	INFO	Starting Controller	{"controller": "clusterinstance", "controllerGroup": "siteconfig.open-cluster-management.io", "controllerKind": "ClusterInstance"}
2024-10-02T22:29:23Z	INFO	Starting workers	{"controller": "clusterinstance", "controllerGroup": "siteconfig.open-cluster-management.io", "controllerKind": "ClusterInstance", "worker count": 1}
2024-10-02T22:29:23Z	INFO	Starting workers	{"controller": "clusterDeploymentReconciler", "controllerGroup": "hive.openshift.io", "controllerKind": "ClusterDeployment", "worker count": 1}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Start reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Loaded ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}, "version": "1393277"}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Finished reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Start reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Loaded ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}, "version": "1393278"}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Starting validation	{"ClusterInstance": "elvis2"}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Validation succeeded	{"ClusterInstance": "elvis2"}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Finished validation	{"ClusterInstance": "elvis2"}
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Rendering templates for ClusterInstance elvis2
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Rendering templates for ClusterInstance elvis2
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance.TemplateEngine	Processing cluster-level templates for ClusterInstance elvis2
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance.TemplateEngine	renderTemplates: processing templateRef 1 of 1
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance.TemplateEngine	Processed cluster-level templates for ClusterInstance elvis2
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance.TemplateEngine	Processing node-level templates for ClusterInstance elvis2 [node: 1 of 1]
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance.TemplateEngine	renderTemplates: processing templateRef 1 of 1
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance.TemplateEngine	Processed node-level templates for ClusterInstance elvis2 [node: 1 of 1]
2024-10-03T15:41:15Z	INFO	controllers.ClusterInstance	Validating rendered manifests for ClusterInstance elvis2
2024-10-03T15:41:16Z	INFO	KubeAPIWarningLogger	unknown field "machineNetwork"
2024-10-03T15:41:16Z	INFO	controllers.ClusterInstance	Applying rendered manifests for ClusterInstance elvis2
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Initializing Provisioned condition	{"ClusterInstance": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Failed to extract condition(s)	{"name": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Failed to extract condition(s)	{"name": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Failed to extract condition(s)	{"name": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Failed to extract condition(s)	{"name": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Failed to extract condition(s)	{"name": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterDeploymentReconciler	Failed to extract condition(s)	{"name": "elvis2"}
2024-10-03T15:41:16Z	INFO	controllers.ClusterInstance	ClusterInstance templates are rendered	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T15:41:16Z	INFO	controllers.ClusterInstance	Updating ObservedGeneration to 1	{"ClusterInstance": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T15:41:16Z	INFO	controllers.ClusterInstance	Finished reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Start reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Loaded ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}, "version": "1405553"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully deleted resource	{"KlusterletAddonConfig": "elvis2"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully deleted resource	{"ManagedCluster": "elvis2"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully deleted resource	{"BareMetalHost": "elvis2.example.redhat.com"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully deleted resource	{"ClusterDeployment": "elvis2"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully deleted resource	{"ImageClusterInstall": "elvis2"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully deleted resource	{"Secret": "elvis2.example.redhat.com"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Successfully finalized ClusterInstance	{"name": "elvis2"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Removing ClusterInstance finalizer	{"name": "elvis2"}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Finished reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T16:02:07Z	ERROR	Reconciler error	{"controller": "clusterDeploymentReconciler", "controllerGroup": "hive.openshift.io", "controllerKind": "ClusterDeployment", "ClusterDeployment": {"name":"elvis2","namespace":"elvis2"}, "namespace": "elvis2", "name": "elvis2", "reconcileID": "67f13231-79b7-458c-9851-a232b7c127fb", "error": "failed to update ClusterInstance status: clusterinstances.siteconfig.open-cluster-management.io \"elvis2\" not found"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
	sigs.k8s.io/controller-runtime@v0.16.2/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	sigs.k8s.io/controller-runtime@v0.16.2/pkg/internal/controller/controller.go:266
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	sigs.k8s.io/controller-runtime@v0.16.2/pkg/internal/controller/controller.go:227
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Start reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	ClusterInstance not found	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T16:02:07Z	INFO	controllers.ClusterInstance	Finished reconciling ClusterInstance	{"name": {"name":"elvis2","namespace":"elvis2"}}
2024-10-03T16:02:07Z	INFO	controllers.ClusterDeploymentReconciler	ClusterInstance not found	{"name": "elvis2"}

It seems like the bmh doesn't get set with "externally provisioned" , which causes the inspection to statrt, despite being explicitly disabled in the clusterinstance spec:

apiVersion: siteconfig.open-cluster-management.io/v1alpha1
kind: ClusterInstance
metadata:
  name: elvis2
  namespace: elvis2
spec:
  additionalNTPSources:
    - clock.redhat.com
    - clock2.redhat.com
  baseDomain: qe.lab.redhat.com
  clusterImageSetNameRef: "4.17"
  clusterLabels:
    common: "true"
    sites: elvis2
  clusterName: elvis2
  clusterNetwork:
    - cidr: 10.128.0.0/14
      hostPrefix: 23
  cpuPartitioningMode: None
  extraAnnotations:
    ClusterDeployment:
      myTestAnnotation: success
  holdInstallation: false
  installConfigOverrides: '{"capabilities":{"baselineCapabilitySet": "None", "additionalEnabledCapabilities": [ "marketplace", "OperatorLifecycleManager", "Console", "NodeTuning", "Ingress", "ImageRegistry" ] }}'
  extraManifestsRefs:
  - name: "elvis2-extras-cm0"
  machineNetwork:
    - cidr: 192.168.123.0/24
  networkType: OVNKubernetes
  nodes:
    - automatedCleaningMode: disabled
      bmcAddress: "redfish-virtualmedia+https://192.168.123.1:8000/redfish/v1/Systems/4a50b4a0-02c1-4cc5-ba80-8741b43583d1"
      bmcCredentialsName:
        name: bmc-secret1
      bootMACAddress: "52:54:00:f7:d4:d1"
      bootMode: UEFI
      rootDeviceHints:
        deviceName: "/dev/sda"
      hostName: elvis2.example.redhat.com
      ironicInspect: "disabled"
      nodeNetwork:
        config:
          interfaces:
            - name: enp5s0
              type: ethernet
              state: up
              mac-address: "52:54:00:f7:d4:d1"
              ipv4:
                enabled: true
                address:
                  - ip: 192.168.123.142
                    prefix-length: 24
                dhcp: false
              ipv6:
                enabled: false
          dns-resolver:
            config:
              server:
                - 192.168.123.1
          routes:
            config:
              - destination: 0.0.0.0/0
                next-hop-address: 192.168.123.1
                next-hop-interface: enp5s0
                table-id: 254
        interfaces:
        - name: "enp5s0"
          macAddress: "52:54:00:f7:d4:d1"
      role: master
      templateRefs:
        - name: ibi-node-templates-v1
          namespace: rhacm
  pullSecretRef:
    name: pull-secret
  serviceNetwork:
    - cidr: 172.30.0.0/16
  sshPublicKey: 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjEQXbTauuwDKVeGyveSAIU77h1iZE5iMa8WzGSx2m+6khNqBMBih88Y4OShhsL0lT1pRPhvW8vyFbotkkCe5VNzvfHnUE8/PrRyIZnXv91oXjITHN2URixwEhqJESUCbizXCGfzN5LpJzQL8PCJTiuObIFqCYIke082/uGfx8u15gtJbSvt9/v6NbicOvVZya8fKKTs2ZAomAj2G33RW7PRRD3DV9kRl9sR8CLsdhX1SuNsmyksIXF/8LdGZNtqAft6pVcGE/iJE20f3rfqFxO7folUur0IQESciLHbCAtaAA9yTrBo20HvxP+PMQQUEFrv7isSUqBBtUroMRBWeiZIA7WEfH3aWIXM5rpMWBqlBFLi0jqNy4P36ynpQ58nm/7C+SF+j762nr1tuFANzuX4LZKLAfgqaMVQHbERsbrOSLlN42w3LJHG6s3fvX13RDI5NbUh8139bIpqfHMueC/q04CcrUiQZLLT15MxJ0CddmIzC2/55B7ZCp/5bc8H8= root@sealusa34.mobius.lab.eng.rdu2.redhat.com'
  templateRefs:
    - name: ibi-cluster-templates-v1
      namespace: rhacm

- - Sort By Name
  - Sort By Date
  - Ascending
  - Descending
  - Thumbnails
  - List
  - Download All

must-gather.tgz
2024/10/03 8:43 PM
68.03 MB
Alexander Chuzhoy

Details

Description

Attachments

Attachments

Easy Agile Planning Poker

Activity

People

Dates