-
Bug
-
Resolution: Done
-
Major
-
ACM 2.6.Z
Description of problem:
SubmarinerConfig on OCP 4.11 on AWS was created, but the Gateway object was not created in submariner-operator namespace.
Version-Release number of selected component (if applicable):
ACM 2.7.0
Submariner 0.14.0
How reproducible:
Unknown.
Steps to Reproduce:
Install ACM and create SubmarinerConfig on OCP 4.11:
Actual results:
$ oc get managedcluster -o wide NAME HUB ACCEPTED MANAGED CLUSTER URLS JOINED AVAILABLE AGE acm-aws-nmanos-a1 true https://api.aws-nmanos-a1.devcluster.openshift.com:6443 True True 17m acm-gcp-nmanos-c1 true https://api.gcp-nmanos-c1.gcp.subm.red-chesterfield.com:6443 True True 16m $ oc describe managedclusteraddons -n "acm-aws-nmanos-a1" "submariner" Name: submariner Namespace: acm-aws-nmanos-a1 Labels: <none> Annotations: <none> API Version: addon.open-cluster-management.io/v1alpha1 Kind: ManagedClusterAddOn Metadata: Creation Timestamp: 2022-11-14T15:19:10Z Generation: 1 Managed Fields: API Version: addon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:metadata: f:annotations: .: f:kubectl.kubernetes.io/last-applied-configuration: f:spec: .: f:installNamespace: Manager: kubectl-client-side-apply Operation: Update Time: 2022-11-14T15:19:10Z API Version: addon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:status: .: f:conditions: f:registrations: Manager: Go-http-client Operation: Update Subresource: status Time: 2022-11-14T15:19:11Z Resource Version: 96743 UID: afb76f6b-3907-4905-92aa-ae778707eebc Spec: Install Namespace: submariner-operator Status: Conditions: Last Transition Time: 2022-11-14T15:19:10Z Message: failed to apply the manifests of addon Reason: AddonManifestAppliedFailed Status: False Type: ManifestApplied Last Transition Time: 2022-11-14T15:19:11Z Message: Registration of the addon agent is configured Reason: RegistrationConfigured Status: True Type: RegistrationApplied Registrations: Signer Name: kubernetes.io/kube-apiserver-client Subject: Groups: system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner system:open-cluster-management:addon:submariner system:authenticated User: system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner:agent:submariner-addon-agent Events: <none> $ oc get manifestwork -n acm-aws-nmanos-a1 --ignore-not-found 2>&1 NAME AGE acm-aws-nmanos-a1-klusterlet 7m44s acm-aws-nmanos-a1-klusterlet-crds 7m45s addon-application-manager-deploy 7m13s addon-cert-policy-controller-deploy 7m13s addon-cluster-proxy-deploy-0 7m45s addon-cluster-proxy-service-proxy 7m45s addon-config-policy-controller-deploy 7m13s addon-governance-policy-framework-deploy 7m12s addon-iam-policy-controller-deploy 7m13s addon-search-collector-deploy 7m43s addon-submariner-deploy-0 3s addon-work-manager-deploy-0 7m45s aws-submariner-gateway-machineset 2s $ oc get manifestwork -n acm-aws-nmanos-a1 --ignore-not-found 2>&1 NAME AGE acm-aws-nmanos-a1-klusterlet 7m45s acm-aws-nmanos-a1-klusterlet-crds 7m46s addon-application-manager-deploy 7m14s addon-cert-policy-controller-deploy 7m14s addon-cluster-proxy-deploy-0 7m46s addon-cluster-proxy-service-proxy 7m46s addon-config-policy-controller-deploy 7m14s addon-governance-policy-framework-deploy 7m13s addon-iam-policy-controller-deploy 7m14s addon-search-collector-deploy 7m44s addon-submariner-deploy-0 4s addon-work-manager-deploy-0 7m46s aws-submariner-gateway-machineset 3s $ oc describe managedclusteraddons "submariner" -n "acm-aws-nmanos-a1" Name: submariner Namespace: acm-aws-nmanos-a1 Labels: <none> Annotations: <none> API Version: addon.open-cluster-management.io/v1alpha1 Kind: ManagedClusterAddOn Metadata: Creation Timestamp: 2022-11-14T15:19:10Z Generation: 1 Managed Fields: API Version: addon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:metadata: f:annotations: .: f:kubectl.kubernetes.io/last-applied-configuration: f:spec: .: f:installNamespace: Manager: kubectl-client-side-apply Operation: Update Time: 2022-11-14T15:19:10Z API Version: addon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:status: .: f:addOnConfiguration: f:addOnMeta: f:conditions: f:healthCheck: .: f:mode: f:registrations: Manager: Go-http-client Operation: Update Subresource: status Time: 2022-11-14T15:19:14Z Resource Version: 102746 UID: afb76f6b-3907-4905-92aa-ae778707eebc Spec: Install Namespace: submariner-operator Status: Add On Configuration: Add On Meta: Conditions: Last Transition Time: 2022-11-14T15:19:11Z Message: manifests of addon are applied successfully Reason: AddonManifestApplied Status: True Type: ManifestApplied Last Transition Time: 2022-11-14T15:19:11Z Message: Registration of the addon agent is configured Reason: RegistrationConfigured Status: True Type: RegistrationApplied Last Transition Time: 2022-11-14T15:19:11Z Message: client certificate rotated starting from 2022-11-14 15:14:11 +0000 UTC to 2022-11-15 13:27:58 +0000 UTC Reason: ClientCertificateUpdated Status: True Type: ClusterCertificateRotated Last Transition Time: 2022-11-14T15:22:06Z Message: The nodes "ip-10-16-11-193.us-west-1.compute.internal" are labeled with "submariner.io/gateway" Reason: SubmarinerGatewayNodesLabeled Status: True Type: SubmarinerGatewayNodesLabeled Last Transition Time: 2022-11-14T15:19:26Z Message: submariner add-on is available. Reason: ManagedClusterAddOnLeaseUpdated Status: True Type: Available Health Check: Mode: Lease Registrations: Signer Name: kubernetes.io/kube-apiserver-client Subject: Groups: system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner system:open-cluster-management:addon:submariner system:authenticated User: system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner:agent:submariner-addon-agent Events: <none> $ oc describe submarinerconfig "submariner" -n "acm-aws-nmanos-a1" Name: submariner Namespace: acm-aws-nmanos-a1 Labels: <none> Annotations: <none> API Version: submarineraddon.open-cluster-management.io/v1alpha1 Kind: SubmarinerConfig Metadata: Creation Timestamp: 2022-11-14T15:19:09Z Finalizers: submarineraddon.open-cluster-management.io/config-cleanup Generation: 2 Managed Fields: API Version: submarineraddon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:metadata: f:annotations: .: f:kubectl.kubernetes.io/last-applied-configuration: f:spec: .: f:IPSecIKEPort: f:IPSecNATTPort: f:NATTDiscoveryPort: f:NATTEnable: f:airGappedDeployment: f:cableDriver: f:credentialsSecret: .: f:name: f:gatewayConfig: .: f:aws: .: f:instanceType: f:gateways: f:imagePullSpecs: f:loadBalancerEnable: f:subscriptionConfig: .: f:channel: f:source: f:sourceNamespace: f:startingCSV: Manager: kubectl-client-side-apply Operation: Update Time: 2022-11-14T15:19:09Z API Version: submarineraddon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:metadata: f:finalizers: .: v:"submarineraddon.open-cluster-management.io/config-cleanup": f:spec: f:gatewayConfig: f:azure: .: f:instanceType: f:gcp: .: f:instanceType: f:rhos: .: f:instanceType: Manager: submariner Operation: Update Time: 2022-11-14T15:19:09Z API Version: submarineraddon.open-cluster-management.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:status: .: f:conditions: f:managedClusterInfo: .: f:clusterName: f:infraId: f:platform: f:region: f:vendor: f:vendorVersion: Manager: submariner Operation: Update Subresource: status Time: 2022-11-14T15:19:13Z Resource Version: 102747 UID: d367c116-09c6-4def-a672-e4b2e9d73869 Spec: IP Sec IKE Port: 501 IP Sec NATT Port: 4501 NATT Discovery Port: 4900 NATT Enable: true Air Gapped Deployment: false Cable Driver: libreswan Credentials Secret: Name: acm-aws-nmanos-a1-aws-creds Gateway Config: Aws: Instance Type: c5d.large Azure: Instance Type: Standard_D4s_v3 Gateways: 1 Gcp: Instance Type: n1-standard-4 Rhos: Instance Type: PnTAE.CPU_16_Memory_32768_Disk_80 Image Pull Specs: Load Balancer Enable: false Subscription Config: Channel: stable-0.14 Source: submariner-stable-0-14-catalog Source Namespace: submariner-operator Starting CSV: submariner.v0.14.0 Status: Conditions: Last Transition Time: 2022-11-14T15:19:13Z Message: Submariner cluster environment was prepared Reason: SubmarinerClusterEnvPrepared Status: True Type: SubmarinerClusterEnvironmentPrepared Last Transition Time: 2022-11-14T15:22:06Z Message: 1 node(s) ("ip-10-16-11-193.us-west-1.compute.internal") are labeled as gateways Reason: Success Status: True Type: SubmarinerGatewaysLabeled Managed Cluster Info: Cluster Name: acm-aws-nmanos-a1 Infra Id: aws-nmanos-a1-swctp Platform: AWS Region: us-west-1 Vendor: OpenShift Vendor Version: 4.11.13 Events: <none> $ oc get nodes -l node-role.kubernetes.io/worker -o wide NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME ip-10-16-11-193.us-west-1.compute.internal Ready worker 23m v1.24.6+5157800 10.16.11.193 13.52.246.240 Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa) 4.18.0-372.32.1.el8_6.x86_64 cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8 ip-10-16-134-138.us-west-1.compute.internal Ready worker 121m v1.24.6+5157800 10.16.134.138 <none> Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa) 4.18.0-372.32.1.el8_6.x86_64 cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8 ip-10-16-175-127.us-west-1.compute.internal Ready worker 117m v1.24.6+5157800 10.16.175.127 <none> Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa) 4.18.0-372.32.1.el8_6.x86_64 cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8 ip-10-16-204-110.us-west-1.compute.internal Ready worker 117m v1.24.6+5157800 10.16.204.110 <none> Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa) 4.18.0-372.32.1.el8_6.x86_64 cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8 $ oc describe Gateway -n submariner-operator No resources found in submariner-operator namespace.
Expected results:
The Gateway object should be created.
Additional info:
Submariner gather logs in build artifacts.
- clones
-
ACM-2076 [ACM 2.7.2] Submariner Gateway was not created for cluster-set with 19 chars
- Closed