Uploaded image for project: 'Red Hat Advanced Cluster Management'
  1. Red Hat Advanced Cluster Management
  2. ACM-3605

[ACM 2.6.5] Submariner Gateway was not created for cluster-set with 19 chars

XMLWordPrintable

    • Submariner Sprint 23-3
    • Low
    • No

      Description of problem:

      SubmarinerConfig on OCP 4.11 on AWS was created, but the Gateway object was not created in submariner-operator namespace.

      Version-Release number of selected component (if applicable):

      ACM 2.7.0

      Submariner 0.14.0

      How reproducible:

      Unknown.

      Steps to Reproduce:

      Install ACM and create SubmarinerConfig on OCP 4.11:

      https://qe-jenkins-csb-skynet.apps.ocp-c1.prod.psi.redhat.com/job/ACM-2.7.0-Submariner-0.14.0-AWS-GCP-Globalnet/28/Test-Report/

      Actual results:

       

      $ oc  get managedcluster -o wide
      NAME                HUB ACCEPTED   MANAGED CLUSTER URLS                                           JOINED   AVAILABLE   AGE
      acm-aws-nmanos-a1   true            https://api.aws-nmanos-a1.devcluster.openshift.com:6443         True     True        17m
      acm-gcp-nmanos-c1   true            https://api.gcp-nmanos-c1.gcp.subm.red-chesterfield.com:6443    True     True        16m
      $ oc  describe managedclusteraddons -n "acm-aws-nmanos-a1" "submariner"
      Name:         submariner
      Namespace:    acm-aws-nmanos-a1
      Labels:       <none>
      Annotations:  <none>
      API Version:  addon.open-cluster-management.io/v1alpha1
      Kind:         ManagedClusterAddOn
      Metadata:
        Creation Timestamp:  2022-11-14T15:19:10Z
        Generation:          1
        Managed Fields:
          API Version:  addon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:metadata:
              f:annotations:
                .:
                f:kubectl.kubernetes.io/last-applied-configuration:
            f:spec:
              .:
              f:installNamespace:
          Manager:      kubectl-client-side-apply
          Operation:    Update
          Time:         2022-11-14T15:19:10Z
          API Version:  addon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:status:
              .:
              f:conditions:
              f:registrations:
          Manager:         Go-http-client
          Operation:       Update
          Subresource:     status
          Time:            2022-11-14T15:19:11Z
        Resource Version:  96743
        UID:               afb76f6b-3907-4905-92aa-ae778707eebc
      Spec:
        Install Namespace:  submariner-operator
      Status:
        Conditions:
          Last Transition Time:  2022-11-14T15:19:10Z
          Message:               failed to apply the manifests of addon
          Reason:                AddonManifestAppliedFailed
          Status:                False
          Type:                  ManifestApplied
          Last Transition Time:  2022-11-14T15:19:11Z
          Message:               Registration of the addon agent is configured
          Reason:                RegistrationConfigured
          Status:                True
          Type:                  RegistrationApplied
        Registrations:
          Signer Name:  kubernetes.io/kube-apiserver-client
          Subject:
            Groups:
              system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner
              system:open-cluster-management:addon:submariner
              system:authenticated
            User:  system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner:agent:submariner-addon-agent
      Events:      <none>
      
      $ oc  get manifestwork -n acm-aws-nmanos-a1 --ignore-not-found 2>&1
      
      NAME                                       AGE
      acm-aws-nmanos-a1-klusterlet               7m44s
      acm-aws-nmanos-a1-klusterlet-crds          7m45s
      addon-application-manager-deploy           7m13s
      addon-cert-policy-controller-deploy        7m13s
      addon-cluster-proxy-deploy-0               7m45s
      addon-cluster-proxy-service-proxy          7m45s
      addon-config-policy-controller-deploy      7m13s
      addon-governance-policy-framework-deploy   7m12s
      addon-iam-policy-controller-deploy         7m13s
      addon-search-collector-deploy              7m43s
      addon-submariner-deploy-0                  3s
      addon-work-manager-deploy-0                7m45s
      aws-submariner-gateway-machineset          2s
      
      $ oc  get manifestwork -n acm-aws-nmanos-a1 --ignore-not-found 2>&1
      NAME                                       AGE
      acm-aws-nmanos-a1-klusterlet               7m45s
      acm-aws-nmanos-a1-klusterlet-crds          7m46s
      addon-application-manager-deploy           7m14s
      addon-cert-policy-controller-deploy        7m14s
      addon-cluster-proxy-deploy-0               7m46s
      addon-cluster-proxy-service-proxy          7m46s
      addon-config-policy-controller-deploy      7m14s
      addon-governance-policy-framework-deploy   7m13s
      addon-iam-policy-controller-deploy         7m14s
      addon-search-collector-deploy              7m44s
      addon-submariner-deploy-0                  4s
      addon-work-manager-deploy-0                7m46s
      aws-submariner-gateway-machineset          3s
      
      $ oc  describe managedclusteraddons "submariner" -n "acm-aws-nmanos-a1"
      Name:         submariner
      Namespace:    acm-aws-nmanos-a1
      Labels:       <none>
      Annotations:  <none>
      API Version:  addon.open-cluster-management.io/v1alpha1
      Kind:         ManagedClusterAddOn
      Metadata:
        Creation Timestamp:  2022-11-14T15:19:10Z
        Generation:          1
        Managed Fields:
          API Version:  addon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:metadata:
              f:annotations:
                .:
                f:kubectl.kubernetes.io/last-applied-configuration:
            f:spec:
              .:
              f:installNamespace:
          Manager:      kubectl-client-side-apply
          Operation:    Update
          Time:         2022-11-14T15:19:10Z
          API Version:  addon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:status:
              .:
              f:addOnConfiguration:
              f:addOnMeta:
              f:conditions:
              f:healthCheck:
                .:
                f:mode:
              f:registrations:
          Manager:         Go-http-client
          Operation:       Update
          Subresource:     status
          Time:            2022-11-14T15:19:14Z
        Resource Version:  102746
        UID:               afb76f6b-3907-4905-92aa-ae778707eebc
      Spec:
        Install Namespace:  submariner-operator
      Status:
        Add On Configuration:
        Add On Meta:
        Conditions:
          Last Transition Time:  2022-11-14T15:19:11Z
          Message:               manifests of addon are applied successfully
          Reason:                AddonManifestApplied
          Status:                True
          Type:                  ManifestApplied
          Last Transition Time:  2022-11-14T15:19:11Z
          Message:               Registration of the addon agent is configured
          Reason:                RegistrationConfigured
          Status:                True
          Type:                  RegistrationApplied
          Last Transition Time:  2022-11-14T15:19:11Z
          Message:               client certificate rotated starting from 2022-11-14 15:14:11 +0000 UTC to 2022-11-15 13:27:58 +0000 UTC
          Reason:                ClientCertificateUpdated
          Status:                True
          Type:                  ClusterCertificateRotated
          Last Transition Time:  2022-11-14T15:22:06Z
          Message:               The nodes "ip-10-16-11-193.us-west-1.compute.internal" are labeled with "submariner.io/gateway"
          Reason:                SubmarinerGatewayNodesLabeled
          Status:                True
          Type:                  SubmarinerGatewayNodesLabeled
          Last Transition Time:  2022-11-14T15:19:26Z
          Message:               submariner add-on is available.
          Reason:                ManagedClusterAddOnLeaseUpdated
          Status:                True
          Type:                  Available
        Health Check:
          Mode:  Lease
        Registrations:
          Signer Name:  kubernetes.io/kube-apiserver-client
          Subject:
            Groups:
              system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner
              system:open-cluster-management:addon:submariner
              system:authenticated
            User:  system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner:agent:submariner-addon-agent
      Events:      <none>
      
      $ oc  describe submarinerconfig "submariner" -n "acm-aws-nmanos-a1"
      Name:         submariner
      Namespace:    acm-aws-nmanos-a1
      Labels:       <none>
      Annotations:  <none>
      API Version:  submarineraddon.open-cluster-management.io/v1alpha1
      Kind:         SubmarinerConfig
      Metadata:
        Creation Timestamp:  2022-11-14T15:19:09Z
        Finalizers:
          submarineraddon.open-cluster-management.io/config-cleanup
        Generation:  2
        Managed Fields:
          API Version:  submarineraddon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:metadata:
              f:annotations:
                .:
                f:kubectl.kubernetes.io/last-applied-configuration:
            f:spec:
              .:
              f:IPSecIKEPort:
              f:IPSecNATTPort:
              f:NATTDiscoveryPort:
              f:NATTEnable:
              f:airGappedDeployment:
              f:cableDriver:
              f:credentialsSecret:
                .:
                f:name:
              f:gatewayConfig:
                .:
                f:aws:
                  .:
                  f:instanceType:
                f:gateways:
              f:imagePullSpecs:
              f:loadBalancerEnable:
              f:subscriptionConfig:
                .:
                f:channel:
                f:source:
                f:sourceNamespace:
                f:startingCSV:
          Manager:      kubectl-client-side-apply
          Operation:    Update
          Time:         2022-11-14T15:19:09Z
          API Version:  submarineraddon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:metadata:
              f:finalizers:
                .:
                v:"submarineraddon.open-cluster-management.io/config-cleanup":
            f:spec:
              f:gatewayConfig:
                f:azure:
                  .:
                  f:instanceType:
                f:gcp:
                  .:
                  f:instanceType:
                f:rhos:
                  .:
                  f:instanceType:
          Manager:      submariner
          Operation:    Update
          Time:         2022-11-14T15:19:09Z
          API Version:  submarineraddon.open-cluster-management.io/v1alpha1
          Fields Type:  FieldsV1
          fieldsV1:
            f:status:
              .:
              f:conditions:
              f:managedClusterInfo:
                .:
                f:clusterName:
                f:infraId:
                f:platform:
                f:region:
                f:vendor:
                f:vendorVersion:
          Manager:         submariner
          Operation:       Update
          Subresource:     status
          Time:            2022-11-14T15:19:13Z
        Resource Version:  102747
        UID:               d367c116-09c6-4def-a672-e4b2e9d73869
      Spec:
        IP Sec IKE Port:        501
        IP Sec NATT Port:       4501
        NATT Discovery Port:    4900
        NATT Enable:            true
        Air Gapped Deployment:  false
        Cable Driver:           libreswan
        Credentials Secret:
          Name:  acm-aws-nmanos-a1-aws-creds
        Gateway Config:
          Aws:
            Instance Type:  c5d.large
          Azure:
            Instance Type:  Standard_D4s_v3
          Gateways:         1
          Gcp:
            Instance Type:  n1-standard-4
          Rhos:
            Instance Type:  PnTAE.CPU_16_Memory_32768_Disk_80
        Image Pull Specs:
        Load Balancer Enable:  false
        Subscription Config:
          Channel:           stable-0.14
          Source:            submariner-stable-0-14-catalog
          Source Namespace:  submariner-operator
          Starting CSV:      submariner.v0.14.0
      Status:
        Conditions:
          Last Transition Time:  2022-11-14T15:19:13Z
          Message:               Submariner cluster environment was prepared
          Reason:                SubmarinerClusterEnvPrepared
          Status:                True
          Type:                  SubmarinerClusterEnvironmentPrepared
          Last Transition Time:  2022-11-14T15:22:06Z
          Message:               1 node(s) ("ip-10-16-11-193.us-west-1.compute.internal") are labeled as gateways
          Reason:                Success
          Status:                True
          Type:                  SubmarinerGatewaysLabeled
        Managed Cluster Info:
          Cluster Name:    acm-aws-nmanos-a1
          Infra Id:        aws-nmanos-a1-swctp
          Platform:        AWS
          Region:          us-west-1
          Vendor:          OpenShift
          Vendor Version:  4.11.13
      Events:              <none>
      
      $ oc  get nodes -l node-role.kubernetes.io/worker -o wide
      NAME                                          STATUS   ROLES    AGE    VERSION           INTERNAL-IP     EXTERNAL-IP     OS-IMAGE                                                        KERNEL-VERSION                 CONTAINER-RUNTIME
      ip-10-16-11-193.us-west-1.compute.internal    Ready    worker   23m    v1.24.6+5157800   10.16.11.193    13.52.246.240   Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      ip-10-16-134-138.us-west-1.compute.internal   Ready    worker   121m   v1.24.6+5157800   10.16.134.138   <none>          Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      ip-10-16-175-127.us-west-1.compute.internal   Ready    worker   117m   v1.24.6+5157800   10.16.175.127   <none>          Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      ip-10-16-204-110.us-west-1.compute.internal   Ready    worker   117m   v1.24.6+5157800   10.16.204.110   <none>          Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      
      $ oc  describe Gateway -n submariner-operator
      No resources found in submariner-operator namespace.
      

       

      Expected results:

      The Gateway object should be created.

      Additional info:

      Submariner gather logs in build artifacts.

              asuryana Aswin Suryanarayanan
              nmanos@redhat.com Noam Manos
              Maxim Babushkin Maxim Babushkin
              ACM QE Team
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: