Uploaded image for project: 'Red Hat Advanced Cluster Management'
  1. Red Hat Advanced Cluster Management
  2. ACM-2076

[ACM 2.7.2] Submariner Gateway was not created for cluster-set with 19 chars

XMLWordPrintable

    • Submariner Sprint 23-01
    • Low
    • No

      Description of problem:

      SubmarinerConfig on OCP 4.11 on AWS was created, but the Gateway object was not created in submariner-operator namespace.

      Version-Release number of selected component (if applicable):

      ACM 2.7.0

      Submariner 0.14.0

      How reproducible:

      Unknown.

      Steps to Reproduce:

      Install ACM and create SubmarinerConfig on OCP 4.11:

      https://qe-jenkins-csb-skynet.apps.ocp-c1.prod.psi.redhat.com/job/ACM-2.7.0-Submariner-0.14.0-AWS-GCP-Globalnet/28/Test-Report/

      Actual results:

       

      $ oc  get managedcluster -o wide
NAME                HUB ACCEPTED   MANAGED CLUSTER URLS                                           JOINED   AVAILABLE   AGE
acm-aws-nmanos-a1   true            https://api.aws-nmanos-a1.devcluster.openshift.com:6443         True     True        17m
acm-gcp-nmanos-c1   true            https://api.gcp-nmanos-c1.gcp.subm.red-chesterfield.com:6443    True     True        16m
$ oc  describe managedclusteraddons -n "acm-aws-nmanos-a1" "submariner"
Name:         submariner
Namespace:    acm-aws-nmanos-a1
Labels:       <none>
Annotations:  <none>
API Version:  addon.open-cluster-management.io/v1alpha1
Kind:         ManagedClusterAddOn
Metadata:
  Creation Timestamp:  2022-11-14T15:19:10Z
  Generation:          1
  Managed Fields:
    API Version:  addon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubectl.kubernetes.io/last-applied-configuration:
      f:spec:
        .:
        f:installNamespace:
    Manager:      kubectl-client-side-apply
    Operation:    Update
    Time:         2022-11-14T15:19:10Z
    API Version:  addon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        .:
        f:conditions:
        f:registrations:
    Manager:         Go-http-client
    Operation:       Update
    Subresource:     status
    Time:            2022-11-14T15:19:11Z
  Resource Version:  96743
  UID:               afb76f6b-3907-4905-92aa-ae778707eebc
Spec:
  Install Namespace:  submariner-operator
Status:
  Conditions:
    Last Transition Time:  2022-11-14T15:19:10Z
    Message:               failed to apply the manifests of addon
    Reason:                AddonManifestAppliedFailed
    Status:                False
    Type:                  ManifestApplied
    Last Transition Time:  2022-11-14T15:19:11Z
    Message:               Registration of the addon agent is configured
    Reason:                RegistrationConfigured
    Status:                True
    Type:                  RegistrationApplied
  Registrations:
    Signer Name:  kubernetes.io/kube-apiserver-client
    Subject:
      Groups:
        system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner
        system:open-cluster-management:addon:submariner
        system:authenticated
      User:  system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner:agent:submariner-addon-agent
Events:      <none>

$ oc  get manifestwork -n acm-aws-nmanos-a1 --ignore-not-found 2>&1

NAME                                       AGE
acm-aws-nmanos-a1-klusterlet               7m44s
acm-aws-nmanos-a1-klusterlet-crds          7m45s
addon-application-manager-deploy           7m13s
addon-cert-policy-controller-deploy        7m13s
addon-cluster-proxy-deploy-0               7m45s
addon-cluster-proxy-service-proxy          7m45s
addon-config-policy-controller-deploy      7m13s
addon-governance-policy-framework-deploy   7m12s
addon-iam-policy-controller-deploy         7m13s
addon-search-collector-deploy              7m43s
addon-submariner-deploy-0                  3s
addon-work-manager-deploy-0                7m45s
aws-submariner-gateway-machineset          2s

$ oc  get manifestwork -n acm-aws-nmanos-a1 --ignore-not-found 2>&1
NAME                                       AGE
acm-aws-nmanos-a1-klusterlet               7m45s
acm-aws-nmanos-a1-klusterlet-crds          7m46s
addon-application-manager-deploy           7m14s
addon-cert-policy-controller-deploy        7m14s
addon-cluster-proxy-deploy-0               7m46s
addon-cluster-proxy-service-proxy          7m46s
addon-config-policy-controller-deploy      7m14s
addon-governance-policy-framework-deploy   7m13s
addon-iam-policy-controller-deploy         7m14s
addon-search-collector-deploy              7m44s
addon-submariner-deploy-0                  4s
addon-work-manager-deploy-0                7m46s
aws-submariner-gateway-machineset          3s

$ oc  describe managedclusteraddons "submariner" -n "acm-aws-nmanos-a1"
Name:         submariner
Namespace:    acm-aws-nmanos-a1
Labels:       <none>
Annotations:  <none>
API Version:  addon.open-cluster-management.io/v1alpha1
Kind:         ManagedClusterAddOn
Metadata:
  Creation Timestamp:  2022-11-14T15:19:10Z
  Generation:          1
  Managed Fields:
    API Version:  addon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubectl.kubernetes.io/last-applied-configuration:
      f:spec:
        .:
        f:installNamespace:
    Manager:      kubectl-client-side-apply
    Operation:    Update
    Time:         2022-11-14T15:19:10Z
    API Version:  addon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        .:
        f:addOnConfiguration:
        f:addOnMeta:
        f:conditions:
        f:healthCheck:
          .:
          f:mode:
        f:registrations:
    Manager:         Go-http-client
    Operation:       Update
    Subresource:     status
    Time:            2022-11-14T15:19:14Z
  Resource Version:  102746
  UID:               afb76f6b-3907-4905-92aa-ae778707eebc
Spec:
  Install Namespace:  submariner-operator
Status:
  Add On Configuration:
  Add On Meta:
  Conditions:
    Last Transition Time:  2022-11-14T15:19:11Z
    Message:               manifests of addon are applied successfully
    Reason:                AddonManifestApplied
    Status:                True
    Type:                  ManifestApplied
    Last Transition Time:  2022-11-14T15:19:11Z
    Message:               Registration of the addon agent is configured
    Reason:                RegistrationConfigured
    Status:                True
    Type:                  RegistrationApplied
    Last Transition Time:  2022-11-14T15:19:11Z
    Message:               client certificate rotated starting from 2022-11-14 15:14:11 +0000 UTC to 2022-11-15 13:27:58 +0000 UTC
    Reason:                ClientCertificateUpdated
    Status:                True
    Type:                  ClusterCertificateRotated
    Last Transition Time:  2022-11-14T15:22:06Z
    Message:               The nodes "ip-10-16-11-193.us-west-1.compute.internal" are labeled with "submariner.io/gateway"
    Reason:                SubmarinerGatewayNodesLabeled
    Status:                True
    Type:                  SubmarinerGatewayNodesLabeled
    Last Transition Time:  2022-11-14T15:19:26Z
    Message:               submariner add-on is available.
    Reason:                ManagedClusterAddOnLeaseUpdated
    Status:                True
    Type:                  Available
  Health Check:
    Mode:  Lease
  Registrations:
    Signer Name:  kubernetes.io/kube-apiserver-client
    Subject:
      Groups:
        system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner
        system:open-cluster-management:addon:submariner
        system:authenticated
      User:  system:open-cluster-management:cluster:acm-aws-nmanos-a1:addon:submariner:agent:submariner-addon-agent
Events:      <none>

$ oc  describe submarinerconfig "submariner" -n "acm-aws-nmanos-a1"
Name:         submariner
Namespace:    acm-aws-nmanos-a1
Labels:       <none>
Annotations:  <none>
API Version:  submarineraddon.open-cluster-management.io/v1alpha1
Kind:         SubmarinerConfig
Metadata:
  Creation Timestamp:  2022-11-14T15:19:09Z
  Finalizers:
    submarineraddon.open-cluster-management.io/config-cleanup
  Generation:  2
  Managed Fields:
    API Version:  submarineraddon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubectl.kubernetes.io/last-applied-configuration:
      f:spec:
        .:
        f:IPSecIKEPort:
        f:IPSecNATTPort:
        f:NATTDiscoveryPort:
        f:NATTEnable:
        f:airGappedDeployment:
        f:cableDriver:
        f:credentialsSecret:
          .:
          f:name:
        f:gatewayConfig:
          .:
          f:aws:
            .:
            f:instanceType:
          f:gateways:
        f:imagePullSpecs:
        f:loadBalancerEnable:
        f:subscriptionConfig:
          .:
          f:channel:
          f:source:
          f:sourceNamespace:
          f:startingCSV:
    Manager:      kubectl-client-side-apply
    Operation:    Update
    Time:         2022-11-14T15:19:09Z
    API Version:  submarineraddon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:finalizers:
          .:
          v:"submarineraddon.open-cluster-management.io/config-cleanup":
      f:spec:
        f:gatewayConfig:
          f:azure:
            .:
            f:instanceType:
          f:gcp:
            .:
            f:instanceType:
          f:rhos:
            .:
            f:instanceType:
    Manager:      submariner
    Operation:    Update
    Time:         2022-11-14T15:19:09Z
    API Version:  submarineraddon.open-cluster-management.io/v1alpha1
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        .:
        f:conditions:
        f:managedClusterInfo:
          .:
          f:clusterName:
          f:infraId:
          f:platform:
          f:region:
          f:vendor:
          f:vendorVersion:
    Manager:         submariner
    Operation:       Update
    Subresource:     status
    Time:            2022-11-14T15:19:13Z
  Resource Version:  102747
  UID:               d367c116-09c6-4def-a672-e4b2e9d73869
Spec:
  IP Sec IKE Port:        501
  IP Sec NATT Port:       4501
  NATT Discovery Port:    4900
  NATT Enable:            true
  Air Gapped Deployment:  false
  Cable Driver:           libreswan
  Credentials Secret:
    Name:  acm-aws-nmanos-a1-aws-creds
  Gateway Config:
    Aws:
      Instance Type:  c5d.large
    Azure:
      Instance Type:  Standard_D4s_v3
    Gateways:         1
    Gcp:
      Instance Type:  n1-standard-4
    Rhos:
      Instance Type:  PnTAE.CPU_16_Memory_32768_Disk_80
  Image Pull Specs:
  Load Balancer Enable:  false
  Subscription Config:
    Channel:           stable-0.14
    Source:            submariner-stable-0-14-catalog
    Source Namespace:  submariner-operator
    Starting CSV:      submariner.v0.14.0
Status:
  Conditions:
    Last Transition Time:  2022-11-14T15:19:13Z
    Message:               Submariner cluster environment was prepared
    Reason:                SubmarinerClusterEnvPrepared
    Status:                True
    Type:                  SubmarinerClusterEnvironmentPrepared
    Last Transition Time:  2022-11-14T15:22:06Z
    Message:               1 node(s) ("ip-10-16-11-193.us-west-1.compute.internal") are labeled as gateways
    Reason:                Success
    Status:                True
    Type:                  SubmarinerGatewaysLabeled
  Managed Cluster Info:
    Cluster Name:    acm-aws-nmanos-a1
    Infra Id:        aws-nmanos-a1-swctp
    Platform:        AWS
    Region:          us-west-1
    Vendor:          OpenShift
    Vendor Version:  4.11.13
Events:              <none>

$ oc  get nodes -l node-role.kubernetes.io/worker -o wide
NAME                                          STATUS   ROLES    AGE    VERSION           INTERNAL-IP     EXTERNAL-IP     OS-IMAGE                                                        KERNEL-VERSION                 CONTAINER-RUNTIME
ip-10-16-11-193.us-west-1.compute.internal    Ready    worker   23m    v1.24.6+5157800   10.16.11.193    13.52.246.240   Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
ip-10-16-134-138.us-west-1.compute.internal   Ready    worker   121m   v1.24.6+5157800   10.16.134.138   <none>          Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
ip-10-16-175-127.us-west-1.compute.internal   Ready    worker   117m   v1.24.6+5157800   10.16.175.127   <none>          Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
ip-10-16-204-110.us-west-1.compute.internal   Ready    worker   117m   v1.24.6+5157800   10.16.204.110   <none>          Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8

$ oc  describe Gateway -n submariner-operator
No resources found in submariner-operator namespace.

       

      Expected results:

      The Gateway object should be created.

      Additional info:

      Submariner gather logs in build artifacts.

              asuryana Aswin Suryanarayanan
              nmanos@redhat.com Noam Manos
              Maxim Babushkin Maxim Babushkin
              ACM QE Team
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: