Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-4724

[4.13] egressIP annotations not present on OpenShift on Openstack multiAZ installation

XMLWordPrintable

    • Important
    • None
    • SDN Sprint 229
    • 1
    • Rejected
    • False
    • Hide

      None

      Show
      None

      Description of problem: Installing OCP4.12 on top of Openstack 16.1 following the multi-availabilityZone installation is creating a cluster where the egressIP annotations ("cloud.network.openshift.io/egress-ipconfig") are created with empty value for the workers:

      $ oc get nodes
      NAME                          STATUS   ROLES                  AGE   VERSION
      ostest-kncvv-master-0         Ready    control-plane,master   9h    v1.25.4+86bd4ff
      ostest-kncvv-master-1         Ready    control-plane,master   9h    v1.25.4+86bd4ff
      ostest-kncvv-master-2         Ready    control-plane,master   9h    v1.25.4+86bd4ff
      ostest-kncvv-worker-0-qxr5g   Ready    worker                 8h    v1.25.4+86bd4ff
      ostest-kncvv-worker-1-bmvvv   Ready    worker                 8h    v1.25.4+86bd4ff
      ostest-kncvv-worker-2-pbgww   Ready    worker                 8h    v1.25.4+86bd4ff
      $ oc get node ostest-kncvv-worker-0-qxr5g -o json | jq -r '.metadata.annotations' 
      {
        "alpha.kubernetes.io/provided-node-ip": "10.196.2.156",
        "cloud.network.openshift.io/egress-ipconfig": "null",
        "csi.volume.kubernetes.io/nodeid": "{\"cinder.csi.openstack.org\":\"8327aef0-c6a7-4bf6-8f8f-d25c9abd9bce\",\"manila.csi.openstack.org\":\"ostest-kncvv-worker-0-qxr5g\"}",
        "k8s.ovn.org/host-addresses": "[\"10.196.2.156\",\"172.17.5.154\"]",
        "k8s.ovn.org/l3-gateway-config": "{\"default\":{\"mode\":\"shared\",\"interface-id\":\"br-ex_ostest-kncvv-worker-0-qxr5g\",\"mac-address\":\"fa:16:3e:7e:b5:70\",\"ip-addresses\":[\"10.196.2.156/16\"],\"ip-address\":\"10.196.2.156/16\",\"next-hops\":[\"10.196.0.1\"],\"next-hop\":\"10.196.0.1\",\"node-port-enable\":\"true\",\"vlan-id\":\"0\"}}",
        "k8s.ovn.org/node-chassis-id": "fd777b73-aa64-4fa5-b0b1-70c3bebc2ac6",
        "k8s.ovn.org/node-gateway-router-lrp-ifaddr": "{\"ipv4\":\"100.64.0.6/16\"}",
        "k8s.ovn.org/node-mgmt-port-mac-address": "42:e8:4f:42:9f:7d",
        "k8s.ovn.org/node-primary-ifaddr": "{\"ipv4\":\"10.196.2.156/16\"}",
        "k8s.ovn.org/node-subnets": "{\"default\":\"10.128.2.0/23\"}",
        "machine.openshift.io/machine": "openshift-machine-api/ostest-kncvv-worker-0-qxr5g",
        "machineconfiguration.openshift.io/controlPlaneTopology": "HighlyAvailable",
        "machineconfiguration.openshift.io/currentConfig": "rendered-worker-31323caf2b510e5b81179bb8ec9c150f",
        "machineconfiguration.openshift.io/desiredConfig": "rendered-worker-31323caf2b510e5b81179bb8ec9c150f",
        "machineconfiguration.openshift.io/desiredDrain": "uncordon-rendered-worker-31323caf2b510e5b81179bb8ec9c150f",
        "machineconfiguration.openshift.io/lastAppliedDrain": "uncordon-rendered-worker-31323caf2b510e5b81179bb8ec9c150f",
        "machineconfiguration.openshift.io/reason": "",
        "machineconfiguration.openshift.io/state": "Done",
        "volumes.kubernetes.io/controller-managed-attach-detach": "true"
      }
      

      Furthermore, Below is observed on openshift-cloud-network-config-controller:

      $ oc logs -n openshift-cloud-network-config-controller          cloud-network-config-controller-5fcdb6fcff-6sddj | grep egress
      I1212 00:34:14.498298       1 node_controller.go:146] Setting annotation: 'cloud.network.openshift.io/egress-ipconfig: null' on node: ostest-kncvv-worker-2-pbgww
      I1212 00:34:15.777129       1 node_controller.go:146] Setting annotation: 'cloud.network.openshift.io/egress-ipconfig: null' on node: ostest-kncvv-worker-0-qxr5g
      I1212 00:38:13.115115       1 node_controller.go:146] Setting annotation: 'cloud.network.openshift.io/egress-ipconfig: null' on node: ostest-kncvv-worker-1-bmvvv
      I1212 01:58:54.414916       1 node_controller.go:146] Setting annotation: 'cloud.network.openshift.io/egress-ipconfig: null' on node: ostest-kncvv-worker-0-drd5l
      I1212 02:01:03.312655       1 node_controller.go:146] Setting annotation: 'cloud.network.openshift.io/egress-ipconfig: null' on node: ostest-kncvv-worker-1-h976w
      I1212 02:04:11.656408       1 node_controller.go:146] Setting annotation: 'cloud.network.openshift.io/egress-ipconfig: null' on node: ostest-kncvv-worker-2-zxwrv
      

      Version-Release number of selected component (if applicable):

      RHOS-16.1-RHEL-8-20221206.n.1
      4.12.0-0.nightly-2022-12-09-063749
      

      How reproducible:

      Always
      

      Steps to Reproduce:

      1. Run AZ job on D/S CI (Openshift on Openstack QE CI)
      2. Run conformance/serial tests
      

      Actual results:

      conformance/serial TCs are failing because it is not finding the egressIP annotation on the workers
      

      Expected results:

      Tests passing
      

      Additional info:

      Links provided on private comment.
      

              akaris@redhat.com Andreas Karis
              rlobillo Ramón Lobillo
              Huiran Wang Huiran Wang
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated:
                Resolved: