Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-32014

adding 2nd VIP causes degraded node content mismatch coredns/Corefile.tmpl

XMLWordPrintable

    • Important
    • No
    • Rejected
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      Testing adding VIPs, after add one of the nodes is stuck

      Testing adding removing VIPs, after add and deletion, one of the nodes is stuck

        "machineconfiguration.openshift.io/reason": "unexpected on-disk state validating against rendered-master-9e627c165752a9a4fbe1eeb33d7ec3df: content mismatch for file \"/etc/kubernetes/static-pod-resources/coredns/Corefile.tmpl\"",
        "machineconfiguration.openshift.io/state": "Degraded"
      
      --- Corefile.tmpl.want  2024-04-09 15:01:49
      +++ Corefile.tmpl       2024-04-09 15:02:16
      @@ -14,7 +14,7 @@
           }
           template IN {{ .Cluster.IngressVIPEmptyType }} rbratta-o16r1s-0.qe.lab.redhat.com {
               match .*[.]apps.rbratta-o16r1s-0.qe.lab.redhat.com
      -        answer "{{"{{ .Name }}"}} 60 in {{"{{ .Type }}"}} fd2e:6f44:5dd8::5"
      +
               fallthrough
           }
           template IN {{ .Cluster.APIVIPRecordType }} rbratta-o16r1s-0.qe.lab.redhat.com {
      @@ -24,7 +24,7 @@
           }
           template IN {{ .Cluster.APIVIPEmptyType }} rbratta-o16r1s-0.qe.lab.redhat.com {
               match ^api.rbratta-o16r1s-0.qe.lab.redhat.com
      -        answer "{{"{{ .Name }}"}} 60 in {{"{{ .Type }}"}} fd2e:6f44:5dd8::4"
      +
               fallthrough
           }
           template IN {{ .Cluster.APIVIPRecordType }} rbratta-o16r1s-0.qe.lab.redhat.com {
      @@ -34,7 +34,7 @@
           }
           template IN {{ .Cluster.APIVIPEmptyType }} rbratta-o16r1s-0.qe.lab.redhat.com {
               match ^api-int.rbratta-o16r1s-0.qe.lab.redhat.com
      -        answer "{{"{{ .Name }}"}} 60 in {{"{{ .Type }}"}} fd2e:6f44:5dd8::4"
      +
               fallthrough
           }
      

      Version-Release number of selected component (if applicable):

      4.16.0-0.nightly-2024-04-08-024331
          

      How reproducible:

      Once
          

      Steps to Reproduce:

       

      
      1.     install single-stack baremetal
      2.     convert to dualstack
      3.     add IPv6 VIP
      4.     content mismatch Corefile.tmpl
      
      
          1. install single-stack cluster in IPv4/IPv6 network
          2. add second vip
      oc patch infrastructure cluster --type='json' -p='[{"op": "add", "path": "/spec/platformSpec/baremetal/apiServerInternalIPs/-", "value": "'$(oc get infrastructures cluster -o jsonpath='{.status.platformStatus.baremetal.machineNetworks[1]}' | sed -e 's#/[0-9]*#4#')'"}, {"op": "add", "path": "/spec/platformSpec/baremetal/ingressIPs/-", "value": "'$(oc get infrastructures cluster -o jsonpath='{.status.platformStatus.baremetal.machineNetworks[1]}' | sed -e 's#/[0-9]*#5#')'"}]'
          3. delete second vip
      oc patch infrastructure cluster --type='json' -p='[{"op": "remove", "path": "/spec/platformSpec/baremetal/apiServerInternalIPs/1"}, {"op": "remove", "path": "/spec/platformSpec/baremetal/ingressIPs/1"}]'
          

      Actual results:

        "machineconfiguration.openshift.io/reason": "unexpected on-disk state validating against rendered-master-9e627c165752a9a4fbe1eeb33d7ec3df: content mismatch for file \"/etc/kubernetes/static-pod-resources/coredns/Corefile.tmpl\"",
        "machineconfiguration.openshift.io/state": "Degraded"
      
          

      Expected results:

      No degraded nodes.

      Additional info:

        spec:
          cloudConfig:
            name: ""
          platformSpec:
            baremetal:
              apiServerInternalIPs:
              - 192.168.123.5
              - fd2e:6f44:5dd8::4
              ingressIPs:
              - 192.168.123.10
              - fd2e:6f44:5dd8::5
              machineNetworks:
              - 192.168.123.0/24
              - fd2e:6f44:5dd8::/64
            type: BareMetal
        status:
          platform: BareMetal
          platformStatus:
            baremetal:
              apiServerInternalIP: 192.168.123.5
              apiServerInternalIPs:
              - 192.168.123.5
              - fd2e:6f44:5dd8::4
              ingressIP: 192.168.123.10
              ingressIPs:
              - 192.168.123.10
              - fd2e:6f44:5dd8::5
              loadBalancer:
                type: OpenShiftManagedDefault
              machineNetworks:
              - 192.168.123.0/24
              - fd2e:6f44:5dd8::/64
            type: BareMetal
          

      install-config

      networking:
        networkType: OVNKubernetes
        machineNetwork:
        - cidr: 192.168.123.0/24
        - cidr: fd2e:6f44:5dd8::/64
        clusterNetwork:
        - cidr: 10.128.0.0/14
          hostPrefix: 23
        serviceNetwork:
        - 172.30.0.0/16
      

            mkowalsk@redhat.com Mat Kowalski
            rbrattai@redhat.com Ross Brattain
            Anurag Saxena Anurag Saxena
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: