Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-4067

Kernel version in added RHEL8 compute nodes doesn't align with OCP4 compatibility

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • None
    • 4.11, 4.10
    • Documentation
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • 2
    • Important
    • None
    • None
    • None
    • Rejected
    • OSDOCS Sprint 229, OSDOCS Sprint 230
    • 2
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      Kernel version in added RHEL8 compute nodes doesn't align with OCP4 compatibility.
      
      According to the article[0], 
      OCP4.10 is supported with RHEL 8.4/8.5 compute node
      OCP4.11 is supported with RHEL 8.5/8.6 compute node
      
      [0]OpenShift Container Platform 4.x Tested Integrations (for x86_x64)
      - https://access.redhat.com/articles/4763741
      
      However if I add rhel nodes according to the procedure in the manual documentation, the latest rhel8 kernel(4.18.0-425.3.1.el8.x86_64) is always installed.
      
      4.18.0-425.3.1.el8.x86_64 kernel is for RHEL 8.7
      
      Is it an expected behavior?
      Is it supported that the rhel 8.4 or rhel 8.5 OS with higher rhel8 kernel versions(latest version) is running in rhel compute nodes for OCP4.10 and OCP 4.11?
      
      Customers is confused whether higher kernel version with RHEL8.4 and RHEL8.5 is supported in OCP4.10/OCP4.11 or not.
      
      If higher rhel8 kernel version is not supported, documentation[1][2][3][4] should be fixed.
      In the documentation, rhel compute node enable below repositories.
      It looks like that ansible playbook always refers to the latest kernel version in rhel-8-for-x86_64-baseos-rpms repository and updates the kernel when adding or updating rhel compute node.
      
      # subscription-manager repos \
          --enable="rhel-8-for-x86_64-baseos-rpms" \
          --enable="rhel-8-for-x86_64-appstream-rpms" \
          --enable="ansible-2.9-for-rhel-8-x86_64-rpms" \
          --enable="rhocp-4.10-for-rhel-8-x86_64-rpms"
      
      I believe that users need to set the OS release version to avoid updating to the latest kernel version from the RHEL 8 repositoriy which is not alingned with OCP compatibility.
      
      $ subscription-manager release --set=8.4
      $ subscription-manager release --set=8.6  

      Version-Release number of selected component (if applicable):

      OCP4.10 / OCP4.11

      How reproducible:

      Add rhel worker node to the ocp cluster according to the procedure in the manual documentation.

      Steps to Reproduce:

      1. Enable repos
      # subscription-manager repos \
          --enable="rhel-8-for-x86_64-baseos-rpms" \
          --enable="rhel-8-for-x86_64-appstream-rpms" \
          --enable="rhocp-4.10-for-rhel-8-x86_64-rpms" \
          --enable="fast-datapath-for-rhel-8-x86_64-rpms" 
      
      2. Set hosts file
      [all:vars]
      ansible_user=root 
      #ansible_become=True 
      
      openshift_kubeconfig_path="~/.kube/config" 
      
      [new_workers] 
      mycluster-rhel8-0.example.com
      mycluster-rhel8-1.example.com 
      
      3. Run ansible playbook for scaleup node.
      $ cd /usr/share/ansible/openshift-ansible
      $ ansible-playbook -i /<path>/inventory/hosts playbooks/scaleup.yml 
      
      * OCP4.10 
      [1]Adding RHEL compute machines to an OpenShift Container Platform cluster 
      - https://docs.openshift.com/container-platform/4.10/machine_management/adding-rhel-compute.html#rhel-preparing-node_adding-rhel-compute 
      [2]Updating RHEL compute machines in your cluster 
      - https://docs.openshift.com/container-platform/4.10/updating/updating-cluster-rhel-compute.html#rhel-compute-updating-minor_updating-cluster-rhel-compute 
      
      * OCP4.11 
      [3]Adding RHEL compute machines to an OpenShift Container Platform cluster 
      - https://docs.openshift.com/container-platform/4.11/machine_management/adding-rhel-compute.html 
      [4]Updating RHEL compute machines in your cluster 
      - https://docs.openshift.com/container-platform/4.11/updating/updating-cluster-rhel-compute.html#rhel-compute-updating-minor_updating-cluster-rhel-compute 

      Actual results:

       

      RHEL8.4 and RHEL8.6 compute nodes are updated to the latest kernel version for RHEL8.7
      The kerner version is not aligned with OS release version.
      
      # OCP 4.10 : worker-2 is a rhel compute node and kernel version is 4.18.0-425.3.1.el8.x86_64 (the latest rhel8 kernel for RHEL8.7)
      $oc get node -o wide
      NAME                          STATUS   ROLES           AGE     VERSION            INTERNAL-IP     EXTERNAL-IP   OS-IMAGE                                                        KERNEL-VERSION                 CONTAINER-RUNTIME
      master-1.ocp410.example.com   Ready    master,worker   3h39m   v1.23.5+012e945    192.168.3.63    <none>        Red Hat Enterprise Linux CoreOS 410.84.202207262020-0 (Ootpa)   4.18.0-305.57.1.el8_4.x86_64   cri-o://1.23.3-11.rhaos4.10.gitddf4b1a.1.el8
      master-2.ocp410.example.com   Ready    master,worker   3h39m   v1.23.5+012e945    192.168.3.190   <none>        Red Hat Enterprise Linux CoreOS 410.84.202207262020-0 (Ootpa)   4.18.0-305.57.1.el8_4.x86_64   cri-o://1.23.3-11.rhaos4.10.gitddf4b1a.1.el8
      master-3.ocp410.example.com   Ready    master,worker   3h39m   v1.23.5+012e945    192.168.3.31    <none>        Red Hat Enterprise Linux CoreOS 410.84.202207262020-0 (Ootpa)   4.18.0-305.57.1.el8_4.x86_64   cri-o://1.23.3-11.rhaos4.10.gitddf4b1a.1.el8
      worker-1.ocp410.example.com   Ready    worker          3h22m   v1.23.5+012e945    192.168.3.172   <none>        Red Hat Enterprise Linux CoreOS 410.84.202207262020-0 (Ootpa)   4.18.0-305.57.1.el8_4.x86_64   cri-o://1.23.3-11.rhaos4.10.gitddf4b1a.1.el8
      worker-2.ocp410.example.com   Ready    worker          13m     v1.23.12+8a6bfe4   192.168.3.163   <none>        Red Hat Enterprise Linux 8.4 (Ootpa)                            4.18.0-425.3.1.el8.x86_64      cri-o://1.23.3-20.rhaos4.10.git89344de.el8
      
      # OCP 4.11 : worker-2 is a rhel compute node and kernel version is 4.18.0-425.3.1.el8.x86_64 (the latest rhel8 kernel for RHEL8.7)
      $oc get node -o wide
      NAME                          STATUS   ROLES           AGE   VERSION           INTERNAL-IP     EXTERNAL-IP   OS-IMAGE                                                        KERNEL-VERSION                 CONTAINER-RUNTIME
      master-1.ocp411.example.com   Ready    master,worker   38d   v1.24.6+5157800   192.168.9.126   <none>        Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      master-2.ocp411.example.com   Ready    master,worker   38d   v1.24.6+5157800   192.168.9.123   <none>        Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      master-3.ocp411.example.com   Ready    master,worker   38d   v1.24.6+5157800   192.168.9.210   <none>        Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      worker-1.ocp411.example.com   Ready    worker          37d   v1.24.6+5157800   192.168.9.60    <none>        Red Hat Enterprise Linux CoreOS 411.86.202210311708-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8
      worker-2.ocp411.example.com   Ready    worker          37d   v1.24.6+5157800   192.168.9.85    <none>        Red Hat Enterprise Linux 8.4 (Ootpa)                            4.18.0-425.3.1.el8.x86_64      cri-o://1.24.3-5.rhaos4.11.gitc4567c0.el8   

       

       

      Expected results:

      RHEL8.4 compute node should be updated to the latest kernel for RHEL8.4
      RHEL8.6 compute node should be updated to the lastet kernel for RHEL8.6

      Additional info:

       

              jaldinge@redhat.com Joe Aldinger
              rhn-support-hyoskim Sophia Hyosun Kim
              None
              None
              Gaoyun Pei Gaoyun Pei
              None
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: