Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-23075

kvdo module not found in latest 9.3 kernel (5.14.0-362.18.1.el9_3)

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Major Major
    • rhel-9.3.0.z
    • rhel-9.3.0.z
    • kmod-kvdo
    • None
    • kmod-kvdo-8.2.1.6-102.el9_3
    • None
    • None
    • rhel-sst-logical-storage
    • ssg_filesystems_storage_and_HA
    • 25
    • 1
    • QE ack, Dev ack
    • False
    • Hide

      None

      Show
      None
    • None
    • Red Hat Enterprise Linux
    • None
    • None

      Description of problem:
      The kmod-kvdo does not work with the latest 9.3 kernel.

      Steps to Reproduce:
      1. Install latest RHEL-9.3.0
      2. Install package (kernel and kmod-kvdo)
      3. Run `modprobe kvdo`.

      Actual results:
      Modules fails load

      root@rhel9 ~]# modinfo kvdo
      modinfo: ERROR: Module kvdo not found.

      Expected results:
      Modules loaded

      Package info:
      kmod-kvdo-8.2.1.6-98.el9.x86_64
      kernel-5.14.0-362.18.1.el9_3.x86_64

       Additional Info:
      It works fine till 5.14.0-362.13.1.el9_3 which is the n-1 release

      #modinfo kvdo
      filename:       /lib/modules/5.14.0-362.13.1.el9_3.x86_64/weak-updates/kmod-kvdo/vdo/kvdo.ko

       

            [RHEL-23075] kvdo module not found in latest 9.3 kernel (5.14.0-362.18.1.el9_3)

            Errata Tool added a comment -

            Since the problem described in this issue should be resolved in a recent advisory, it has been closed.

            For information on the advisory (kmod-kvdo bug fix update), and where to find the updated files, follow the link below.

            If the solution does not work for you, open a new bug report.
            https://access.redhat.com/errata/RHBA-2024:1361

            Errata Tool added a comment - Since the problem described in this issue should be resolved in a recent advisory, it has been closed. For information on the advisory (kmod-kvdo bug fix update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2024:1361

            Filip Suba added a comment -

            Verified that kmod-kvdo-8.2.1.6-102.el9_3 works with latest kernel.

            1. uname -r
              5.14.0-362.24.1.el9_3.x86_64
            2. modprobe kvdo
            3. lsmod | grep kvdo
              kvdo                  876544  2
              dm_bufio               53248  1 kvdo
              dm_mod                237568  32 kvdo,dm_log,dm_mirror,dm_bufio

            Filip Suba added a comment - Verified that kmod-kvdo-8.2.1.6-102.el9_3 works with latest kernel. uname -r 5.14.0-362.24.1.el9_3.x86_64 modprobe kvdo lsmod | grep kvdo kvdo                  876544  2 dm_bufio               53248  1 kvdo dm_mod                237568  32 kvdo,dm_log,dm_mirror,dm_bufio

            I have the exact same problem. I had the same problem in the past and it was resolved by RHBA-2023:6586, but it came back with a recent update.

            Naoya NIWA (Inactive) added a comment - I have the exact same problem. I had the same problem in the past and it was resolved by RHBA-2023 :6586, but it came back with a recent update.

            Jon Magrini added a comment -

            Reproduced with 5.14.0-362.18.1.el9_3, seems specific to latest 9.3.z:

            Installed:
              kernel-5.14.0-362.18.1.el9_3.x86_64   kernel-core-5.14.0-362.18.1.el9_3.x86_64   kernel-modules-5.14.0-362.18.1.el9_3.x86_64   kernel-modules-core-5.14.0-362.18.1.el9_3.x86_64
              
            Installed:
              kmod-kvdo-8.2.1.6-98.el9.x86_64 

              Attempt to load kvdo: 
              

            [root@localhost ~]# modprobe kvdo
            modprobe: FATAL: Module kvdo not found in directory /lib/modules/5.14.0-362.18.1.el9_3.x86_64

            root@localhost ~]# ls -al /lib/modules/`uname -r`/weak-updates
            total 4
            drwxr-xr-x. 2 root root 6 Jan 30 09:13 .
            drwxr-xr-x. 7 root root 4096 Jan 30 09:13 ..

            Jon Magrini added a comment - Reproduced with 5.14.0-362.18.1.el9_3, seems specific to latest 9.3.z: Installed:   kernel-5.14.0-362.18.1.el9_3.x86_64   kernel-core-5.14.0-362.18.1.el9_3.x86_64   kernel-modules-5.14.0-362.18.1.el9_3.x86_64   kernel-modules-core-5.14.0-362.18.1.el9_3.x86_64    Installed:   kmod-kvdo-8.2.1.6-98.el9.x86_64    Attempt to load kvdo:     [root@localhost ~]# modprobe kvdo modprobe: FATAL: Module kvdo not found in directory /lib/modules/5.14.0-362.18.1.el9_3.x86_64 root@localhost ~]# ls -al /lib/modules/`uname -r`/weak-updates total 4 drwxr-xr-x. 2 root root 6 Jan 30 09:13 . drwxr-xr-x. 7 root root 4096 Jan 30 09:13 ..

            Aaron Smith (Inactive) added a comment - - edited

            same issue here:

            [root@localhost]# uname -a
            Linux localhost 5.14.0-362.18.1.el9_3.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jan 3 15:54:45 EST 2024 x86_64 x86_64 x86_64 GNU/Linux
            [root@localhost]# rpm -qa | grep vdo
            vdo-support-8.2.2.2-1.el9.x86_64
            kmod-kvdo-8.2.1.6-98.el9.x86_64
            vdo-8.2.2.2-1.el9.x86_64
            [root@localhost ]# modprobe kvdo
            modprobe: FATAL: Module kvdo not found in directory /lib/modules/5.14.0-362.18.1.el9_3.x86_64
            [root@localhost ]# modinfo kvdo
            modinfo: ERROR: Module kvdo not found.

            [root@localhost ]# cd /lib/modules
            [root@localhost ]# find . -name 'vdo'
            ./5.14.0-360.el9.x86_64/extra/kmod-kvdo
            ./5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo
            ./5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo/kvdo.ko

            Aaron Smith (Inactive) added a comment - - edited same issue here: [root@localhost] # uname -a Linux localhost 5.14.0-362.18.1.el9_3.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jan 3 15:54:45 EST 2024 x86_64 x86_64 x86_64 GNU/Linux [root@localhost] # rpm -qa | grep vdo vdo-support-8.2.2.2-1.el9.x86_64 kmod-kvdo-8.2.1.6-98.el9.x86_64 vdo-8.2.2.2-1.el9.x86_64 [root@localhost ] # modprobe kvdo modprobe: FATAL: Module kvdo not found in directory /lib/modules/5.14.0-362.18.1.el9_3.x86_64 [root@localhost ] # modinfo kvdo modinfo: ERROR: Module kvdo not found. [root@localhost ] # cd /lib/modules [root@localhost ] # find . -name ' vdo ' ./5.14.0-360.el9.x86_64/extra/kmod-kvdo ./5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo ./5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo/kvdo.ko

            We use weak-updates to install the module in the current tree. But when we unpack the RPM, yes, /lib/modules/<older NVR> is created based on what kernel the kmod-kvdo module was built against. That is to be expected. When issuing the modprobe command, it should be 'modprobe kvdo'. The kmod prefix should not be used for modprobe.

            [root@localhost ~]# uname -r
            5.14.0-362.8.1.el9_3.x86_64
            
            [root@localhost ~]# dnf install kmod-kvdo
            ...
            Installed:
              kmod-kvdo-8.2.1.6-98.el9.x86_64 
            
            [root@localhost ~]# ls /lib/modules
            5.14.0-360.el9.x86_64  5.14.0-362.8.1.el9_3.x86_64
            
            [root@localhost ~]# ls /lib/modules/`uname -r`/weak-updates
            kmod-kvdo
            
            [root@localhost ~]# modprobe kmod-kvdo
            modprobe: FATAL: Module kmod-kvdo not found in directory /lib/modules/5.14.0-362.8.1.el9_3.x86_64
            
            [root@localhost ~]# modprobe kvdo
            [root@localhost ~]# modinfo kvdo
            [root@vm-10-0-187-221 modules]# modinfo kvdo
            filename:       /lib/modules/5.14.0-362.8.1.el9_3.x86_64/weak-updates/kmod-kvdo/vdo/kvdo.ko
            version:        8.2.1.6
            license:        GPL
            author:         Red Hat, Inc.
            description:    device-mapper target for transparent deduplication
            description:    LZ4 compressor
            license:        Dual BSD/GPL
            rhelversion:    9.3
            srcversion:     671AA943863D42729AE5454
            depends:        dm-mod,dm-bufio
            retpoline:      Y
            name:           kvdo
            vermagic:       5.14.0-360.el9.x86_64 SMP preempt mod_unload modversions 
            sig_id:         PKCS#7
            signer:         Red Hat Enterprise Linux Driver Update Program (key 3)
            ...
            

            Susan LeGendre McGhee added a comment - We use weak-updates to install the module in the current tree. But when we unpack the RPM, yes, /lib/modules/<older NVR> is created based on what kernel the kmod-kvdo module was built against. That is to be expected. When issuing the modprobe command, it should be 'modprobe kvdo'. The kmod prefix should not be used for modprobe. [root@localhost ~]# uname -r 5.14.0-362.8.1.el9_3.x86_64 [root@localhost ~]# dnf install kmod-kvdo ... Installed: kmod-kvdo-8.2.1.6-98.el9.x86_64 [root@localhost ~]# ls /lib/modules 5.14.0-360.el9.x86_64 5.14.0-362.8.1.el9_3.x86_64 [root@localhost ~]# ls /lib/modules/`uname -r`/weak-updates kmod-kvdo [root@localhost ~]# modprobe kmod-kvdo modprobe: FATAL: Module kmod-kvdo not found in directory /lib/modules/5.14.0-362.8.1.el9_3.x86_64 [root@localhost ~]# modprobe kvdo [root@localhost ~]# modinfo kvdo [root@vm-10-0-187-221 modules]# modinfo kvdo filename: /lib/modules/5.14.0-362.8.1.el9_3.x86_64/weak-updates/kmod-kvdo/vdo/kvdo.ko version: 8.2.1.6 license: GPL author: Red Hat, Inc. description: device-mapper target for transparent deduplication description: LZ4 compressor license: Dual BSD/GPL rhelversion: 9.3 srcversion: 671AA943863D42729AE5454 depends: dm-mod,dm-bufio retpoline: Y name: kvdo vermagic: 5.14.0-360.el9.x86_64 SMP preempt mod_unload modversions sig_id: PKCS#7 signer: Red Hat Enterprise Linux Driver Update Program (key 3) ...

            Jon Magrini added a comment -

            slegendr@redhat.com Thanks for the info and the update, unfortunately I didn't see your comment before I started reproducing.  

            Jon Magrini added a comment - slegendr@redhat.com Thanks for the info and the update, unfortunately I didn't see your comment before I started reproducing.  

            Jon Magrini added a comment -

            The issue appears to be due to kmod-kvdo installs the module into `/lib/modules/5.14.0-360.el9.x86_64` and not the current tree. 

             

            [root@localhost ~]# ls /lib/modules/5.14.0-36
            5.14.0-360.el9.x86_64/       5.14.0-362.8.1.el9_3.x86_64/
            [root@localhost ~]# ls /lib/modules/5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo/kvdo.ko 
            /lib/modules/5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo/kvdo.ko
            

             

            Jon Magrini added a comment - The issue appears to be due to kmod-kvdo installs the module into `/lib/modules/5.14.0-360.el9.x86_64` and not the current tree.    [root@localhost ~]# ls /lib/modules/5.14.0-36 5.14.0-360.el9.x86_64/       5.14.0-362.8.1.el9_3.x86_64/ [root@localhost ~]# ls /lib/modules/5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo/kvdo.ko  /lib/modules/5.14.0-360.el9.x86_64/extra/kmod-kvdo/vdo/kvdo.ko  

            Jon Magrini added a comment - - edited

            [root@localhost ~]# uname -r
            5.14.0-362.8.1.el9_3.x86_64

            [root@localhost ~]# dnf info kmod-kvdo
            Updating Subscription Management repositories.
            Last metadata expiration check: 0:00:09 ago on Mon Jan 29 13:01:47 2024.
            Available Packages
            Name         : kmod-kvdo
            Version      : 8.2.1.6
            Release      : 98.el9
            Architecture : x86_64
            Size         : 337 k
            Source       : kmod-kvdo-8.2.1.6-98.el9.src.rpm
            Repository   : rhel-9-for-x86_64-baseos-rpms
            Summary      : Kernel Modules for Virtual Data Optimizer
            URL          : http://github.com/dm-vdo/kvdo
            License      : GPLv2+
            Description  : Virtual Data Optimizer (VDO) is a device mapper target that delivers
                         : block-level deduplication, compression, and thin provisioning.
                         : 
                         : This package provides the kernel modules for VDO.

             

            [root@localhost ~]# dnf install kmod-kvdo
            [..]
            Downloading Packages:
            kmod-kvdo-8.2.1.6-98.el9.x86_64.rpm
            [..]
            Installed:
              kmod-kvdo-8.2.1.6-98.el9.x86_64

            [root@localhost ~]# modprobe kmod-kvdo
            modprobe: FATAL: Module kmod-kvdo not found in directory /lib/modules/5.14.0-362.8.1.el9_3.x86_64

            Jon Magrini added a comment - - edited [root@localhost ~] # uname -r 5.14.0-362.8.1.el9_3.x86_64 [root@localhost ~] # dnf info kmod-kvdo Updating Subscription Management repositories. Last metadata expiration check: 0:00:09 ago on Mon Jan 29 13:01:47 2024. Available Packages Name         : kmod-kvdo Version      : 8.2.1.6 Release      : 98.el9 Architecture : x86_64 Size         : 337 k Source       : kmod-kvdo-8.2.1.6-98.el9.src.rpm Repository   : rhel-9-for-x86_64-baseos-rpms Summary      : Kernel Modules for Virtual Data Optimizer URL          : http://github.com/dm-vdo/kvdo License      : GPLv2+ Description  : Virtual Data Optimizer (VDO) is a device mapper target that delivers              : block-level deduplication, compression, and thin provisioning.              :               : This package provides the kernel modules for VDO.   [root@localhost ~] # dnf install kmod-kvdo [..] Downloading Packages: kmod-kvdo-8.2.1.6-98.el9.x86_64.rpm [..] Installed:   kmod-kvdo-8.2.1.6-98.el9.x86_64 [root@localhost ~] # modprobe kmod-kvdo modprobe: FATAL: Module kmod-kvdo not found in directory /lib/modules/5.14.0-362.8.1.el9_3.x86_64

            Jon Magrini added a comment - - edited

            As this is RHELPLAN, was this resolved in RHBA-2023:6586 via RHELPLAN-149795. Or is this still an issue where this needs migrated to RHEL Jira project? 

            Jon Magrini added a comment - - edited As this is RHELPLAN, was this resolved in RHBA-2023:6586 via RHELPLAN-149795. Or is this still an issue where this needs migrated to RHEL Jira project? 

              rhn-support-fsuba Filip Suba
              rhn-support-shivgupt Shivam Gupta
              Susan LeGendre McGhee Susan LeGendre McGhee
              Filip Suba Filip Suba
              Votes:
              2 Vote for this issue
              Watchers:
              14 Start watching this issue

                Created:
                Updated:
                Resolved: