Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-31362

SRIOV: Cluster was drained twice after applying SRIOV policy with the externally managed flag.

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Undefined Undefined
    • 4.16.0
    • 4.14.z
    • Networking / SR-IOV
    • None
    • Important
    • None
    • CNF Network Sprint 251, CNF Network Sprint 252
    • 2
    • False
    • Hide

      None

      Show
      None
    • Hide
      5/9 - color: green
      4/30 - 4.15 backport PR in progress, to be tested by QE before merging
      4/24 - merged u/s and d/s 4.16.0
      4/16 - merged u/s - waiting to sync d/s
      Show
      5/9 - color: green 4/30 - 4.15 backport PR in progress, to be tested by QE before merging 4/24 - merged u/s and d/s 4.16.0 4/16 - merged u/s - waiting to sync d/s

      Description of problem:

      - apiVersion: sriovnetwork.openshift.io/v1
        kind: SriovNetworkNodePolicy
        metadata:
          creationTimestamp: "2024-03-21T21:09:14Z"
          generation: 1
          name: extmanaged
          namespace: openshift-sriov-network-operator
          resourceVersion: "223522"
          uid: 48b7330d-ad7f-4732-8364-1d8810b77f49
        spec:
          deviceType: netdevice
          externallyManaged: true
          isRdma: false
          nicSelector:
            pfNames:
            - ens5f0#0-1
          nodeSelector:
            node-role.kubernetes.io/workercnf: ""
          numVfs: 5
          priority: 1
          resourceName: extmanaged

      Version-Release number of selected component (if applicable):

      How reproducible:

      Steps to Reproduce:

      1.       Create VFs via nmstate.
      2. Apply SR-IOV policy and network.
      3. Wait for the cluster to stabilize.
      4. After approximately 5 minutes, SR-IOV starts draining again without any changes being made.

      Actual results:

      Expected results:

      Additional info:

      I0321 21:14:09.101149 242034 daemon.go:429] nodeStateSyncHandler(): new generation is 20 I0321 21:14:09.142026 242034 daemon.go:470] nodeStateSyncHandler(): Interface not changed I0321 21:14:09.142061 242034 daemon.go:365] Successfully synced I0321 21:14:09.142072 242034 daemon.go:328] worker queue size: 0 I0321 21:14:10.672194 242034 daemon.go:303] Run(): period refresh I0321 21:14:10.672275 242034 daemon.go:1042] tryCreateSwitchdevUdevRule() I0321 21:14:15.936116 242034 daemon.go:334] get item: 21 I0321 21:14:15.940704 242034 daemon.go:429] nodeStateSyncHandler(): new generation is 21 I0321 21:14:15.966019 242034 writer.go:103] Run(): refresh trigger I0321 21:14:15.966038 242034 writer.go:123] pollNicStatus() I0321 21:14:15.966046 242034 utils.go:71] DiscoverSriovDevices I0321 21:14:16.102718 242034 utils.go:120] DiscoverSriovDevices(): unsupported device 0000:18:00.0 -> driver: 'tg3' class: 'Network controller' vendor: 'Broadcom Inc. and subsidiaries' product: 'NetXtreme BCM5720 Gigabit Ethernet PCIe' I0321 21:14:16.102780 242034 utils.go:120] DiscoverSriovDevices(): unsupported device 0000:18:00.1 -> driver: 'tg3' class: 'Network controller' vendor: 'Broadcom Inc. and subsidiaries' product: 'NetXtreme BCM5720 Gigabit Ethernet PCIe' I0321 21:14:16.102815 242034 utils.go:120] DiscoverSriovDevices(): unsupported device 0000:19:00.0 -> driver: 'tg3' class: 'Network controller' vendor: 'Broadcom Inc. and subsidiaries' product: 'NetXtreme BCM5720 Gigabit Ethernet PCIe' I0321 21:14:16.102847 242034 utils.go:120] DiscoverSriovDevices(): unsupported device 0000:19:00.1 -> driver: 'tg3' class: 'Network controller' vendor: 'Broadcom Inc. and subsidiaries' product: 'NetXtreme BCM5720 Gigabit Ethernet PCIe' I0321 21:14:16.102884 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:00.0 I0321 21:14:16.102926 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0 I0321 21:14:16.102988 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0 I0321 21:14:16.102992 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f0 I0321 21:14:16.103010 242034 utils.go:626] getNetDevLinkSpeed(): get LinkSpeed for device ens5f0 I0321 21:14:16.117404 242034 utils.go:761] getLinkType(): Device 0000:86:00.0 I0321 21:14:16.118003 242034 utils.go:814] GetNicSriovMode(): device 0000:86:00.0 I0321 21:14:16.119261 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:01.0 I0321 21:14:16.119366 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v0 I0321 21:14:16.119502 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v0 I0321 21:14:16.119512 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f0v0 I0321 21:14:16.119970 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:01.1 I0321 21:14:16.120066 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v1 I0321 21:14:16.120199 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v1 I0321 21:14:16.120208 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f0v1 I0321 21:14:16.120756 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:01.2 I0321 21:14:16.120845 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v2 I0321 21:14:16.120975 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v2 I0321 21:14:16.120984 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f0v2 I0321 21:14:16.121641 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:01.3 I0321 21:14:16.121735 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v3 I0321 21:14:16.121875 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v3 I0321 21:14:16.121883 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f0v3 I0321 21:14:16.122639 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:01.4 I0321 21:14:16.122734 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v4 I0321 21:14:16.122877 242034 utils.go:588] tryGetInterfaceName(): name is ens5f0v4 I0321 21:14:16.122888 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f0v4 I0321 21:14:16.123019 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:00.1 I0321 21:14:16.123110 242034 utils.go:588] tryGetInterfaceName(): name is ens5f1 I0321 21:14:16.123246 242034 utils.go:588] tryGetInterfaceName(): name is ens5f1 I0321 21:14:16.123254 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f1 I0321 21:14:16.123302 242034 utils.go:626] getNetDevLinkSpeed(): get LinkSpeed for device ens5f1 I0321 21:14:16.139788 242034 utils.go:761] getLinkType(): Device 0000:86:00.1 I0321 21:14:16.140075 242034 utils.go:814] GetNicSriovMode(): device 0000:86:00.1 I0321 21:14:16.140421 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:00.2 I0321 21:14:16.140517 242034 utils.go:588] tryGetInterfaceName(): name is ens5f2 I0321 21:14:16.140657 242034 utils.go:588] tryGetInterfaceName(): name is ens5f2 I0321 21:14:16.140666 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f2 I0321 21:14:16.140716 242034 utils.go:626] getNetDevLinkSpeed(): get LinkSpeed for device ens5f2 I0321 21:14:16.141066 242034 utils.go:761] getLinkType(): Device 0000:86:00.2 I0321 21:14:16.141302 242034 utils.go:814] GetNicSriovMode(): device 0000:86:00.2 I0321 21:14:16.141641 242034 utils.go:593] getNetdevMTU(): get MTU for device 0000:86:00.3 I0321 21:14:16.141735 242034 utils.go:588] tryGetInterfaceName(): name is ens5f3 I0321 21:14:16.141884 242034 utils.go:588] tryGetInterfaceName(): name is ens5f3 I0321 21:14:16.141893 242034 utils.go:614] getNetDevMac(): get Mac for device ens5f3 I0321 21:14:16.141946 242034 utils.go:626] getNetDevLinkSpeed(): get LinkSpeed for device ens5f3 I0321 21:14:16.142336 242034 utils.go:761] getLinkType(): Device 0000:86:00.3 I0321 21:14:16.142593 242034 utils.go:814] GetNicSriovMode(): device 0000:86:00.3 I0321 21:14:16.158011 242034 writer.go:175] setNodeStateStatus(): syncStatus: InProgress, lastSyncError: I0321 21:14:16.179072 242034 daemon.go:538] nodeStateSyncHandler(): calling OnNodeStateChange for an updated node state I0321 21:14:16.179101 242034 intel_plugin.go:38] intel-plugin OnNodeStateChange() I0321 21:14:16.179121 242034 daemon.go:545] nodeStateSyncHandler(): plugin intel_plugin: reqDrain false, reqReboot false I0321 21:14:16.179138 242034 daemon.go:538] nodeStateSyncHandler(): calling OnNodeStateChange for an updated node state I0321 21:14:16.179148 242034 generic_plugin.go:108] generic-plugin OnNodeStateChange() I0321 21:14:16.179157 242034 generic_plugin.go:238] generic-plugin needDrainNode(): current state '[{Name:ens5f0 Mac:50:7c:6f:4a:fd:aa Driver:ice PciAddress:0000:86:00.0 Vendor:8086 DeviceID:1593 NetFilter: Mtu:1500 NumVfs:5 LinkSpeed:25000 Mb/s LinkType:ETH EswitchMode:legacy ExternallyManaged:true TotalVfs:64 VFs:[{Name:ens5f0v0 Mac:42:67:d8:50:a4:14 Assigned: Driver:iavf PciAddress:0000:86:01.0 Vendor:8086 DeviceID:1889 Vlan:0 Mtu:1500 VfID:0} {Name:ens5f0v1 Mac:ba:a3:85:b9:5b:a7 Assigned: Driver:iavf PciAddress:0000:86:01.1 Vendor:8086 DeviceID:1889 Vlan:0 Mtu:1500 VfID:1} {Name:ens5f0v2 Mac:b2:8c:8c:fd:8d:1e Assigned: Driver:iavf PciAddress:0000:86:01.2 Vendor:8086 DeviceID:1889 Vlan:0 Mtu:1500 VfID:2} {Name:ens5f0v3 Mac:4a:e5:41:03:7b:72 Assigned: Driver:iavf PciAddress:0000:86:01.3 Vendor:8086 DeviceID:1889 Vlan:0 Mtu:1500 VfID:3} {Name:ens5f0v4 Mac:86:cc:6c:74:8d:00 Assigned: Driver:iavf PciAddress:0000:86:01.4 Vendor:8086 DeviceID:1889 Vlan:0 Mtu:1500 VfID:4}]} {Name:ens5f1 Mac:50:7c:6f:4a:fd:ab Driver:ice PciAddress:0000:86:00.1 Vendor:8086 DeviceID:1593 NetFilter: Mtu:1500 NumVfs:0 LinkSpeed:25000 Mb/s LinkType:ETH EswitchMode:legacy ExternallyManaged:false TotalVfs:64 VFs:[]} {Name:ens5f2 Mac:50:7c:6f:4a:fd:ac Driver:ice PciAddress:0000:86:00.2 Vendor:8086 DeviceID:1593 NetFilter: Mtu:1500 NumVfs:0 LinkSpeed:-1 Mb/s LinkType:ETH EswitchMode:legacy ExternallyManaged:false TotalVfs:64 VFs:[]} {Name:ens5f3 Mac:50:7c:6f:4a:fd:ad Driver:ice PciAddress:0000:86:00.3 Vendor:8086 DeviceID:1593 NetFilter: Mtu:1500 NumVfs:0 LinkSpeed:-1 Mb/s LinkType:ETH EswitchMode:legacy ExternallyManaged:false TotalVfs:64 VFs:[]}]', desired state '[{PciAddress:0000:86:00.0 NumVfs:5 Mtu:0 Name:ens5f0 LinkType: EswitchMode: VfGroups:[{ResourceName:extmanaged DeviceType:netdevice VfRange:0-1 PolicyName:extmanaged Mtu:0 IsRdma:false VdpaType:}] ExternallyManaged:true}]' I0321 21:14:16.179292 242034 utils.go:356] NeedUpdate(): need to update the device as it's externally manage for pci address 0000:86:00.0 I0321 21:14:16.179305 242034 generic_plugin.go:251] generic-plugin needDrainNode(): need drain, for PCI address 0000:86:00.0 request update I0321 21:14:16.179357 242034 daemon.go:545] nodeStateSyncHandler(): plugin generic_plugin: reqDrain true, reqReboot false I0321 21:14:16.179378 242034 daemon.go:569] nodeStateSyncHandler(): aggregated daemon reqDrain true, reqReboot false disableDrain false I0321 21:14:16.179386 242034 intel_plugin.go:44] intel-plugin Apply() I0321 21:14:16.206123 242034 daemon.go:592] nodeStateSyncHandler(): get drain lock for sriov daemon I0321 21:14:16.206192 242034 leaderelection.go:245] attempting to acquire leader lease openshift-sriov-network-operator/config-daemon-draining-lock... I0321 21:14:16.219241 242034 leaderelection.go:255] successfully acquired lease openshift-sriov-network-operator/config-daemon-draining-lock I0321 21:14:16.219400 242034 daemon.go:888] getDrainLock(): started leading I0321 21:14:19.220297 242034 daemon.go:897] getDrainLock(): no other node is draining I0321 21:14:19.220333 242034 daemon.go:805] annotateNode(): Annotate node worker-0 with: Draining I0321 21:14:19.245779 242034 daemon.go:600] nodeStateSyncHandler(): pause MCP I0321 21:14:19.245810 242034 daemon.go:917] pauseMCP(): pausing MCP I0321 21:14:19.261653 242034 daemon.go:943] pauseMCP(): MCP workercnf is ready I0321 21:14:19.261690 242034 daemon.go:953] pauseMCP(): pause MCP workercnf I0321 21:14:19.274841 242034 daemon.go:805] annotateNode(): Annotate node worker-0 with: Draining_MCP_Paused I0321 21:14:19.301242 242034 daemon.go:943] pauseMCP(): MCP workercnf is ready I0321 21:14:19.301277 242034 daemon.go:945] pauseMCP(): stop MCP informer I0321 21:14:19.301329 242034 daemon.go:609] nodeStateSyncHandler(): drain node I0321 21:14:19.301338 242034 daemon.go:1005] drainNode(): Update prepared I0321 21:14:19.301346 242034 daemon.go:1015] drainNode(): Start draining E0321 21:14:21.397711 242034 daemon.go:137] WARNING: ignoring DaemonSet-managed Pods: openshift-cluster-node-tuning-operator/tuned-857jn, openshift-dns/dns-default-zmj2p, openshift-dns/node-resolver-cv2lj, openshift-image-registry/node-ca-mjmhq, openshift-ingress-canary/ingress-canary-r8bzw, openshift-machine-config-operator/machine-config-daemon-mfq7b, openshift-monitoring/node-exporter-59g8p, openshift-multus/dhcp-daemon-lwvdj, openshift-multus/multus-additional-cni-plugins-nwfmn, openshift-multus/multus-s6qtd, openshift-multus/network-metrics-daemon-w45bh, openshift-network-diagnostics/network-check-target-nwhmq, openshift-nmstate/nmstate-handler-72x6m, openshift-ovn-kubernetes/ovnkube-node-j4z5m, openshift-ptp/linuxptp-daemon-lt7gx, openshift-sriov-network-operator/sriov-device-plugin-kh7dt, openshift-sriov-network-operator/sriov-network-config-daemon-r9xrz, vran-acceleration-operators/accelerator-discovery-6ghpf, vran-acceleration-operators/sriov-device-plugin-sbbzx, vran-acceleration-operators/sriov-fec-daemonset-w6g95

      Before:

      apiVersion: v1
      items:
      - apiVersion: sriovnetwork.openshift.io/v1
        kind: SriovNetworkNodeState
        metadata:
          creationTimestamp: "2024-03-21T19:19:02Z"
          generation: 22
          name: worker-0
          namespace: openshift-sriov-network-operator
          ownerReferences:
          - apiVersion: sriovnetwork.openshift.io/v1
            blockOwnerDeletion: true
            controller: true
            kind: SriovNetworkNodePolicy
            name: default
            uid: 91d1e0ad-1366-4caf-a4ef-1a283baac702
          resourceVersion: "257798"
          uid: 99107dd3-7bf8-47dc-a3ca-fe7a8ac0e680
        spec:
          dpConfigVersion: 7f97f404fc3f1dc853e33287d64edeee
          interfaces:
          - externallyManaged: true
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            vfGroups:
            - deviceType: netdevice
              policyName: extmanaged
              resourceName: extmanaged
              vfRange: 0-1
        status:
          interfaces:
          - Vfs:
            - deviceID: "1889"
              driver: iavf
              mac: be:bf:2b:dd:8a:13
              mtu: 1500
              name: ens5f0v0
              pciAddress: 0000:86:01.0
              vendor: "8086"
              vfID: 0
            - deviceID: "1889"
              driver: iavf
              mac: be:ec:8f:75:98:38
              mtu: 1500
              name: ens5f0v1
              pciAddress: 0000:86:01.1
              vendor: "8086"
              vfID: 1
            - deviceID: "1889"
              driver: iavf
              mac: 36:1d:65:15:c4:c5
              mtu: 1500
              name: ens5f0v2
              pciAddress: 0000:86:01.2
              vendor: "8086"
              vfID: 2
            - deviceID: "1889"
              driver: iavf
              mac: c6:55:92:b9:99:11
              mtu: 1500
              name: ens5f0v3
              pciAddress: 0000:86:01.3
              vendor: "8086"
              vfID: 3
            - deviceID: "1889"
              driver: iavf
              mac: e2:e5:b4:69:50:6a
              mtu: 1500
              name: ens5f0v4
              pciAddress: 0000:86:01.4
              vendor: "8086"
              vfID: 4
            deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            externallyManaged: true
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:aa
            mtu: 1500
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:ab
            mtu: 1500
            name: ens5f1
            pciAddress: 0000:86:00.1
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:ac
            mtu: 1500
            name: ens5f2
            pciAddress: 0000:86:00.2
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:ad
            mtu: 1500
            name: ens5f3
            pciAddress: 0000:86:00.3
            totalvfs: 64
            vendor: "8086"
          syncStatus: Succeeded
      - apiVersion: sriovnetwork.openshift.io/v1
        kind: SriovNetworkNodeState
        metadata:
          creationTimestamp: "2024-03-21T19:19:02Z"
          generation: 22
          name: worker-1
          namespace: openshift-sriov-network-operator
          ownerReferences:
          - apiVersion: sriovnetwork.openshift.io/v1
            blockOwnerDeletion: true
            controller: true
            kind: SriovNetworkNodePolicy
            name: default
            uid: 91d1e0ad-1366-4caf-a4ef-1a283baac702
          resourceVersion: "255376"
          uid: 7f045833-feb3-4b3d-b2a1-92d9bc09e5d7
        spec:
          dpConfigVersion: 7f97f404fc3f1dc853e33287d64edeee
          interfaces:
          - externallyManaged: true
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            vfGroups:
            - deviceType: netdevice
              policyName: extmanaged
              resourceName: extmanaged
              vfRange: 0-1
        status:
          interfaces:
          - deviceID: 158b
            driver: i40e
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 40:a6:b7:37:0b:c0
            mtu: 1500
            name: ens1f0
            pciAddress: 0000:3b:00.0
            totalvfs: 64
            vendor: "8086"
          - deviceID: 158b
            driver: i40e
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 40:a6:b7:37:0b:c1
            mtu: 1500
            name: ens1f1
            pciAddress: 0000:3b:00.1
            totalvfs: 64
            vendor: "8086"
          - Vfs:
            - deviceID: "1889"
              driver: iavf
              mac: a2:0d:92:f6:d5:08
              mtu: 1500
              name: ens5f0v0
              pciAddress: 0000:86:01.0
              vendor: "8086"
              vfID: 0
            - deviceID: "1889"
              driver: iavf
              mac: 86:51:c3:98:5a:2d
              mtu: 1500
              name: ens5f0v1
              pciAddress: 0000:86:01.1
              vendor: "8086"
              vfID: 1
            - deviceID: "1889"
              driver: iavf
              mac: 2e:8e:37:45:47:93
              mtu: 1500
              name: ens5f0v2
              pciAddress: 0000:86:01.2
              vendor: "8086"
              vfID: 2
            - deviceID: "1889"
              driver: iavf
              mac: 7a:3d:74:0d:e2:be
              mtu: 1500
              name: ens5f0v3
              pciAddress: 0000:86:01.3
              vendor: "8086"
              vfID: 3
            - deviceID: "1889"
              driver: iavf
              mac: 9a:b0:19:32:b6:ee
              mtu: 1500
              name: ens5f0v4
              pciAddress: 0000:86:01.4
              vendor: "8086"
              vfID: 4
            deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            externallyManaged: true
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8a
            mtu: 1500
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8b
            mtu: 1500
            name: ens5f1
            pciAddress: 0000:86:00.1
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8c
            mtu: 1500
            name: ens5f2
            pciAddress: 0000:86:00.2
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8d
            mtu: 1500
            name: ens5f3
            pciAddress: 0000:86:00.3
            totalvfs: 64
            vendor: "8086"
          syncStatus: Succeeded
      kind: List
      metadata:
        resourceVersion: "" 
      [elevin@elevin ~]$ oc -n openshift-sriov-network-operator get cm device-plugin-config -oyaml apiVersion: v1 data: worker-0: '{"resourceList":[{"resourceName":"extmanaged","selectors":
      {"pfNames":["ens5f0#0-1"],"IsRdma":false,"NeedVhostNet":false}
      ,"SelectorObj":null}]}' worker-1: '{"resourceList":[{"resourceName":"extmanaged","selectors":
      {"pfNames":["ens5f0#0-1"],"IsRdma":false,"NeedVhostNet":false}
      ,"SelectorObj":null}]}' kind: ConfigMap metadata: creationTimestamp: "2024-03-21T19:19:02Z" name: device-plugin-config namespace: openshift-sriov-network-operator resourceVersion: "577105" uid: 2779a5cd-7158-495a-8154-d7d7c3e69dd0 

       
      AFTER:

      apiVersion: v1
      items:
      - apiVersion: sriovnetwork.openshift.io/v1
        kind: SriovNetworkNodeState
        metadata:
          creationTimestamp: "2024-03-21T19:19:02Z"
          generation: 23
          name: worker-0
          namespace: openshift-sriov-network-operator
          ownerReferences:
          - apiVersion: sriovnetwork.openshift.io/v1
            blockOwnerDeletion: true
            controller: true
            kind: SriovNetworkNodePolicy
            name: default
            uid: 91d1e0ad-1366-4caf-a4ef-1a283baac702
          resourceVersion: "259731"
          uid: 99107dd3-7bf8-47dc-a3ca-fe7a8ac0e680
        spec:
          dpConfigVersion: 9c3edeab730aef6a6de7ec9b33d668a8
          interfaces:
          - externallyManaged: true
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            vfGroups:
            - deviceType: netdevice
              policyName: extmanaged
              resourceName: extmanaged
              vfRange: 0-1
        status:
          interfaces:
          - Vfs:
            - deviceID: "1889"
              driver: iavf
              mac: be:bf:2b:dd:8a:13
              mtu: 1500
              name: ens5f0v0
              pciAddress: 0000:86:01.0
              vendor: "8086"
              vfID: 0
            - deviceID: "1889"
              driver: iavf
              mac: be:ec:8f:75:98:38
              mtu: 1500
              name: ens5f0v1
              pciAddress: 0000:86:01.1
              vendor: "8086"
              vfID: 1
            - deviceID: "1889"
              driver: iavf
              mac: 36:1d:65:15:c4:c5
              mtu: 1500
              name: ens5f0v2
              pciAddress: 0000:86:01.2
              vendor: "8086"
              vfID: 2
            - deviceID: "1889"
              driver: iavf
              mac: c6:55:92:b9:99:11
              mtu: 1500
              name: ens5f0v3
              pciAddress: 0000:86:01.3
              vendor: "8086"
              vfID: 3
            - deviceID: "1889"
              driver: iavf
              mac: e2:e5:b4:69:50:6a
              mtu: 1500
              name: ens5f0v4
              pciAddress: 0000:86:01.4
              vendor: "8086"
              vfID: 4
            deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            externallyManaged: true
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:aa
            mtu: 1500
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:ab
            mtu: 1500
            name: ens5f1
            pciAddress: 0000:86:00.1
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:ac
            mtu: 1500
            name: ens5f2
            pciAddress: 0000:86:00.2
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:fd:ad
            mtu: 1500
            name: ens5f3
            pciAddress: 0000:86:00.3
            totalvfs: 64
            vendor: "8086"
          syncStatus: Succeeded
      - apiVersion: sriovnetwork.openshift.io/v1
        kind: SriovNetworkNodeState
        metadata:
          creationTimestamp: "2024-03-21T19:19:02Z"
          generation: 23
          name: worker-1
          namespace: openshift-sriov-network-operator
          ownerReferences:
          - apiVersion: sriovnetwork.openshift.io/v1
            blockOwnerDeletion: true
            controller: true
            kind: SriovNetworkNodePolicy
            name: default
            uid: 91d1e0ad-1366-4caf-a4ef-1a283baac702
          resourceVersion: "262088"
          uid: 7f045833-feb3-4b3d-b2a1-92d9bc09e5d7
        spec:
          dpConfigVersion: 9c3edeab730aef6a6de7ec9b33d668a8
          interfaces:
          - externallyManaged: true
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            vfGroups:
            - deviceType: netdevice
              policyName: extmanaged
              resourceName: extmanaged
              vfRange: 0-1
        status:
          interfaces:
          - deviceID: 158b
            driver: i40e
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 40:a6:b7:37:0b:c0
            mtu: 1500
            name: ens1f0
            pciAddress: 0000:3b:00.0
            totalvfs: 64
            vendor: "8086"
          - deviceID: 158b
            driver: i40e
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 40:a6:b7:37:0b:c1
            mtu: 1500
            name: ens1f1
            pciAddress: 0000:3b:00.1
            totalvfs: 64
            vendor: "8086"
          - Vfs:
            - deviceID: "1889"
              driver: iavf
              mac: a2:0d:92:f6:d5:08
              mtu: 1500
              name: ens5f0v0
              pciAddress: 0000:86:01.0
              vendor: "8086"
              vfID: 0
            - deviceID: "1889"
              driver: iavf
              mac: 86:51:c3:98:5a:2d
              mtu: 1500
              name: ens5f0v1
              pciAddress: 0000:86:01.1
              vendor: "8086"
              vfID: 1
            - deviceID: "1889"
              driver: iavf
              mac: 2e:8e:37:45:47:93
              mtu: 1500
              name: ens5f0v2
              pciAddress: 0000:86:01.2
              vendor: "8086"
              vfID: 2
            - deviceID: "1889"
              driver: iavf
              mac: 7a:3d:74:0d:e2:be
              mtu: 1500
              name: ens5f0v3
              pciAddress: 0000:86:01.3
              vendor: "8086"
              vfID: 3
            - deviceID: "1889"
              driver: iavf
              mac: 9a:b0:19:32:b6:ee
              mtu: 1500
              name: ens5f0v4
              pciAddress: 0000:86:01.4
              vendor: "8086"
              vfID: 4
            deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            externallyManaged: true
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8a
            mtu: 1500
            name: ens5f0
            numVfs: 5
            pciAddress: 0000:86:00.0
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: 25000 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8b
            mtu: 1500
            name: ens5f1
            pciAddress: 0000:86:00.1
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8c
            mtu: 1500
            name: ens5f2
            pciAddress: 0000:86:00.2
            totalvfs: 64
            vendor: "8086"
          - deviceID: "1593"
            driver: ice
            eSwitchMode: legacy
            linkSpeed: -1 Mb/s
            linkType: ETH
            mac: 50:7c:6f:4a:e1:8d
            mtu: 1500
            name: ens5f3
            pciAddress: 0000:86:00.3
            totalvfs: 64
            vendor: "8086"
          syncStatus: Succeeded
      kind: List
      metadata:
        resourceVersion: "" 
      apiVersion: v1 data: worker-0: '{"resourceList":[{"resourceName":"extmanaged","selectors": {"pfNames":["ens5f0#0-1"],"IsRdma":false,"NeedVhostNet":false} ,"SelectorObj":null}]}' worker-1: '{"resourceList":[{"resourceName":"extmanaged","selectors": {"pfNames":["ens5f0#0-1"],"IsRdma":false,"NeedVhostNet":false} ,"SelectorObj":null}]}' kind: ConfigMap metadata: creationTimestamp: "2024-03-21T19:19:02Z" name: device-plugin-config namespace: openshift-sriov-network-operator resourceVersion: "577105" uid: 2779a5cd-7158-495a-8154-d7d7c3e69dd0 

       
       
       

       

       

       

       

              sscheink@redhat.com Sebastian Scheinkman
              rhn-cnf-elevin Evgeny Levin
              Evgeny Levin Evgeny Levin
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated:
                Resolved: