Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-51240

wasp-agent pod restarted with `invalid memory address or nil pointer dereference`

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Critical Critical
    • CNV v4.18.0
    • CNV v4.17.0
    • CNV Virt-Node
    • None
    • 0.42
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • ---
    • ---
    • High
    • None

      Description of problem:

      wasp-agent pods restarted many times with error:
      
      E1115 03:03:38.453176 4165106 runtime.go:79] Observed a panic: "invalid memory address or nil pointer dereference" (runtime error: invalid memory address or nil pointer dereference)
      
      
      and it keeps in error loop state while the VM is using swap:
      
      
      $ oc get pod -n wasp
      NAME               READY   STATUS             RESTARTS         AGE
      wasp-agent-25lrb   1/1     Running            55 (31m ago)     10d
      wasp-agent-mc27m   1/1     Running            86 (6h12m ago)   10d
      wasp-agent-tqmz9   0/1     CrashLoopBackOff   15 (2m22s ago)   10d
      
      # virt-launcher pod is using swap:
      bash-5.1$ cat /sys/fs/cgroup/memory.swap.current
      324562944
      
      
      
      

      Version-Release number of selected component (if applicable):

      4.17

      How reproducible:

      100%

      Steps to Reproduce:

      1. create VM with memory overcommitment
      2. overload VM (virt-launcher pod started using swap on the node)
      3. check wasp-agent pod status
      

      Actual results:

      wasp-agent pod restarted with error

      Expected results:

      wasp-agent pod is running

      Additional info:

      attached pod log - it contains go stack trace

              ibezukh Igor Bezukh
              dshchedr@redhat.com Denys Shchedrivyi
              Denys Shchedrivyi Denys Shchedrivyi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: