Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-30062

Reboot test results for 4.15 show longer reboot times than 4.14

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Undefined Undefined
    • None
    • 4.15, 4.15.0
    • Telco Performance
    • None
    • Important
    • No
    • Rejected
    • False
    • Hide

      None

      Show
      None
    • 4/17: Retesting with fix for stress-ng test pod configuration to determine if issue is still there.

      Description of problem:

      Reboot time KPI showed higher reboot times for some test iterations that for 4.14
      For six iterations of each type:
      Soft reboot was average of ~3 minutes longer
      Power cycle was average of ~2 minutes longer
      
          

      Version-Release number of selected component (if applicable):

          OCP-5.15-rc.5 and newer
          

      How reproducible:

          Intermittent
          

      Steps to Reproduce:

          1. Install SNO spoke with RAN DU profile
          2. Run far-edge-vran-deployment job with tests field set to "reboot=6"
          3. Observe reported results
          

      Actual results:

      
      [The following data is formatted such that it should paste into a Sheet for readability]
      
      Version	OCP Version	Operator Version	Reboot Type	Stage	Iteration	Seconds	Total Minutes	Cluster	(Average)
      4.14	4.14.0	4.14	Soft reboot	Node Pingable	1	306	7.97	helix54	8.40
      4.14	4.14.0	4.14	Soft reboot	OC Reachable	1	17		helix54	
      4.14	4.14.0	4.14	Soft reboot	Workload Recovery	1	95		helix54	
      4.14	4.14.0	4.14	Soft reboot	Cluster Recovery	1	60		helix54	
      4.14	4.14.0	4.14	Soft reboot	Node Pingable	2	306	8.60	helix54	
      4.14	4.14.0	4.14	Soft reboot	OC Reachable	2	20		helix54	
      4.14	4.14.0	4.14	Soft reboot	Workload Recovery	2	130		helix54	
      4.14	4.14.0	4.14	Soft reboot	Cluster Recovery	2	60		helix54	
      4.14	4.14.0	4.14	Soft reboot	Node Pingable	3	306	8.45	helix54	
      4.14	4.14.0	4.14	Soft reboot	OC Reachable	3	36		helix54	
      4.14	4.14.0	4.14	Soft reboot	Workload Recovery	3	90		helix54	
      4.14	4.14.0	4.14	Soft reboot	Cluster Recovery	3	75		helix54	
      4.14	4.14.0	4.14	Soft reboot	Node Pingable	4	306	8.48	helix54	
      4.14	4.14.0	4.14	Soft reboot	OC Reachable	4	18		helix54	
      4.14	4.14.0	4.14	Soft reboot	Workload Recovery	4	95		helix54	
      4.14	4.14.0	4.14	Soft reboot	Cluster Recovery	4	90		helix54	
      4.14	4.14.0	4.14	Soft reboot	Node Pingable	5	306	8.52	helix54	
      4.14	4.14.0	4.14	Soft reboot	OC Reachable	5	15		helix54	
      4.14	4.14.0	4.14	Soft reboot	Workload Recovery	5	100		helix54	
      4.14	4.14.0	4.14	Soft reboot	Cluster Recovery	5	90		helix54	
      4.14	4.14.0	4.14	Soft reboot	Node Pingable	6	306	8.38	helix54	
      4.14	4.14.0	4.14	Soft reboot	OC Reachable	6	17		helix54	
      4.14	4.14.0	4.14	Soft reboot	Workload Recovery	6	105		helix54	
      4.14	4.14.0	4.14	Soft reboot	Cluster Recovery	6	75		helix54	
      4.14	4.14.0	4.14	Power off/on	Node Pingable	1	241	7.25	helix54	7.27
      4.14	4.14.0	4.14	Power off/on	OC Reachable	1	14		helix54	
      4.14	4.14.0	4.14	Power off/on	Workload Recovery	1	105		helix54	
      4.14	4.14.0	4.14	Power off/on	Cluster Recovery	1	75		helix54	
      4.14	4.14.0	4.14	Power off/on	Node Pingable	2	241	7.35	helix54	
      4.14	4.14.0	4.14	Power off/on	OC Reachable	2	15		helix54	
      4.14	4.14.0	4.14	Power off/on	Workload Recovery	2	110		helix54	
      4.14	4.14.0	4.14	Power off/on	Cluster Recovery	2	75		helix54	
      4.14	4.14.0	4.14	Power off/on	Node Pingable	3	241	7.27	helix54	
      4.14	4.14.0	4.14	Power off/on	OC Reachable	3	15		helix54	
      4.14	4.14.0	4.14	Power off/on	Workload Recovery	3	105		helix54	
      4.14	4.14.0	4.14	Power off/on	Cluster Recovery	3	75		helix54	
      4.14	4.14.0	4.14	Power off/on	Node Pingable	4	241	6.95	helix54	
      4.14	4.14.0	4.14	Power off/on	OC Reachable	4	36		helix54	
      4.14	4.14.0	4.14	Power off/on	Workload Recovery	4	50		helix54	
      4.14	4.14.0	4.14	Power off/on	Cluster Recovery	4	90		helix54	
      4.14	4.14.0	4.14	Power off/on	Node Pingable	5	242	7.75	helix54	
      4.14	4.14.0	4.14	Power off/on	OC Reachable	5	36		helix54	
      4.14	4.14.0	4.14	Power off/on	Workload Recovery	5	82		helix54	
      4.14	4.14.0	4.14	Power off/on	Cluster Recovery	5	105		helix54	
      4.14	4.14.0	4.14	Power off/on	Node Pingable	6	241	7.07	helix54	
      4.14	4.14.0	4.14	Power off/on	OC Reachable	6	13		helix54	
      4.14	4.14.0	4.14	Power off/on	Workload Recovery	6	95		helix54	
      4.14	4.14.0	4.14	Power off/on	Cluster Recovery	6	75		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Node Pingable	1	325	11.35	helix54	11.75
      4.15	4.15.0-rc.5	4.15	Soft reboot	OC Reachable	1	36		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Workload Recovery	1	95		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Cluster Recovery	1	225		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Node Pingable	2	345	13.92	helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	OC Reachable	2	11		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Workload Recovery	2	105		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Cluster Recovery	2	374		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Node Pingable	3	345	9.12	helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	OC Reachable	3	8		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Workload Recovery	3	90		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Cluster Recovery	3	104		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Node Pingable	4	325	16.95	helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	OC Reachable	4	33		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Workload Recovery	4	105		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Cluster Recovery	4	554		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Node Pingable	5	333	10.10	helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	OC Reachable	5	33		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Workload Recovery	5	90		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Cluster Recovery	5	150		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Node Pingable	6	345	9.05	helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	OC Reachable	6	9		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Workload Recovery	6	100		helix54	
      4.15	4.15.0-rc.5	4.15	Soft reboot	Cluster Recovery	6	89		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Node Pingable	1	276	8.93	helix54	9.39
      4.15	4.15.0-rc.5	4.15	Power off/on	OC Reachable	1	15		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Workload Recovery	1	110		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Cluster Recovery	1	135		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Node Pingable	2	276	8.43	helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	OC Reachable	2	36		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Workload Recovery	2	75		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Cluster Recovery	2	119		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Node Pingable	3	276	10.62	helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	OC Reachable	3	12		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Workload Recovery	3	110		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Cluster Recovery	3	239		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Node Pingable	4	276	11.33	helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	OC Reachable	4	14		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Workload Recovery	4	105		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Cluster Recovery	4	285		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Node Pingable	5	276	8.58	helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	OC Reachable	5	15		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Workload Recovery	5	90		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Cluster Recovery	5	134		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Node Pingable	6	276	8.47	helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	OC Reachable	6	13		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Workload Recovery	6	100		helix54	
      4.15	4.15.0-rc.5	4.15	Power off/on	Cluster Recovery	6	119		helix54	
          

      Expected results:

      Reboot times for 4.15 should be comparable to or better than 4.14
          

      Additional info:

      
          

            bwensley@redhat.com Bart Wensley
            rhn-support-dgonyier Dwaine Gonyier
            Dwaine Gonyier Dwaine Gonyier
            Dwaine Gonyier
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: