Uploaded image for project: 'OCP Technical Release Team'
  1. OCP Technical Release Team
  2. TRT-2423

Front-load long running tests to avoid long tail execution

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • None
    • None
    • None

      Store and sort origin tests by duration to avoid a long tail problem where long running tests at the end of a test bucket end up executing alone because their duration far outlasts the rest of the tests in the bucket.

      By front-loading (scheduling) long running tests first, we can ensure they run in parallel with other tests rather than executing alone at the end, which can save significant time in overall test execution.

      This work builds on the scheduler work being done in TRT-2292 for test isolation and orchestration.

      Implementation

      • Store test duration metadata
      • Sort tests by duration (longest first) when scheduling test buckets
      • Ensure long running tests are scheduled early in bucket execution
      • Verify this doesn't conflict with isolation requirements from TRT-2292

      Expected Benefits

      • Reduced overall test execution time
      • Better parallelization of test buckets
      • Elimination of long tail where a single long test runs alone

              stbenjam Stephen Benjamin
              stbenjam Stephen Benjamin
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: