Uploaded image for project: 'OCP Technical Release Team'
  1. OCP Technical Release Team
  2. TRT-1719

/payload-aggregate crashing on index error

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Normal Normal
    • None
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      https://prow.ci.openshift.org/view/gs/test-platform-results/logs/aggregator-periodic-ci-openshift-release-master-ci-4.16-e2e-gcp-ovn/1802717173353811968

       time="2024-06-17T17:17:44.942Z" level=info msg="aggregating junit tests" job=periodic-ci-openshift-release-master-ci-4.16-e2e-gcp-ovn payload=
      panic: runtime error: index out of range [15] with length 13
      goroutine 1 [running]:
      github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer.(*weeklyAverageFromTenDays).CheckFailed(0xc000829680, {0x2194540, 0xc00071eee0}, {0x7ffe3873107c?, 0xc04b4b6780?}, {0x0?, 0x0?, 0x0?}, 0xc04b4b6780)
      	/go/src/github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer/pass_fail.go:617 +0x9d2
      github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer.assignPassFailForTestSuite({0x2194540, 0xc00071eee0}, {0x7ffe3873107c, 0x38}, {0x3295640?, 0x0?, 0x0?}, 0xc036a14460, {0x2194410, 0xc000829680})
      	/go/src/github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer/pass_fail.go:77 +0x323
      github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer.assignPassFail({0x2194540, 0xc00071eee0}, {0x7ffe3873107c, 0x38}, 0x2500?, {0x2194410, 0xc000829680})
      	/go/src/github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer/pass_fail.go:41 +0xbd
      github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer.(*JobRunAggregatorAnalyzerOptions).Run(0xc0008dc2a0, {0x21943d8, 0x3295640})
      	/go/src/github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer/analyzer.go:253 +0x194b
      github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer.NewJobRunsAnalyzerCommand.func1(0xc0008de800?, {0xc0008b3480?, 0x4?, 0x1e5b844?})
      	/go/src/github.com/openshift/ci-tools/pkg/jobrunaggregator/jobrunaggregatoranalyzer/cmd.go:89 +0x11e
      github.com/spf13/cobra.(*Command).execute(0xc0008fc300, {0xc0008b3400, 0x8, 0x8})
      	/go/src/github.com/openshift/ci-tools/vendor/github.com/spf13/cobra/command.go:940 +0x87c
      github.com/spf13/cobra.(*Command).ExecuteC(0xc000004c00)
      	/go/src/github.com/openshift/ci-tools/vendor/github.com/spf13/cobra/command.go:1068 +0x3a5
      github.com/spf13/cobra.(*Command).Execute(0xc000514f00?)
      	/go/src/github.com/openshift/ci-tools/vendor/github.com/spf13/cobra/command.go:992 +0x13
      main.main()
      	/go/src/github.com/openshift/ci-tools/cmd/job-run-aggregator/main.go:19 +0x38 
      

      The job runs are visible in the spyglass dropdown and can be examined manually, but it looks like automated use of the aggregation code is busted at least in some cases. Possibly people using payload-aggregate with larger counts? This was a 20.

              Unassigned Unassigned
              rhn-engineering-dgoodwin Devan Goodwin
              None
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: