WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 81 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "releasetest-gzw2g". Running gauge specs gauge run specs/clustertasks/clustertask-s2i.spec log-level : [debug] tags : [sanity & !tls] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Compatible version of plugin go not found. Installing plugin go... Gathering metadata for go Downloading https://downloads.gauge.org/plugin/go?l=go&p=&o=linux&a=amd64 Downloading https://github.com/getgauge-contrib/gauge-go/releases/download/v0.4.0/gauge-go-0.4.0-linux.x86_64.zip ........................ Running plugin hook command => [go install github.com/go-delve/delve/cmd/dlv@latest] go: downloading github.com/go-delve/delve v1.22.1 go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/mattn/go-isatty v0.0.20 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/cosiner/argv v0.1.0 go: downloading github.com/derekparker/trie v0.0.0-20230829180723-39f4de51ef7d go: downloading github.com/go-delve/liner v1.2.3-0.20231231155935-4726ab1d7f62 go: downloading github.com/hashicorp/golang-lru v1.0.2 go: downloading golang.org/x/arch v0.6.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/google/go-dap v0.11.0 go: downloading go.starlark.net v0.0.0-20231101134539-556fd59b42f6 go: downloading github.com/cilium/ebpf v0.11.0 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading golang.org/x/exp v0.0.0-20230224173230-c95f2b4c22f2 Running plugin hook command => [go install github.com/getgauge-contrib/gauge-go@latest] go: downloading github.com/getgauge-contrib/gauge-go v0.4.0 go: downloading github.com/getgauge/common v0.0.0-20211105093448-e0aee1ccb217 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/dmotylev/goproperties v0.0.0-20140630191356-7cbffbaada47 go: downloading google.golang.org/protobuf v1.31.0 Installing plugin go 0.4.0 Successfully installed plugin 'go' version 0.4.0 Compatible version of plugin html-report not found. Installing plugin html-report... Gathering metadata for html-report Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go&o=linux&a=amd64 Downloading https://github.com/getgauge/html-report/releases/download/v4.3.1/html-report-4.3.1-linux.x86_64.zip ........................ Installing plugin html-report 4.3.1 Successfully installed plugin 'html-report' version 4.3.1 Compatible version of plugin xml-report not found. Installing plugin xml-report... Gathering metadata for xml-report Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report&o=linux&a=amd64 Downloading https://github.com/getgauge/xml-report/releases/download/v0.5.1/xml-report-0.5.1-linux.x86_64.zip ........................ Installing plugin xml-report 0.5.1 Successfully installed plugin 'xml-report' version 0.5.1 Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 1 specifications parsing completed. Applying tags filter: sanity & !tls The following specifications satisfy filter criteria: specs/clustertasks/clustertask-s2i.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 go: downloading github.com/openshift/client-go v0.0.0-20220603133046-984ee5ebedcf go: downloading github.com/openshift/api v0.0.0-20220525145417-ee5b62754c68 go: downloading github.com/getgauge-contrib/gauge-go v0.3.1 go: downloading github.com/tektoncd/pipeline v0.47.0 go: downloading k8s.io/api v0.25.9 go: downloading k8s.io/apimachinery v0.25.9 go: downloading github.com/prometheus/client_golang v1.15.0 go: downloading github.com/prometheus/common v0.42.0 go: downloading github.com/operator-framework/operator-lifecycle-manager v0.22.0 go: downloading github.com/tektoncd/operator v0.67.0 go: downloading github.com/tektoncd/triggers v0.24.0 go: downloading k8s.io/client-go v0.25.9 go: downloading gotest.tools/v3 v3.4.0 go: downloading github.com/operator-framework/api v0.16.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading knative.dev/pkg v0.0.0-20230221145627-8efb3485adcf go: downloading github.com/getgauge/common v0.0.0-20200824023809-24587c106922 go: downloading github.com/Netflix/go-expect v0.0.0-20220104043353-73e0943537d2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading k8s.io/klog/v2 v2.90.1 go: downloading k8s.io/utils v0.0.0-20230313181309-38a27ef9d749 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.2.3 go: downloading github.com/imdario/mergo v0.3.14 go: downloading golang.org/x/term v0.8.0 go: downloading golang.org/x/net v0.10.0 go: downloading github.com/google/gnostic v0.6.9 go: downloading github.com/sirupsen/logrus v1.9.0 go: downloading github.com/creack/pty v1.1.17 go: downloading github.com/cloudevents/sdk-go/v2 v2.14.0 go: downloading github.com/google/uuid v1.3.0 go: downloading github.com/tidwall/sjson v1.2.4 go: downloading go.uber.org/zap v1.24.0 go: downloading golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 go: downloading knative.dev/eventing v0.36.7 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading github.com/google/go-containerregistry v0.14.1-0.20230409045903-ed5c185df419 go: downloading golang.org/x/exp v0.0.0-20230321023759-10a507213a29 go: downloading k8s.io/kube-openapi v0.0.0-20230308215209-15aac26d736a go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/go-logr/logr v1.2.4 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading golang.org/x/oauth2 v0.7.0 go: downloading google.golang.org/protobuf v1.30.0 go: downloading golang.org/x/sys v0.8.0 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/manifestival/manifestival v0.7.2 go: downloading github.com/openshift-pipelines/pipelines-as-code v0.19.1 go: downloading google.golang.org/grpc v1.55.0 go: downloading k8s.io/apiextensions-apiserver v0.25.9 go: downloading github.com/tidwall/gjson v1.12.1 go: downloading go.uber.org/atomic v1.10.0 go: downloading go.uber.org/multierr v1.9.0 go: downloading contrib.go.opencensus.io/exporter/ocagent v0.7.1-0.20200907061046-05415f1de66d go: downloading contrib.go.opencensus.io/exporter/prometheus v0.4.2 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading golang.org/x/sync v0.1.0 go: downloading github.com/blendle/zapdriver v1.3.1 go: downloading github.com/google/cel-go v0.13.0 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.2.0 go: downloading golang.org/x/text v0.9.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/kelseyhightower/envconfig v1.4.0 go: downloading github.com/tidwall/match v1.1.1 go: downloading github.com/tidwall/pretty v1.2.0 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading sigs.k8s.io/controller-runtime v0.14.6 go: downloading github.com/prometheus/statsd_exporter v0.23.1 go: downloading github.com/census-instrumentation/opencensus-proto v0.4.1 go: downloading google.golang.org/api v0.119.0 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/client_model v0.3.0 go: downloading github.com/prometheus/procfs v0.9.0 go: downloading google.golang.org/genproto v0.0.0-20230410155749-daa745c078e1 go: downloading github.com/go-kit/log v0.2.1 go: downloading github.com/grpc-ecosystem/grpc-gateway/v2 v2.15.2 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/stoewer/go-strcase v1.2.1 go: downloading github.com/antlr/antlr4/runtime/Go/antlr v1.4.10 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/go-logfmt/logfmt v0.6.0 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 33277 Successfully made the connection with plugin with port: 33277 Starting Xml Report plugin Attempting to connect to grpc server at port: 34977 Successfully made the connection with plugin with port: 34977 Initialising suite data store. # Verify Clustertasks E2E spec  ## S2I nodejs pipelinerun: PIPELINES-14-TC01 2024/06/24 12:37:02 output: Now using project "releasetest-g96bw" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname 2024/06/24 12:37:02 Waiting for operator to be up and running.... 2024/06/24 12:37:03 Waiting for config cr InstalledStatus Actual: [False] Expected: [True] 2024/06/24 12:37:08 Operator is up  * Validate Operator should be installed ...[PASS] 2024/06/24 12:37:08 Verify SA "pipeline" is created in namespace "releasetest-g96bw"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:37:09 output: imagestream.image.openshift.io/nodejs-ex-git created deploymentconfig.apps.openshift.io/nodejs-ex-git created pipeline.tekton.dev/nodejs-ex-git created pipelinerun.tekton.dev/nodejs-ex-git-pr created  * Create |S.NO|resource_dir | |----|--------------------------------------------------------| |1 |testdata/v1beta1/pipelinerun/s2i-nodejs-pipelinerun.yaml| ...[PASS] 2024/06/24 12:37:09 validating pipeline run for success state... 2024/06/24 12:40:09 pipelineRun: nodejs-ex-git-pr is successful under namespace : releasetest-g96bw  * Verify pipelinerun |S.NO|pipeline_run_name|status |check_lable_propagation| |----|-----------------|----------|-----------------------| |1 |nodejs-ex-git-pr |successful|no | ...[PASS] 2024/06/24 12:40:22 output: project.project.openshift.io "releasetest-g96bw" deleted  ## S2I java pipelinerun: PIPELINES-14-TC04 2024/06/24 12:40:22 output: Now using project "releasetest-8ndvw" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:40:22 Verify SA "pipeline" is created in namespace "releasetest-8ndvw"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:40:28 output: pipeline.tekton.dev/s2i-java-pipeline created 2024/06/24 12:40:28 output: persistentvolumeclaim/shared-pvc created  * Create |S.NO|resource_dir | |----|----------------------------------------------------| |1 |testdata/v1beta1/clustertask/pipelines/s2i-java.yaml| |2 |testdata/pvc/pvc.yaml | ...[PASS] 2024/06/24 12:40:28 Getting imagestream from the namespace openshift  * Get tags of the imagestream "java" from namespace "openshift" and store to variable "java-tags" ...[PASS] 2024/06/24 12:40:28 Starting pipeline s2i-java-pipeline with param VERSION=11 2024/06/24 12:40:29 Pipelinerun s2i-java-pipeline-run-bdvn8 started 2024/06/24 12:40:29 validating pipeline run for success state... 2024/06/24 12:42:24 pipelineRun: s2i-java-pipeline-run-bdvn8 is successful under namespace : releasetest-8ndvw 2024/06/24 12:42:24 Starting pipeline s2i-java-pipeline with param VERSION=8 2024/06/24 12:42:25 Pipelinerun s2i-java-pipeline-run-zd29x started 2024/06/24 12:42:25 validating pipeline run for success state... 2024/06/24 12:44:25 pipelineRun: s2i-java-pipeline-run-zd29x is successful under namespace : releasetest-8ndvw 2024/06/24 12:44:25 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-el7 2024/06/24 12:44:26 Pipelinerun s2i-java-pipeline-run-7pvtx started 2024/06/24 12:44:26 validating pipeline run for success state... 2024/06/24 12:46:16 pipelineRun: s2i-java-pipeline-run-7pvtx is successful under namespace : releasetest-8ndvw 2024/06/24 12:46:16 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-ubi8 2024/06/24 12:46:16 Pipelinerun s2i-java-pipeline-run-s7dtp started 2024/06/24 12:46:16 validating pipeline run for success state... 2024/06/24 12:48:52 pipelineRun: s2i-java-pipeline-run-s7dtp is successful under namespace : releasetest-8ndvw 2024/06/24 12:48:52 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-17-ubi8 2024/06/24 12:48:52 Pipelinerun s2i-java-pipeline-run-vhmt2 started 2024/06/24 12:48:52 validating pipeline run for success state... 2024/06/24 12:51:08 pipelineRun: s2i-java-pipeline-run-vhmt2 is successful under namespace : releasetest-8ndvw 2024/06/24 12:51:08 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-el7 2024/06/24 12:51:08 Pipelinerun s2i-java-pipeline-run-cqgrz started 2024/06/24 12:51:08 validating pipeline run for success state... 2024/06/24 12:52:23 pipelineRun: s2i-java-pipeline-run-cqgrz is successful under namespace : releasetest-8ndvw 2024/06/24 12:52:23 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-ubi8 2024/06/24 12:52:24 Pipelinerun s2i-java-pipeline-run-2w5nv started 2024/06/24 12:52:24 validating pipeline run for success state... 2024/06/24 12:52:30 pipelineRun: s2i-java-pipeline-run-2w5nv is successful under namespace : releasetest-8ndvw  * Start and verify pipeline "s2i-java-pipeline" with param "VERSION" with values stored in variable "java-tags" with workspace "name=source,claimName=shared-pvc" ...[FAIL] 2024/06/24 12:52:30 Skipping deletion of the namespace 'releasetest-8ndvw' as the test got failed Failed Step: Start and verify pipeline "s2i-java-pipeline" with param "VERSION" with values stored in variable "java-tags" with workspace "name=source,claimName=shared-pvc" Specification: specs/clustertasks/clustertask-s2i.spec:75 Error Message: error waiting for pipeline run s2i-java-pipeline-run-cqgrz to finish Get "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443/apis/tekton.dev/v1beta1/namespaces/releasetest-8ndvw/pipelineruns/s2i-java-pipeline-run-cqgrz": http2: client connection lost error waiting for pipeline run s2i-java-pipeline-run-2w5nv to finish "s2i-java-pipeline-run-2w5nv" failed Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc00054a8c0, {0x2279cea?, 0x1b?}, {0xc000406f50?, 0x22406c3?, 0x14?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/pkg/pipelines.validatePipelineRunForSuccessStatus(0xc000926ea0, {0xc0001215e0, 0x1b}, {0x2226b40, 0x2}, {0xc000b867b0, 0x11}) /tmp/release-tests/pkg/pipelines/pipelines.go:32 +0x152 github.com/openshift-pipelines/release-tests/pkg/pipelines.ValidatePipelineRun(0xc000926ea0, {0xc0006abfa0, 0x1b}, {0x222f63d, 0xa}, {0x2226b40, 0x2}, {0xc000b867b0, 0x11}) /tmp/release-tests/pkg/pipelines/pipelines.go:176 +0x24f github.com/openshift-pipelines/release-tests/steps/cli.init.func24({0xc0004d1a70, 0x11}, {0xc00045a0a0, 0x7}, {0xc00045a0a7?, 0x0?}, {0xc0001d7d40, 0x20}) /tmp/release-tests/steps/cli/tkn.go:28 +0x58c reflect.Value.call({0x1eaff20?, 0x234f080?, 0x1c0?}, {0x22275a4, 0x4}, {0xc00079c480, 0x4, 0xc00054a8c0?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1eaff20?, 0x234f080?, 0x7f2e237f5a68?}, {0xc00079c480?, 0x37c3320?, 0xc00090e6e0?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1eaff20?, 0x234f080?, 0x3a?}, {0xc000912840, 0x4, 0x15a?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc000114180?, {0xc000912840?, 0x5e?, 0x15e?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/step.go:17 +0x8c github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x1ef7e60?, 0xc000237770, 0xc000000007?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ExecuteStepProcessor.go:20 +0xa6 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719232615868503633/gauge_test.go:31 +0xf goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc00054a8c0, {0x2279cea?, 0x1b?}, {0xc000406f50?, 0x22406c3?, 0x14?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/pkg/pipelines.validatePipelineRunForSuccessStatus(0xc000926ea0, {0xc000121ca0, 0x1b}, {0x2226b40, 0x2}, {0xc000b867b0, 0x11}) /tmp/release-tests/pkg/pipelines/pipelines.go:32 +0x152 github.com/openshift-pipelines/release-tests/pkg/pipelines.ValidatePipelineRun(0xc000926ea0, {0xc000532400, 0x1b}, {0x222f63d, 0xa}, {0x2226b40, 0x2}, {0xc000b867b0, 0x11}) /tmp/release-tests/pkg/pipelines/pipelines.go:176 +0x24f github.com/openshift-pipelines/release-tests/steps/cli.init.func24({0xc0004d1a70, 0x11}, {0xc00045a0a0, 0x7}, {0xc00045a0a7?, 0x0?}, {0xc0001d7d40, 0x20}) /tmp/release-tests/steps/cli/tkn.go:28 +0x58c reflect.Value.call({0x1eaff20?, 0x234f080?, 0x1c0?}, {0x22275a4, 0x4}, {0xc00079c480, 0x4, 0xc00054a8c0?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1eaff20?, 0x234f080?, 0x7f2e237f5a68?}, {0xc00079c480?, 0x37c3320?, 0xc00090e6e0?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1eaff20?, 0x234f080?, 0x3a?}, {0xc000912840, 0x4, 0x15a?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc000114180?, {0xc000912840?, 0x5e?, 0x15e?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/step.go:17 +0x8c github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x1ef7e60?, 0xc000237770, 0xc000000007?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ExecuteStepProcessor.go:20 +0xa6 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719232615868503633/gauge_test.go:31 +0xf  Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_12.52.30/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 12.52.30 Sending kill message to Xml Report plugin. Sending kill message to Html Report plugin. Sending kill message to runner. ok command-line-arguments 929.195s Runner with PID:4245 has exited Specifications: 1 executed 0 passed 1 failed 0 skipped Scenarios: 2 executed 1 passed 1 failed 0 skipped Total time taken: 15m28.659s gauge run specs/clustertasks/clustertask.spec log-level : [debug] tags : [sanity & !tls] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Plugin go is already installed. Plugin html-report is already installed. Plugin xml-report is already installed. Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 1 specifications parsing completed. Applying tags filter: sanity & !tls The following specifications satisfy filter criteria: specs/clustertasks/clustertask.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 33349 Successfully made the connection with plugin with port: 33349 Starting Xml Report plugin Attempting to connect to grpc server at port: 40349 Successfully made the connection with plugin with port: 40349 Initialising suite data store. # Verify Clustertasks E2E spec  ## buildah pipelinerun: PIPELINES-16-TC01 2024/06/24 12:52:40 output: Now using project "releasetest-dwj8l" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname 2024/06/24 12:52:41 Waiting for operator to be up and running.... 2024/06/24 12:52:41 Waiting for config cr InstalledStatus Actual: [False] Expected: [True] 2024/06/24 12:52:46 Operator is up  * Validate Operator should be installed ...[PASS] 2024/06/24 12:52:46 Verify SA "pipeline" is created in namespace "releasetest-dwj8l"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:52:46 output: pipeline.tekton.dev/buildah-pipeline created 2024/06/24 12:52:47 output: persistentvolumeclaim/shared-pvc created 2024/06/24 12:52:47 output: pipelinerun.tekton.dev/buildah-run created  * Create |S.NO|resource_dir | |----|-------------------------------------------------| |1 |testdata/v1/clustertask/pipelines/buildah.yaml | |2 |testdata/pvc/pvc.yaml | |3 |testdata/v1/clustertask/pipelineruns/buildah.yaml| ...[PASS] 2024/06/24 12:52:47 validating pipeline run for success state... 2024/06/24 12:53:42 pipelineRun: buildah-run is successful under namespace : releasetest-dwj8l  * Verify pipelinerun |S.NO|pipeline_run_name|status |check_label_propagation| |----|-----------------|----------|-----------------------| |1 |buildah-run |successful|no | ...[PASS] 2024/06/24 12:53:55 output: project.project.openshift.io "releasetest-dwj8l" deleted  ## git-clone read private repo taskrun PIPELINES-16-TC12 2024/06/24 12:53:56 output: Now using project "releasetest-qcp8b" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:53:56 Verify SA "pipeline" is created in namespace "releasetest-qcp8b"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:54:01 output: pipeline.tekton.dev/git-clone-read-private-pipeline created 2024/06/24 12:54:01 output: persistentvolumeclaim/shared-pvc created 2024/06/24 12:54:02 output: secret/ssh-key created  * Create |S.NO|resource_dir | |----|-------------------------------------------------------------| |1 |testdata/v1/clustertask/pipelines/git-clone-read-private.yaml| |2 |testdata/pvc/pvc.yaml | |3 |testdata/v1/clustertask/secrets/ssh-key.yaml | ...[PASS] 2024/06/24 12:54:02 output:  * Link secret "ssh-key" to service account "pipeline" ...[PASS] 2024/06/24 12:54:02 output: pipelinerun.tekton.dev/git-clone-read-private-pipeline-run created  * Create |S.NO|resource_dir | |----|----------------------------------------------------------------| |1 |testdata/v1/clustertask/pipelineruns/git-clone-read-private.yaml| ...[PASS] 2024/06/24 12:54:03 validating pipeline run for success state... 2024/06/24 12:54:13 pipelineRun: git-clone-read-private-pipeline-run is successful under namespace : releasetest-qcp8b  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|-----------------------------------|----------|-----------------------| |1 |git-clone-read-private-pipeline-run|successful|no | ...[PASS] 2024/06/24 12:54:25 output: project.project.openshift.io "releasetest-qcp8b" deleted Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_12.54.25/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 12.54.25 Sending kill message to Html Report plugin. Sending kill message to Xml Report plugin. Sending kill message to runner. ok command-line-arguments 106.047s Runner with PID:22130 has exited Specifications: 1 executed 1 passed 0 failed 0 skipped Scenarios: 2 executed 2 passed 0 failed 0 skipped Total time taken: 1m46.007s gauge run specs/pipelines/ log-level : [debug] tags : [sanity & !tls] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Plugin go is already installed. Plugin html-report is already installed. Plugin xml-report is already installed. Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 6 specifications parsing completed. Applying tags filter: sanity & !tls The following specifications satisfy filter criteria: specs/pipelines/bundles-resolver.spec specs/pipelines/cluster-resolvers.spec specs/pipelines/fail.spec specs/pipelines/git-resolvers.spec specs/pipelines/hub-resolvers.spec specs/pipelines/run.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 38777 Successfully made the connection with plugin with port: 38777 Starting Xml Report plugin Attempting to connect to grpc server at port: 38101 Successfully made the connection with plugin with port: 38101 Initialising suite data store. # Bundles resolver spec  ## Test the functionality of bundles resolver with parameter: PIPELINES-25-TC02 2024/06/24 12:54:28 output: Now using project "releasetest-xst9c" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname 2024/06/24 12:54:29 Waiting for operator to be up and running.... 2024/06/24 12:54:29 Waiting for config cr InstalledStatus Actual: [False] Expected: [True] 2024/06/24 12:54:34 Operator is up  * Validate Operator should be installed ...[PASS] 2024/06/24 12:54:34 Verify SA "pipeline" is created in namespace "releasetest-xst9c"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:54:34 output: pipelinerun.tekton.dev/bundles-resolver-pipelinerun-param created  * Create |S.NO|resource_dir | |----|-----------------------------------------------------------------------| |1 |testdata/resolvers/pipelineruns/bundles-resolver-pipelinerun-param.yaml| ...[PASS] 2024/06/24 12:54:35 validating pipeline run for success state... 2024/06/24 12:54:55 pipelineRun: bundles-resolver-pipelinerun-param is successful under namespace : releasetest-xst9c  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|----------------------------------|----------|-----------------------| |1 |bundles-resolver-pipelinerun-param|successful|no | ...[PASS] 2024/06/24 12:55:08 output: project.project.openshift.io "releasetest-xst9c" deleted # Cluster resolvers spec  ## Checking the functionality of cluster resolvers#1: PIPELINES-23-TC01 2024/06/24 12:55:08 output: Now using project "releasetest-xfqvt" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname 2024/06/24 12:55:08 Check if project releasetest-tasks already exists 2024/06/24 12:55:09 Creating project releasetest-tasks 2024/06/24 12:55:09 output: Now using project "releasetest-tasks" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Create project "releasetest-tasks" ...[PASS] 2024/06/24 12:55:10 output: task.tekton.dev/resolver-task2 created  * Create |S.NO|resource_dir | |----|--------------------------------------------| |1 |testdata/resolvers/tasks/resolver-task2.yaml| ...[PASS] 2024/06/24 12:55:10 Check if project releasetest-pipelines already exists 2024/06/24 12:55:10 Creating project releasetest-pipelines 2024/06/24 12:55:11 output: Now using project "releasetest-pipelines" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Create project "releasetest-pipelines" ...[PASS] 2024/06/24 12:55:11 output: pipeline.tekton.dev/resolver-pipeline created  * Create |S.NO|resource_dir | |----|---------------------------------------------------| |1 |testdata/resolvers/pipelines/resolver-pipeline.yaml| ...[PASS] 2024/06/24 12:55:11 Check if project releasetest-pipelineruns already exists 2024/06/24 12:55:12 Creating project releasetest-pipelineruns 2024/06/24 12:55:12 output: Now using project "releasetest-pipelineruns" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Create project "releasetest-pipelineruns" ...[PASS] 2024/06/24 12:55:12 Verify SA "pipeline" is created in namespace "releasetest-pipelineruns"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:55:18 output: pipelinerun.tekton.dev/resolver-pipelinerun created  * Create |S.NO|resource_dir | |----|---------------------------------------------------------| |1 |testdata/resolvers/pipelineruns/resolver-pipelinerun.yaml| ...[PASS] 2024/06/24 12:55:18 validating pipeline run for success state... 2024/06/24 12:55:28 pipelineRun: resolver-pipelinerun is successful under namespace : releasetest-pipelineruns  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|--------------------|----------|-----------------------| |1 |resolver-pipelinerun|successful|no | ...[PASS] 2024/06/24 12:55:28 Deleting project releasetest-tasks 2024/06/24 12:55:35 output: project.project.openshift.io "releasetest-tasks" deleted  * Delete project "releasetest-tasks" ...[PASS] 2024/06/24 12:55:35 Deleting project releasetest-pipelines 2024/06/24 12:55:41 output: project.project.openshift.io "releasetest-pipelines" deleted  * Delete project "releasetest-pipelines" ...[PASS] 2024/06/24 12:55:41 Deleting project releasetest-pipelineruns 2024/06/24 12:55:54 output: project.project.openshift.io "releasetest-pipelineruns" deleted  * Delete project "releasetest-pipelineruns" ...[PASS] 2024/06/24 12:56:01 output: project.project.openshift.io "releasetest-xfqvt" deleted # Verify Pipeline Failures  ## Run Pipeline with a non-existent ServiceAccount: PIPELINES-02-TC01 2024/06/24 12:56:02 output: Now using project "releasetest-jp62g" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:56:02 Verify SA "foobar" is absent in namespace "releasetest-jp62g"  * Verify ServiceAccount "foobar" does not exist ...[PASS] 2024/06/24 12:56:02 output: task.tekton.dev/create-file-vb created task.tekton.dev/check-stuff-file-exists-vb created pipeline.tekton.dev/output-pipeline-vb created pipelinerun.tekton.dev/output-pipeline-run-vb created  * Create |S.NO|resource_dir | |----|------------------------------------------| |1 |testdata/negative/v1beta1/pipelinerun.yaml| ...[PASS] 2024/06/24 12:56:02 validating pipeline run for failure state... 2024/06/24 12:56:02 Waiting for PipelineRun in namespace releasetest-jp62g to fail  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|----------------------|-------|-----------------------| |1 |output-pipeline-run-vb|Failure|no | ...[PASS] 2024/06/24 12:56:20 output: project.project.openshift.io "releasetest-jp62g" deleted # Git resolvers spec  ## Test the functionality of git resolvers: PIPELINES-24-TC01 2024/06/24 12:56:20 output: Now using project "releasetest-qhbnd" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:56:20 Verify SA "pipeline" is created in namespace "releasetest-qhbnd"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:56:26 output: pipelinerun.tekton.dev/git-resolver-pipelinerun created  * Create |S.NO|resource_dir | |----|-------------------------------------------------------------| |1 |testdata/resolvers/pipelineruns/git-resolver-pipelinerun.yaml| ...[PASS] 2024/06/24 12:56:26 validating pipeline run for success state... 2024/06/24 12:56:36 pipelineRun: git-resolver-pipelinerun is successful under namespace : releasetest-qhbnd  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|------------------------|----------|-----------------------| |1 |git-resolver-pipelinerun|successful|no | ...[PASS] 2024/06/24 12:56:49 output: project.project.openshift.io "releasetest-qhbnd" deleted # HUB resolvers spec  ## Test the functionality of hub resolvers 2024/06/24 12:56:49 output: Now using project "releasetest-l564z" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:56:49 Verify SA "pipeline" is created in namespace "releasetest-l564z"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:56:57 output: pipeline.tekton.dev/hub-git-cli-pipeline created 2024/06/24 12:56:58 output: persistentvolumeclaim/shared-pvc created 2024/06/24 12:57:00 output: pipelinerun.tekton.dev/hub-git-cli-run created  * Apply |S.NO|resource_dir | |----|------------------------------------------------| |1 |testdata/resolvers/pipelines/git-cli-hub.yaml | |2 |testdata/pvc/pvc.yaml | |3 |testdata/resolvers/pipelineruns/git-cli-hub.yaml| ...[PASS] 2024/06/24 12:57:00 validating pipeline run for success state... 2024/06/24 12:57:46 pipelineRun: hub-git-cli-run is successful under namespace : releasetest-l564z  * Verify pipelinerun |S.NO|pipeline_run_name|status |check_label_propagation| |----|-----------------|----------|-----------------------| |1 |hub-git-cli-run |successful|no | ...[PASS] 2024/06/24 12:57:59 output: project.project.openshift.io "releasetest-l564z" deleted # Verify Pipeline E2E spec  ## Pipelinerun Timeout failure Test: PIPELINES-03-TC04 2024/06/24 12:57:59 output: Now using project "releasetest-lck6m" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:57:59 Verify SA "pipeline" is created in namespace "releasetest-lck6m"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:58:05 output: task.tekton.dev/banana created pipeline.tekton.dev/tomatoes created pipelinerun.tekton.dev/pear created  * Create |S.NO|resource_dir | |----|----------------------------------------------------| |1 |testdata/v1beta1/pipelinerun/pipelineruntimeout.yaml| ...[PASS] 2024/06/24 12:58:05 validating pipeline run timeout... 2024/06/24 12:58:05 Waiting for Pipelinerun pear in namespace releasetest-lck6m to be started 2024/06/24 12:58:05 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-lck6m to be running 2024/06/24 12:58:05 Waiting for PipelineRun pear in namespace releasetest-lck6m to be timed out 2024/06/24 12:58:15 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-lck6m to be cancelled  * Verify pipelinerun |S.NO|pipeline_run_name|status |check_label_propagation| |----|-----------------|-------|-----------------------| |1 |pear |timeout|no | ...[PASS] 2024/06/24 12:58:28 output: project.project.openshift.io "releasetest-lck6m" deleted  ## Configure execution results at the Task level Test: PIPELINES-03-TC05 2024/06/24 12:58:29 output: Now using project "releasetest-7d6s2" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:58:29 Verify SA "pipeline" is created in namespace "releasetest-7d6s2"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:58:35 output: pipeline.tekton.dev/sum-and-multiply-pipeline created task.tekton.dev/sum created task.tekton.dev/multiply created pipelinerun.tekton.dev/task-level-results created  * Create |S.NO|resource_dir | |----|------------------------------------------------------| |1 |testdata/v1beta1/pipelinerun/task_results_example.yaml| ...[PASS] 2024/06/24 12:58:35 validating pipeline run for success state... 2024/06/24 12:58:45 pipelineRun: task-level-results is successful under namespace : releasetest-7d6s2  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|------------------|----------|-----------------------| |1 |task-level-results|successful|no | ...[PASS] 2024/06/24 12:58:58 output: project.project.openshift.io "releasetest-7d6s2" deleted  ## Cancel pipelinerun Test: PIPELINES-03-TC06 2024/06/24 12:58:58 output: Now using project "releasetest-8hbc8" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:58:58 Verify SA "pipeline" is created in namespace "releasetest-8hbc8"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:59:04 output: persistentvolumeclaim/shared-pvc created 2024/06/24 12:59:04 output: task.tekton.dev/create-file-v1b1 created task.tekton.dev/check-file-exists-v1b1 created pipeline.tekton.dev/output-pipeline-v1b1 created pipelinerun.tekton.dev/output-pipeline-run-v1b1 created  * Create |S.NO|resource_dir | |----|---------------------------------------------| |1 |testdata/pvc/pvc.yaml | |2 |testdata/v1beta1/pipelinerun/pipelinerun.yaml| ...[PASS] 2024/06/24 12:59:05 validating pipeline run timeout... 2024/06/24 12:59:05 Waiting for Pipelinerun output-pipeline-run-v1b1 in namespace releasetest-8hbc8 to be started 2024/06/24 12:59:10 Canceling pipeline run: PipelineRun cancelled: output-pipeline-run-v1b1 2024/06/24 12:59:11 Waiting for TaskRuns in PipelineRun output-pipeline-run-v1b1 in namespace releasetest-8hbc8 to be cancelled  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|------------------------|---------|-----------------------| |1 |output-pipeline-run-v1b1|cancelled|no | ...[PASS] 2024/06/24 12:59:23 output: project.project.openshift.io "releasetest-8hbc8" deleted  ## Pipelinerun with large result: PIPELINES-03-TC08 2024/06/24 12:59:24 output: Now using project "releasetest-7wczt" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 12:59:24 Verify SA "pipeline" is created in namespace "releasetest-7wczt"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 12:59:30 output: task.tekton.dev/print-result created task.tekton.dev/generate-result created pipeline.tekton.dev/result-test created pipelinerun.tekton.dev/result-test-run created  * Create |S.NO|resource_dir | |----|---------------------------------------------------------------| |1 |testdata/v1beta1/pipelinerun/pipelinerun-with-large-result.yaml| ...[PASS] 2024/06/24 12:59:30 validating pipeline run for success state... 2024/06/24 12:59:40 pipelineRun: result-test-run is successful under namespace : releasetest-7wczt  * Verify pipelinerun |S.NO|pipeline_run_name|status |check_label_propagation| |----|-----------------|----------|-----------------------| |1 |result-test-run |successful|no | ...[PASS] 2024/06/24 12:59:52 output: project.project.openshift.io "releasetest-7wczt" deleted Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_12.59.52/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 12.59.52 Sending kill message to Html Report plugin. Sending kill message to Xml Report plugin. Sending kill message to runner. ok command-line-arguments 324.779s Runner with PID:22875 has exited Specifications: 6 executed 6 passed 0 failed 0 skipped Scenarios: 9 executed 9 passed 0 failed 0 skipped Total time taken: 5m24.729s gauge run specs/triggers/ log-level : [debug] tags : [sanity & !tls] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Plugin go is already installed. Plugin html-report is already installed. Plugin xml-report is already installed. Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 4 specifications parsing completed. Applying tags filter: sanity & !tls The following specifications satisfy filter criteria: specs/triggers/cron.spec specs/triggers/eventlistener.spec specs/triggers/triggerbinding.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 32981 Successfully made the connection with plugin with port: 32981 Starting Xml Report plugin Attempting to connect to grpc server at port: 41413 Successfully made the connection with plugin with port: 41413 Initialising suite data store. # Verify Triggers with cronjob  ## Create Triggers using k8s cronJob: PIPELINES-04-TC01 2024/06/24 12:59:56 output: Now using project "releasetest-2gng8" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname 2024/06/24 12:59:56 Waiting for operator to be up and running.... 2024/06/24 12:59:56 Waiting for config cr InstalledStatus Actual: [False] Expected: [True] 2024/06/24 13:00:01 Operator is up  * Validate Operator should be installed ...[PASS] 2024/06/24 13:00:02 output: task.tekton.dev/say-hello created task.tekton.dev/say-message created task.tekton.dev/say-bye created pipeline.tekton.dev/simple-pipeline created 2024/06/24 13:00:02 output: triggerbinding.triggers.tekton.dev/cron-binding created 2024/06/24 13:00:03 output: triggertemplate.triggers.tekton.dev/pipeline-template created 2024/06/24 13:00:03 output: eventlistener.triggers.tekton.dev/cron-listener created  * Create |S.NO|resource_dir | |----|--------------------------------------------| |1 |testdata/triggers/cron/example-pipeline.yaml| |2 |testdata/triggers/cron/triggerbinding.yaml | |3 |testdata/triggers/cron/triggertemplate.yaml | |4 |testdata/triggers/cron/eventlistener.yaml | ...[PASS] 2024/06/24 13:00:03 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0007207b0} Configuration:{GeneratedResourceName:el-cron-listener}} 2024/06/24 13:00:08 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-cron-listener-759d66f468" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000808288} Configuration:{GeneratedResourceName:el-cron-listener}} 2024/06/24 13:00:13 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:12 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:12 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:12 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cron-listener-759d66f468" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:12 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:00:12 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000720960} Configuration:{GeneratedResourceName:el-cron-listener}} 2024/06/24 13:00:13 sinkpod name: el-cron-listener-759d66f468-dsm98 2024/06/24 13:00:14 Route url: 'http://el-cron-listener-releasetest-2gng8.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "cron-listener" ...[PASS] 2024/06/24 13:00:19 Verify that image stream "golang" exists in namespace "openshift"  * Verify that image stream "golang" exists ...[PASS] 2024/06/24 13:00:19 Cronjob: hello created in namespace: releasetest-2gng8  * Create cron job with schedule "*/1 * * * *" ...[PASS] 2024/06/24 13:01:01 pipeline run : simple-pipeline-run-xhn97 2024/06/24 13:02:00 pipeline run : simple-pipeline-run-9bdfh 2024/06/24 13:03:00 pipeline run : simple-pipeline-run-mdzxk 2024/06/24 13:04:01 pipeline run : simple-pipeline-run-glfg4 2024/06/24 13:05:00 pipeline run : simple-pipeline-run-xkqjj  * Watch for pipelinerun resources ...[PASS]  * Delete cron job ...[PASS]  * Assert no new pipelineruns created ...[PASS] 2024/06/24 13:06:21 Deleted EventListener 2024/06/24 13:06:21 EventListener's Deployment was deleted 2024/06/24 13:06:21 EventListener's Service was deleted 2024/06/24 13:06:21 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:06:36 output: project.project.openshift.io "releasetest-2gng8" deleted # Verify eventlisteners spec  ## Create Eventlistener embedded TriggersBindings specs: PIPELINES-05-TC08 2024/06/24 13:06:37 output: Now using project "releasetest-d9ncj" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:06:37 output: task.tekton.dev/say-hello created task.tekton.dev/say-message created task.tekton.dev/say-bye created pipeline.tekton.dev/simple-pipeline created 2024/06/24 13:06:38 output: triggerbinding.triggers.tekton.dev/pipeline-binding created 2024/06/24 13:06:38 output: triggertemplate.triggers.tekton.dev/pipeline-template created 2024/06/24 13:06:38 output: eventlistener.triggers.tekton.dev/listener-embed-binding created  * Create |S.NO|resource_dir | |----|-------------------------------------------------------------------| |1 |testdata/triggers/sample-pipeline.yaml | |2 |testdata/triggers/triggerbindings/triggerbinding.yaml | |3 |testdata/triggers/triggertemplate/triggertemplate.yaml | |4 |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml| ...[PASS] 2024/06/24 13:06:38 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:38 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:38 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:38 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000918420} Configuration:{GeneratedResourceName:el-listener-embed-binding}} 2024/06/24 13:06:43 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:41 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:41 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:41 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-74df68976c" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:41 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:06:41 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0007202a0} Configuration:{GeneratedResourceName:el-listener-embed-binding}} 2024/06/24 13:06:43 sinkpod name: el-listener-embed-binding-74df68976c-44f8q 2024/06/24 13:06:45 Route url: 'http://el-listener-embed-binding-releasetest-d9ncj.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "listener-embed-binding" ...[PASS] 2024/06/24 13:06:50 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:06:51 validating pipeline run for success state... 2024/06/24 13:07:06 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-d9ncj  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|-------------------|----------|-----------------------| |1 |simple-pipeline-run|successful|no | ...[PASS] 2024/06/24 13:07:06 Deleted EventListener 2024/06/24 13:07:06 EventListener's Deployment was deleted 2024/06/24 13:07:06 EventListener's Service was deleted 2024/06/24 13:07:06 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:07:21 output: project.project.openshift.io "releasetest-d9ncj" deleted  ## Create embedded TriggersTemplate: PIPELINES-05-TC09 2024/06/24 13:07:22 output: Now using project "releasetest-jklh8" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:07:22 output: triggerbinding.triggers.tekton.dev/pipeline-binding created 2024/06/24 13:07:22 output: triggertemplate.triggers.tekton.dev/pipeline-template created 2024/06/24 13:07:23 output: eventlistener.triggers.tekton.dev/listener-embed-binding created  * Create |S.NO|resource_dir | |----|-------------------------------------------------------------------| |1 |testdata/triggers/triggerbindings/triggerbinding.yaml | |2 |testdata/triggers/triggertemplate/embed-triggertemplate.yaml | |3 |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml| ...[PASS] 2024/06/24 13:07:23 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:23 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:23 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:23 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000aacf60} Configuration:{GeneratedResourceName:el-listener-embed-binding}} 2024/06/24 13:07:28 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:25 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:25 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:25 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-566bcd498c" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:25 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:25 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0009199e0} Configuration:{GeneratedResourceName:el-listener-embed-binding}} 2024/06/24 13:07:28 sinkpod name: el-listener-embed-binding-566bcd498c-s7vjm 2024/06/24 13:07:29 Route url: 'http://el-listener-embed-binding-releasetest-jklh8.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "listener-embed-binding" ...[PASS] 2024/06/24 13:07:34 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:07:35 validating pipeline run for success state... 2024/06/24 13:07:40 pipelineRun: pipelinerun-with-taskspec-to-echo-message is successful under namespace : releasetest-jklh8  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|-----------------------------------------|----------|-----------------------| |1 |pipelinerun-with-taskspec-to-echo-message|successful|no | ...[PASS] 2024/06/24 13:07:40 Deleted EventListener 2024/06/24 13:07:40 EventListener's Deployment was deleted 2024/06/24 13:07:40 EventListener's Service was deleted 2024/06/24 13:07:40 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:07:55 output: project.project.openshift.io "releasetest-jklh8" deleted  ## Verify Github push event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC12 2024/06/24 13:07:56 output: Now using project "releasetest-l98kc" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:07:56 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-push created 2024/06/24 13:07:56 output: eventlistener.triggers.tekton.dev/listener-ctb-github-push created  * Create |S.NO|resource_dir | |----|------------------------------------------------------------------| |1 |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-push.yaml| |2 |testdata/triggers/github-ctb/eventlistener-ctb-git-push.yaml | ...[PASS] 2024/06/24 13:07:56 Verify SA "pipeline" is created in namespace "releasetest-l98kc"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 13:07:57 output: secret/github-secret created 2024/06/24 13:07:57 output:  * Create & Link secret "github-secret" to service account "pipeline" ...[PASS] 2024/06/24 13:07:57 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:07:56 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:56 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:56 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-646dccf7fd" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:07:56 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:56 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000cacf18} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}} 2024/06/24 13:08:02 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:58 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:58 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:58 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-ctb-github-push-646dccf7fd" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:58 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:07:58 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000aac810} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}} 2024/06/24 13:08:02 sinkpod name: el-listener-ctb-github-push-646dccf7fd-tfbfd 2024/06/24 13:08:03 Route url: 'http://el-listener-ctb-github-push-releasetest-l98kc.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "listener-ctb-github-push" ...[PASS] 2024/06/24 13:08:08 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "push", payload "testdata/triggers/github-ctb/push.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:08:09 validating pipeline run for success state... 2024/06/24 13:08:14 pipelineRun: pipelinerun-git-push-ctb is successful under namespace : releasetest-l98kc  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|------------------------|----------|-----------------------| |1 |pipelinerun-git-push-ctb|successful|no | ...[PASS] 2024/06/24 13:08:14 Deleted EventListener 2024/06/24 13:08:14 EventListener's Deployment was deleted 2024/06/24 13:08:15 EventListener's Service was deleted 2024/06/24 13:08:15 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:08:30 output: project.project.openshift.io "releasetest-l98kc" deleted  ## Verify Github pull_request event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC13 2024/06/24 13:08:30 output: Now using project "releasetest-gx4hk" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:08:31 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-pr created 2024/06/24 13:08:31 output: eventlistener.triggers.tekton.dev/listener-clustertriggerbinding-github-pr created  * Create |S.NO|resource_dir | |----|----------------------------------------------------------------| |1 |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-pr.yaml| |2 |testdata/triggers/github-ctb/eventlistener-ctb-git-pr.yaml | ...[PASS] 2024/06/24 13:08:31 Verify SA "pipeline" is created in namespace "releasetest-gx4hk"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 13:08:31 output: secret/github-secret created 2024/06/24 13:08:32 output:  * Create & Link secret "github-secret" to service account "pipeline" ...[PASS] 2024/06/24 13:08:32 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:08:31 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:31 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:31 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-6696999988" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:08:31 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:31 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000918150} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}} 2024/06/24 13:08:37 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:33 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:33 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:33 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-6696999988" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:33 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:08:33 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0009183d8} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}} 2024/06/24 13:08:37 sinkpod name: el-listener-clustertriggerbinding-github-pr-6696999988-lwgz4 2024/06/24 13:08:38 Route url: 'http://el-listener-clustertriggerbinding-github-pr-releasetest-gx4hk.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "listener-clustertriggerbinding-github-pr" ...[PASS] 2024/06/24 13:08:43 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/github-ctb/pr.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:08:44 validating pipeline run for success state... 2024/06/24 13:08:49 pipelineRun: pipelinerun-git-pr-ctb is successful under namespace : releasetest-gx4hk  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|----------------------|----------|-----------------------| |1 |pipelinerun-git-pr-ctb|successful|no | ...[PASS] 2024/06/24 13:08:49 Deleted EventListener 2024/06/24 13:08:49 EventListener's Deployment was deleted 2024/06/24 13:08:49 EventListener's Service was deleted 2024/06/24 13:08:49 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:09:04 output: project.project.openshift.io "releasetest-gx4hk" deleted  ## Create TriggersCRD resource with CEL interceptors (overlays): PIPELINES-05-TC15 2024/06/24 13:09:05 output: Now using project "releasetest-tzgps" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:09:05 output: eventlistener.triggers.tekton.dev/listener-triggerref created 2024/06/24 13:09:05 output: trigger.triggers.tekton.dev/trigger created 2024/06/24 13:09:06 output: triggerbinding.triggers.tekton.dev/github-pr-binding created 2024/06/24 13:09:06 output: triggertemplate.triggers.tekton.dev/github-template created 2024/06/24 13:09:07 output: pipeline.tekton.dev/parallel-pipeline created task.tekton.dev/persist-param created task.tekton.dev/to-upper created task.tekton.dev/to-lower created task.tekton.dev/result-reporter created task.tekton.dev/validator created  * Create |S.NO|resource_dir | |----|-----------------------------------------------------------| |1 |testdata/triggers/triggersCRD/eventlistener-triggerref.yaml| |2 |testdata/triggers/triggersCRD/trigger.yaml | |3 |testdata/triggers/triggersCRD/triggerbindings.yaml | |4 |testdata/triggers/triggersCRD/triggertemplate.yaml | |5 |testdata/triggers/triggersCRD/pipeline.yaml | ...[PASS] 2024/06/24 13:09:07 Verify SA "pipeline" is created in namespace "releasetest-tzgps"  * Verify ServiceAccount "pipeline" exist ...[PASS] 2024/06/24 13:09:07 output: secret/github-secret created 2024/06/24 13:09:08 output:  * Create & Link secret "github-secret" to service account "pipeline" ...[PASS] 2024/06/24 13:09:08 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:09:05 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:05 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:05 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-86bd4fcf95" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-06-24 13:09:05 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:05 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000aac348} Configuration:{GeneratedResourceName:el-listener-triggerref}} 2024/06/24 13:09:13 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:08 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:08 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:08 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-triggerref-86bd4fcf95" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:08 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:09:08 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000cac900} Configuration:{GeneratedResourceName:el-listener-triggerref}} 2024/06/24 13:09:13 sinkpod name: el-listener-triggerref-86bd4fcf95-2g65r 2024/06/24 13:09:14 Route url: 'http://el-listener-triggerref-releasetest-tzgps.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "listener-triggerref" ...[PASS] 2024/06/24 13:09:19 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/triggersCRD/pull-request.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:09:20 validating pipeline run for success state... 2024/06/24 13:10:00 pipelineRun: parallel-pipelinerun is successful under namespace : releasetest-tzgps  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|--------------------|----------|-----------------------| |1 |parallel-pipelinerun|successful|no | ...[PASS] 2024/06/24 13:10:00 Deleted EventListener 2024/06/24 13:10:00 EventListener's Deployment was deleted 2024/06/24 13:10:00 EventListener's Service was deleted 2024/06/24 13:10:00 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:10:15 output: project.project.openshift.io "releasetest-tzgps" deleted  ## Create Eventlistener with github interceptor And verify Kuberenetes Events: PIPELINES-05-TC17 2024/06/24 13:10:16 output: Now using project "releasetest-sgj5n" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:10:16 output: task.tekton.dev/say-hello created task.tekton.dev/say-message created task.tekton.dev/say-bye created pipeline.tekton.dev/simple-pipeline created 2024/06/24 13:10:17 output: triggerbinding.triggers.tekton.dev/pipeline-binding created 2024/06/24 13:10:17 output: triggertemplate.triggers.tekton.dev/pipeline-template created 2024/06/24 13:10:17 output: eventlistener.triggers.tekton.dev/listener-embed-binding created  * Create |S.NO|resource_dir | |----|-------------------------------------------------------------------| |1 |testdata/triggers/sample-pipeline.yaml | |2 |testdata/triggers/triggerbindings/triggerbinding.yaml | |3 |testdata/triggers/triggertemplate/triggertemplate.yaml | |4 |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml| ...[PASS] 2024/06/24 13:10:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:17 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:17 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:17 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0000124e0} Configuration:{GeneratedResourceName:el-listener-embed-binding}} 2024/06/24 13:10:22 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:19 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:19 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:19 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-86bddf7d6c" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:19 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:10:19 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0003084c8} Configuration:{GeneratedResourceName:el-listener-embed-binding}} 2024/06/24 13:10:22 sinkpod name: el-listener-embed-binding-86bddf7d6c-h48fz 2024/06/24 13:10:24 Route url: 'http://el-listener-embed-binding-releasetest-sgj5n.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "listener-embed-binding" ...[PASS] 2024/06/24 13:10:29 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS]  * Verify kubernetes events for eventlistener ...[PASS] 2024/06/24 13:10:30 validating pipeline run for success state... 2024/06/24 13:10:45 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-sgj5n  * Verify pipelinerun |S.NO|pipeline_run_name |status |check_label_propagation| |----|-------------------|----------|-----------------------| |1 |simple-pipeline-run|successful|no | ...[PASS] 2024/06/24 13:10:45 Deleted EventListener 2024/06/24 13:10:45 EventListener's Deployment was deleted 2024/06/24 13:10:46 EventListener's Service was deleted 2024/06/24 13:10:46 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:11:01 output: project.project.openshift.io "releasetest-sgj5n" deleted # Verify triggerbindings spec  ## Verify CEL marshaljson function Test: PIPELINES-10-TC01 2024/06/24 13:11:01 output: Now using project "releasetest-qt2gg" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:11:02 output: eventlistener.triggers.tekton.dev/cel-marshaljson created  * Create |S.NO|resource_dir | |----|------------------------------------------------------| |1 |testdata/triggers/triggerbindings/cel-marshalJson.yaml| ...[PASS] 2024/06/24 13:11:02 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:02 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:02 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:02 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000013e30} Configuration:{GeneratedResourceName:el-cel-marshaljson}} 2024/06/24 13:11:07 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:04 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:04 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:04 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cel-marshaljson-d88f4f9bb" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:04 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:04 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000cac078} Configuration:{GeneratedResourceName:el-cel-marshaljson}} 2024/06/24 13:11:07 sinkpod name: el-cel-marshaljson-d88f4f9bb-4x7k8 2024/06/24 13:11:08 Route url: 'http://el-cel-marshaljson-releasetest-qt2gg.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "cel-marshaljson" ...[PASS] 2024/06/24 13:11:13 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:11:14 Waiting for TaskRun cel-trig-marshaljson in namespace releasetest-qt2gg to succeed  * Verify taskrun |S.NO|task_run_name |status | |----|--------------------|-------| |1 |cel-trig-marshaljson|Success| ...[PASS] 2024/06/24 13:11:24 Deleted EventListener 2024/06/24 13:11:24 EventListener's Deployment was deleted 2024/06/24 13:11:24 EventListener's Service was deleted 2024/06/24 13:11:24 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:11:39 output: project.project.openshift.io "releasetest-qt2gg" deleted  ## Verify event message body parsing with old annotation Test: PIPELINES-10-TC02 2024/06/24 13:11:40 output: Now using project "releasetest-dwlsk" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname  * Validate Operator should be installed ...[PASS] 2024/06/24 13:11:40 output: triggertemplate.triggers.tekton.dev/taskrun-with-annotation created eventlistener.triggers.tekton.dev/parse-json-body-with-annotation created  * Create |S.NO|resource_dir | |----|----------------------------------------------------------------------| |1 |testdata/triggers/triggerbindings/parse-json-body-with-annotation.yaml| ...[PASS] 2024/06/24 13:11:40 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:40 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:40 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:40 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000918780} Configuration:{GeneratedResourceName:el-parse-json-body-with-annotation}} 2024/06/24 13:11:45 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:43 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:43 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:43 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-parse-json-body-with-annotation-f9567bd57" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:43 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-06-24 13:11:43 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000308690} Configuration:{GeneratedResourceName:el-parse-json-body-with-annotation}} 2024/06/24 13:11:46 sinkpod name: el-parse-json-body-with-annotation-f9567bd57-z72g5 2024/06/24 13:11:47 Route url: 'http://el-parse-json-body-with-annotation-releasetest-dwlsk.apps.rosa.ci-rosa-h-jjag.elqm.s3.devshift.org'  * Expose Event listener "parse-json-body-with-annotation" ...[PASS] 2024/06/24 13:11:52 Building headers for github interceptor..  * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false" ...[PASS]  * Assert eventlistener response ...[PASS] 2024/06/24 13:11:52 Waiting for TaskRun trig-parse-json-body-with-annotation in namespace releasetest-dwlsk to succeed  * Verify taskrun |S.NO|task_run_name |status | |----|------------------------------------|-------| |1 |trig-parse-json-body-with-annotation|Success| ...[PASS] 2024/06/24 13:11:58 Deleted EventListener 2024/06/24 13:11:58 EventListener's Deployment was deleted 2024/06/24 13:11:58 EventListener's Service was deleted 2024/06/24 13:11:58 EventListener's Route got deleted successfully...  * Cleanup Triggers ...[PASS] 2024/06/24 13:12:13 output: project.project.openshift.io "releasetest-dwlsk" deleted Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_13.12.13/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 13.12.13 Sending kill message to Html Report plugin. Sending kill message to Xml Report plugin. Sending kill message to runner. ok command-line-arguments 738.054s Runner with PID:24089 has exited Specifications: 3 executed 3 passed 0 failed 0 skipped Scenarios: 9 executed 9 passed 0 failed 0 skipped Total time taken: 12m18.002s gauge run specs/metrics/ log-level : [debug] tags : [sanity & !tls] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Plugin go is already installed. Plugin html-report is already installed. Plugin xml-report is already installed. Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 1 specifications parsing completed. Applying tags filter: sanity & !tls The following specifications satisfy filter criteria: specs/metrics/metrics.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 43991 Successfully made the connection with plugin with port: 43991 Starting Xml Report plugin Attempting to connect to grpc server at port: 41953 Successfully made the connection with plugin with port: 41953 Initialising suite data store. # Verify openshift pipelines monitoring  ## Openshift pipelines metrics acceptance tests: PIPELINES-01-TC01 2024/06/24 13:12:16 output: Now using project "releasetest-dm78f" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname 2024/06/24 13:12:16 Waiting for operator to be up and running.... 2024/06/24 13:12:17 Waiting for config cr InstalledStatus Actual: [False] Expected: [True] 2024/06/24 13:12:22 Operator is up  * Validate Operator should be installed ...[PASS] 2024/06/24 13:12:22 Target Job: [node-exporter] ready/up status, Actual: [1], Expected: [1] 2024/06/24 13:12:23 Target Job: [kube-state-metrics] ready/up status, Actual: [1], Expected: [1] 2024/06/24 13:12:23 Target Job: [prometheus-k8s] ready/up status, Actual: [1], Expected: [1] 2024/06/24 13:12:24 Target Job: [prometheus-operator] ready/up status, Actual: [1], Expected: [1] 2024/06/24 13:12:24 Target Job: [alertmanager-main] ready/up status, Actual: [1], Expected: [1] 2024/06/24 13:12:25 Target Job: [tekton-pipelines-controller] ready/up status, Actual: [1], Expected: [1]  * Verify job health status metrics |S.NO|Job_name |Expected_value| |----|---------------------------|--------------| |1 |node-exporter |1 | |2 |kube-state-metrics |1 | |3 |prometheus-k8s |1 | |4 |prometheus-operator |1 | |5 |alertmanager-main |1 | |6 |tekton-pipelines-controller|1 | ...[PASS]  * Verify pipelines controlPlane metrics ...[PASS] 2024/06/24 13:12:33 output: project.project.openshift.io "releasetest-dm78f" deleted Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 13.12.33 Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_13.12.33/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Sending kill message to Html Report plugin. Sending kill message to Xml Report plugin. Sending kill message to runner. ok command-line-arguments 17.672s Runner with PID:26068 has exited Specifications: 1 executed 1 passed 0 failed 0 skipped Scenarios: 1 executed 1 passed 0 failed 0 skipped Total time taken: 17.634s gauge run specs/operator/addon.spec specs/operator/auto-prune.spec log-level : [debug] parallel : [true] tags : [sanity & !tls] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Plugin xml-report is already installed. Plugin go is already installed. Plugin html-report is already installed. Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 2 specifications parsing completed. Applying tags filter: sanity & !tls The following specifications satisfy filter criteria: specs/operator/addon.spec specs/operator/auto-prune.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 33263 Successfully made the connection with plugin with port: 33263 Starting Xml Report plugin Attempting to connect to grpc server at port: 39515 Successfully made the connection with plugin with port: 39515 Executing in 2 parallel streams. Starting go runner Established connection to runner. Initialising suite data store. Initialising suite data store. [runner: 2] # Verify Addon E2E spec [runner: 1] # Verify auto-prune E2E [runner: 2] ## Disable/Enable community clustertasks: PIPELINES-15-TC01 2024/06/24 13:12:38 output: Now using project "releasetest-295hx" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname [runner: 2] * Validate Operator should be installed 2024/06/24 13:12:38 output: Now using project "releasetest-k9scn" on server "https://api.ci-rosa-h-jjag.elqm.s3.devshift.org:443". You can add applications to this project with the 'new-app' command. For example, try: oc new-app rails-postgresql-example to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application: kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname [runner: 2] Failed Step: Validate Operator should be installed Specification: specs/operator/addon.spec:5 Error Message: Operator is not installed Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc0006c2a80, {0x2248f99?, 0x222a865?}, {0x0?, 0xc000896000?, 0x0?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/pkg/operator.ValidateOperatorInstallStatus(0xc00022c360, {{0x222c69f, 0x8}, {0x222b14f, 0x7}, {0x0, 0x0}, {0x22283fe, 0x5}, {0x22292e3, ...}, ...}) /tmp/release-tests/pkg/operator/operator.go:76 +0x10c github.com/openshift-pipelines/release-tests/steps/olm.init.func1.1() /tmp/release-tests/steps/olm/operator.go:24 +0x165 sync.(*Once).doSlow(0x0?, 0x0?) /usr/lib/golang/src/sync/once.go:74 +0xc2 sync.(*Once).Do(...) /usr/lib/golang/src/sync/once.go:65 github.com/openshift-pipelines/release-tests/steps/olm.init.func1() /tmp/release-tests/steps/olm/operator.go:23 +0x2c reflect.Value.call({0x1d62920?, 0x234f120?, 0x1c0?}, {0x22275a4, 0x4}, {0x3823c20, 0x0, 0xc0006c2a80?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d62920?, 0x234f120?, 0xc00078fbe0?}, {0x3823c20?, 0xc00078fc48?, 0x8a702b?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d62920?, 0x234f120?, 0x2d?}, {0x0, 0x0, 0x56?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc0000d8de0?, {0x0?, 0x25?, 0x5f?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/step.go:17 +0x8c github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x1ef7e60?, 0xc000734690, 0xc000000007?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ExecuteStepProcessor.go:20 +0xa6 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234755904202676/gauge_test.go:31 +0xf 2024/06/24 13:12:38 Skipping deletion of the namespace 'releasetest-295hx' as the test got failed [runner: 2] ## Disable/Enable clustertasks: PIPELINES-15-TC02 [runner: 2] Error Message: [assertion failed: Command: oc new-project releasetest-f26rm ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f99cc910008, 0x3823c20}, 0x234f6e8, 0xc000886460, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f99cc910008, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc000886460}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc000886460}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc0001330c0, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc00070cba0, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00005b548, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000741398, 0x1, 0xc0005a5c00?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc000578501?}, {0xc000741398?, 0xc00045e4f0?, 0xc000507f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc00078fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0008889f0?, 0x3?, 0xc000506900?}, 0xc0005785a0, 0xc000888960) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0005785a0, 0xc0000d8de0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234755904202676/gauge_test.go:31 +0xf [runner: 2] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc0006c3340, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc00048a070?, 0xc00078f418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc00011b590) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc00045c720, 0x1, 0xc0006c3340?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc000734801?}, {0xc00045c720?, 0xc0001310b0?, 0xc0004d9f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc00078fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc00011b620?, 0x7?, 0xc0004d8a80?}, 0xc000734870, 0xc00011b590) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc000734870, 0xc0000d8de0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234755904202676/gauge_test.go:31 +0xf [runner: 2] ## Disable/Enable pipeline templates: PIPELINES-15-TC03 [runner: 2] Error Message: [assertion failed: Command: oc new-project releasetest-wp4vp ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f99cc910008, 0x3823c20}, 0x234f6e8, 0xc0000da230, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f99cc910008, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc0000da230}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc0000da230}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc000895f00, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000804de0, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc000030b28, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc00045c738, 0x1, 0xc0006c3a40?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc000734d01?}, {0xc00045c738?, 0xc000131240?, 0xc0004d9f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc00078fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0007c4000?, 0x3?, 0xc0004d8ae0?}, 0xc000734d20, 0xc00011b8c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc000734d20, 0xc0000d8de0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234755904202676/gauge_test.go:31 +0xf [runner: 2] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc00025d180, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc00048a070?, 0xc00078f418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc0001d4090) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc00002a240, 0x1, 0xc00025d180?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc000928001?}, {0xc00002a240?, 0xc0004a8180?, 0xc000025f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc00078fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0001d4120?, 0x7?, 0xc0000244e0?}, 0xc0009280f0, 0xc0001d4090) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0009280f0, 0xc0000d8de0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234755904202676/gauge_test.go:31 +0xf [runner: 2] Sending kill message to runner. ok command-line-arguments 0.900s 2024/06/24 13:12:38 Annotating the namespaces with 'operator.tekton.dev/prune.skip=true' so that the pipelineruns should not get deleted Runner with PID:27002 has exited 2024/06/24 13:12:38 output: 2024/06/24 13:12:38 output: 2024/06/24 13:12:38 output: 2024/06/24 13:12:38 output: 2024/06/24 13:12:38 output: 2024/06/24 13:12:39 output: 2024/06/24 13:12:39 output: 2024/06/24 13:12:39 output: 2024/06/24 13:12:39 output: [runner: 1] ## Verify auto prune for taskrun: PIPELINES-12-TC01 [runner: 1] Error Message: [assertion failed: Command: oc new-project releasetest-n5pqh ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f2760611a98, 0x3823c20}, 0x234f6e8, 0xc000566910, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f2760611a98, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc000566910}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc000566910}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc000851c80, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc0005bcc60, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00054eb88, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000550a50, 0x1, 0xc0006c3180?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc0004fe201?}, {0xc000550a50?, 0xc000710ac0?, 0xc0006cff80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc00090fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc000886f30?, 0x3?, 0xc0006ceb40?}, 0xc0004fe2d0, 0xc000886c90) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0004fe2d0, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc000583880, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc0004caca8?, 0xc00090f418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc0005bcf90) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000551938, 0x1, 0xc000583880?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc0004fe401?}, {0xc000551938?, 0xc0004a6d30?, 0xc0006cff80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc00090fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0005bd020?, 0x7?, 0xc0006cfc20?}, 0xc0004fe4b0, 0xc0005bcf90) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0004fe4b0, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] ## Verify auto prune with keep-since: PIPELINES-12-TC04 [runner: 1] Error Message: [assertion failed: Command: oc new-project releasetest-dtcnq ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f2760611a98, 0x3823c20}, 0x234f6e8, 0xc0001ea050, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f2760611a98, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc0001ea050}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc0001ea050}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc000967980, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc0009bb200, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00054f608, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000551950, 0x1, 0xc000583c00?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc0004fe801?}, {0xc000551950?, 0xc0004a6fa0?, 0xc0006cff80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc00090fbd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0005bd110?, 0x3?, 0xc0006cfc80?}, 0xc0004fe870, 0xc0005bd080) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0004fe870, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc000603340, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc0004caca8?, 0xc000071418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc0007940c0) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc0007960a8, 0x1, 0xc000603340?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc0004fe001?}, {0xc0007960a8?, 0xc000782230?, 0xc000115f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc000071bd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0007941e0?, 0x7?, 0xc0001145a0?}, 0xc0004fe0f0, 0xc0007940c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0004fe0f0, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] ## Verify auto prune add resources taskrun and pipelinerun per namespace with annotation: PIPELINES-12-TC07 [runner: 1] Error Message: [assertion failed: Command: oc new-project releasetest-k257p ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f2760611a98, 0x3823c20}, 0x234f6e8, 0xc0001ffd60, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f2760611a98, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc0001ffd60}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc0001ffd60}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc0007abc00, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc0008861b0, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00073a2a0, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc0007960c0, 0x1, 0xc000603a40?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc0004fe401?}, {0xc0007960c0?, 0xc0007823c0?, 0xc000115f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc000071bd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc000794510?, 0x3?, 0xc000114660?}, 0xc0004fe4b0, 0xc0007942a0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0004fe4b0, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc0009b2540, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc0004caca8?, 0xc000071418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc000886330) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000796ab0, 0x1, 0xc0009b2540?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc0004fe601?}, {0xc000796ab0?, 0xc00068ae10?, 0xc000745f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc000071bd8, 0x1, 0x60?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0008863c0?, 0x7?, 0xc0007448a0?}, 0xc0004fe690, 0xc000886330) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0004fe690, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] ## Verify auto prune cronjob contains single container: PIPELINES-12-TC14 [runner: 1] Error Message: [assertion failed: Command: oc new-project releasetest-5v2xj ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f2760611a98, 0x3823c20}, 0x234f6e8, 0xc000488000, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f2760611a98, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc000488000}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc000488000}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc000967c00, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc0001f4d20, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00073ac90, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000796ac8, 0x1, 0xc0009b28c0?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc0004feb01?}, {0xc000796ac8?, 0xc00068afa0?, 0xc0002adf80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc000071bd8, 0x1, 0x70?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0008864b0?, 0x3?, 0xc0002acaf0?}, 0xc0004feb40, 0xc000886420) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0004feb40, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc000702e00, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc0004caca8?, 0xc000071418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc0005bc090) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc0006aa060, 0x1, 0xc000702e00?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc0001fa301?}, {0xc0006aa060?, 0xc0007108f0?, 0xc0004ddf80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc000071bd8, 0x1, 0x70?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0005bc2a0?, 0x7?, 0xc0004dc000?}, 0xc0001fa3c0, 0xc0005bc090) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0001fa3c0, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] ## Verify that the operator is up and running after deleting namespace with pruner annotation: PIPELINES-12-TC15 [runner: 1] Error Message: [assertion failed: Command: oc new-project releasetest-r76pd ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f2760611a98, 0x3823c20}, 0x234f6e8, 0xc000570000, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f2760611a98, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc000570000}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc000570000}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc00073e280, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc00084eed0, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00054e060, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc0006aa078, 0x1, 0xc000703340?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc0001fa701?}, {0xc0006aa078?, 0xc000710ec0?, 0xc0004ddf80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc000071bd8, 0x1, 0x70?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0005bc420?, 0x3?, 0xc0004dc850?}, 0xc0001fa780, 0xc0005bc390) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0001fa780, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc000b18540, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc0004caca8?, 0xc000071418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc0006a8090) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc0009b0048, 0x1, 0xc000940070?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0x1?}, {0xc0009b0048?, 0xc0004a6140?, 0xc000941f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc000071bd8, 0x1, 0x70?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0006a8120?, 0x7?, 0xc000940000?}, 0xc0009240f0, 0xc0006a8090) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0009240f0, 0xc0007440c0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Error Message: [assertion failed: Command: oc patch tektonconfig config -p {"spec":{"pruner":{"keep":100,"keep-since":null,"schedule":"0 8 * * *","resources":["pipelinerun"]}}} --type=merge ExitCode: 1 Error: exit status 1 Stdout: Stderr: error: the server doesn't have a resource type "tektonconfig" Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7f2760611a98, 0x3823c20}, 0x234f6e8, 0xc0005700f0, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7f2760611a98, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc0005700f0}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc0005700f0}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc000460480, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000940230, 0x7, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.UpdateTektonConfig({0xc00093e070, 0x65}) /tmp/release-tests/pkg/oc/oc.go:65 +0x130 github.com/openshift-pipelines/release-tests/steps.init.func4(0x0?) /tmp/release-tests/steps/hooks.go:103 +0x1d2 reflect.Value.call({0x1d9eca0?, 0x234eff8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc0009b0120, 0x1, 0xc0009401c0?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234eff8?, 0x1?}, {0xc0009b0120?, 0xc0000e50e0?, 0x2710?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234eff8?, 0x2710?}, {0xc000071c08, 0x1, 0x222f629?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x6?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0006a8330?, 0x6?, 0xc0004a6320?}, 0xc0009242d0, 0xc0006a82d0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*SpecExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0009242d0, 0xc000000002?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/SpecExecutionEndingProcessor.go:15 +0x98 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234753786562304/gauge_test.go:31 +0xf [runner: 1] Sending kill message to runner. ok command-line-arguments 4.434s Runner with PID:26551 has exited Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_13.12.39/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 13.12.40 Sending kill message to Html Report plugin. Sending kill message to Xml Report plugin. Specifications: 2 executed 0 passed 2 failed 0 skipped Scenarios: 8 executed 0 passed 8 failed 0 skipped Total time taken: 4.51s gauge run specs/operator/rbac.spec log-level : [debug] tags : [sanity] verbose : [true] env will be loaded from default directory 'env' 'gauge_environment' set to 'default' Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots Plugin go is already installed. Plugin html-report is already installed. Plugin xml-report is already installed. Parsing started. Started concepts parsing. 14 concepts parsing completed. Started specifications parsing. 1 specifications parsing completed. Applying tags filter: sanity The following specifications satisfy filter criteria: specs/operator/rbac.spec Parsing completed. Starting go runner Checking updates... Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64 Established connection to runner. Validation started. Validation completed. Run started Starting Html Report plugin Setting MaxRecvMsgSize = 1024 MB Attempting to connect to grpc server at port: 34615 Successfully made the connection with plugin with port: 34615 Starting Xml Report plugin Attempting to connect to grpc server at port: 38983 Successfully made the connection with plugin with port: 38983 Initialising suite data store. # Verify RBAC Resources  ## Disable RBAC resource creation: PIPELINES-11-TC01  Error Message: [assertion failed: Command: oc new-project releasetest-twgnv ExitCode: 1 Error: exit status 1 Stdout: Stderr: Error from server (Forbidden): You may not request a new project via this API. Failures: ExitCode was 1 expected 0 Expected no error] Stacktrace: /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:46 github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...) /tmp/release-tests/pkg/cmd/cmd.go:34 gotest.tools/v3/internal/assert.RunComparison({0x7fae5c1ac380, 0x3823c20}, 0x234f6e8, 0xc0005d6050, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/result.go:60 +0x205 gotest.tools/v3/internal/assert.Eval({0x7fae5c1ac380, 0x3823c20}, 0x234f6e8, {0x1e768e0, 0xc0005d6050}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/internal/assert/assert.go:56 +0x13d gotest.tools/v3/assert.Assert({0x2575df0, 0x3823c20}, {0x1e768e0, 0xc0005d6050}, {0x0, 0x0, 0x0}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/assert/assert.go:145 +0xce gotest.tools/v3/icmd.(*Result).Assert(0xc000527080, {0x2575df0, 0x3823c20}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}) /alabama/go/pkg/mod/gotest.tools/v3@v3.4.0/icmd/command.go:62 +0x145 github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc0006ee2a0, 0x3, ...}) /tmp/release-tests/pkg/cmd/cmd.go:50 +0x105 github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...) /tmp/release-tests/pkg/cmd/cmd.go:43 github.com/openshift-pipelines/release-tests/pkg/oc.CreateNewProject({0xc00005d740, 0x11}) /tmp/release-tests/pkg/oc/oc.go:30 +0xe5 github.com/openshift-pipelines/release-tests/pkg/k8s.NewClientSet() /tmp/release-tests/pkg/k8s/k8s.go:45 +0x85 github.com/openshift-pipelines/release-tests/steps.init.func1(0x0?) /tmp/release-tests/steps/hooks.go:24 +0x25 reflect.Value.call({0x1d9eca0?, 0x234efe0?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000386b10, 0x1, 0xc00053ec40?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe0?, 0xc0001f7301?}, {0xc000386b10?, 0xc0007866c0?, 0xc0004a5f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe0?, 0x0?}, {0xc00069bbd8, 0x1, 0x40?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x3?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0002b32c0?, 0x3?, 0xc0004a4a00?}, 0xc0001f73b0, 0xc0002b2cf0) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionStartingRequestProcessor).Process(0x1ef7e60?, 0xc0001f73b0, 0xc000506240) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionStartingRequestProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234760443755797/gauge_test.go:31 +0xf  Error Message: Error: return type is not of type func() Stacktrace: goroutine 1 [running, locked to thread]: runtime/debug.Stack() /usr/lib/golang/src/runtime/debug/stack.go:24 +0x5e github.com/getgauge-contrib/gauge-go/testsuit.(*testingT).Errorf(0xc0006c2c40, {0x2265cfd?, 0x2238e72?}, {0x0?, 0xc0005350b8?, 0xc00069b418?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/testing.go:56 +0x47 github.com/openshift-pipelines/release-tests/steps.init.func2(0xc0001cc210) /tmp/release-tests/steps/hooks.go:52 +0x172 reflect.Value.call({0x1d9eca0?, 0x234efe8?, 0x1c0?}, {0x22275a4, 0x4}, {0xc000012870, 0x1, 0xc0006c2c40?}) /usr/lib/golang/src/reflect/value.go:596 +0xca6 reflect.Value.Call({0x1d9eca0?, 0x234efe8?, 0xc0007b0001?}, {0xc000012870?, 0xc0001bc110?, 0xc000487f80?}) /usr/lib/golang/src/reflect/value.go:380 +0xb9 github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x1d9eca0?, 0x234efe8?, 0x0?}, {0xc00069bbd8, 0x1, 0x40?}) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/funcExecutor.go:47 +0x235 github.com/getgauge-contrib/gauge-go/testsuit.(*Hook).Execute(0x1?, 0x7?) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/testsuit/hook.go:38 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.executeHooks({0xc0001cc2a0?, 0x7?, 0xc000486a00?}, 0xc0007b00f0, 0xc0001cc210) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/Helper.go:12 +0x91 github.com/getgauge-contrib/gauge-go/messageprocessors.(*ScenarioExecutionEndingProcessor).Process(0x1ef7e60?, 0xc0007b00f0, 0xc000506240) /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/messageprocessors/ScenarioExecutionEndingProcessor.go:15 +0x154 github.com/getgauge-contrib/gauge-go/gauge.Run() /alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.3.1/gauge/runner.go:219 +0x227 command-line-arguments.init.0() /tmp/gauge_temp1719234760443755797/gauge_test.go:31 +0xf  Transformed SuiteResult to report structure Successfully generated html-report to => /logs/artifacts/html-report/2024-06-24_13.12.42/index.html Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default Successfully generated xml-report to => /logs/artifacts/xml-report/2024-06-24 13.12.42 Sending kill message to Html Report plugin. Sending kill message to Xml Report plugin. Sending kill message to runner. ok command-line-arguments 0.136s Runner with PID:27750 has exited Specifications: 1 executed 0 passed 1 failed 0 skipped Scenarios: 1 executed 0 passed 1 failed 0 skipped Total time taken: 101ms Rename xml files to junit_test_*.xml