WARNING: Using insecure TLS client config. Setting this option is not supported!

Login successful.

You have access to 102 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
Running gauge specs
gauge run specs/clustertasks/clustertask-s2i.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Compatible version of plugin go not found. Installing plugin go...
Gathering metadata for go
Downloading https://downloads.gauge.org/plugin/go?l=go&p=&o=linux&a=amd64
Downloading https://github.com/getgauge-contrib/gauge-go/releases/download/v0.4.0/gauge-go-0.4.0-linux.x86_64.zip
.......................
Running plugin hook command => [go install github.com/go-delve/delve/cmd/dlv@latest]
go: downloading github.com/go-delve/delve v1.23.0
go: downloading github.com/sirupsen/logrus v1.9.3
go: downloading github.com/spf13/cobra v1.7.0
go: downloading github.com/mattn/go-isatty v0.0.20
go: downloading github.com/spf13/pflag v1.0.5
go: downloading github.com/hashicorp/golang-lru v1.0.2
go: downloading github.com/cosiner/argv v0.1.0
go: downloading github.com/derekparker/trie v0.0.0-20230829180723-39f4de51ef7d
go: downloading github.com/go-delve/liner v1.2.3-0.20231231155935-4726ab1d7f62
go: downloading golang.org/x/arch v0.6.0
go: downloading gopkg.in/yaml.v3 v3.0.1
go: downloading github.com/google/go-dap v0.12.0
go: downloading github.com/cilium/ebpf v0.11.0
go: downloading go.starlark.net v0.0.0-20231101134539-556fd59b42f6
go: downloading golang.org/x/sys v0.17.0
go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2
go: downloading github.com/mattn/go-runewidth v0.0.13
go: downloading github.com/russross/blackfriday/v2 v2.1.0
go: downloading golang.org/x/exp v0.0.0-20230224173230-c95f2b4c22f2
go: downloading github.com/rivo/uniseg v0.2.0
Running plugin hook command => [go install github.com/getgauge-contrib/gauge-go@latest]
go: downloading github.com/getgauge-contrib/gauge-go v0.4.0
go: downloading github.com/getgauge/common v0.0.0-20211105093448-e0aee1ccb217
go: downloading github.com/golang/protobuf v1.5.3
go: downloading github.com/dmotylev/goproperties v0.0.0-20140630191356-7cbffbaada47
go: downloading google.golang.org/protobuf v1.31.0
Installing plugin go 0.4.0
Successfully installed plugin 'go' version 0.4.0
Compatible version of plugin html-report not found. Installing plugin html-report...
Gathering metadata for html-report
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go&o=linux&a=amd64
Downloading https://github.com/getgauge/html-report/releases/download/v4.3.1/html-report-4.3.1-linux.x86_64.zip
.......................
Installing plugin html-report 4.3.1
Successfully installed plugin 'html-report' version 4.3.1
Compatible version of plugin xml-report not found. Installing plugin xml-report...
Gathering metadata for xml-report
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report&o=linux&a=amd64
Downloading https://github.com/getgauge/xml-report/releases/download/v0.5.1/xml-report-0.5.1-linux.x86_64.zip
........................
Installing plugin xml-report 0.5.1
Successfully installed plugin 'xml-report' version 0.5.1
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/clustertasks/clustertask-s2i.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
go: downloading github.com/openshift/client-go v0.0.0-20230503144108-75015d2347cb
go: downloading k8s.io/apimachinery v0.28.9
go: downloading go.opencensus.io v0.24.0
go: downloading github.com/openshift/api v0.0.0-20240304080513-3e8192a10b13
go: downloading github.com/tektoncd/operator v0.71.0
go: downloading gotest.tools/v3 v3.5.1
go: downloading github.com/operator-framework/operator-lifecycle-manager v0.22.0
go: downloading k8s.io/api v0.28.9
go: downloading github.com/operator-framework/api v0.16.0
go: downloading github.com/tektoncd/cli v0.37.0
go: downloading github.com/tektoncd/pipeline v0.59.0
go: downloading github.com/pkg/errors v0.9.1
go: downloading github.com/prometheus/client_golang v1.19.0
go: downloading knative.dev/pkg v0.0.0-20240116073220-b488e7be5902
go: downloading github.com/prometheus/common v0.52.2
go: downloading github.com/google/go-cmp v0.6.0
go: downloading github.com/tektoncd/triggers v0.27.0
go: downloading k8s.io/client-go v0.28.9
go: downloading github.com/golang/protobuf v1.5.4
go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
go: downloading github.com/gogo/protobuf v1.3.2
go: downloading github.com/google/gofuzz v1.2.0
go: downloading k8s.io/utils v0.0.0-20240310230437-4693a0247e57
go: downloading github.com/json-iterator/go v1.1.12
go: downloading k8s.io/klog/v2 v2.120.1
go: downloading github.com/prometheus/client_model v0.6.1
go: downloading google.golang.org/protobuf v1.33.0
go: downloading go.uber.org/zap v1.27.0
go: downloading github.com/manifestival/manifestival v0.7.2
go: downloading github.com/openshift-pipelines/pipelines-as-code v0.27.0
go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.4.1
go: downloading github.com/fatih/color v1.16.0
go: downloading github.com/jonboulle/clockwork v0.4.0
go: downloading github.com/spf13/cobra v1.8.0
go: downloading go.uber.org/multierr v1.11.0
go: downloading k8s.io/cli-runtime v0.28.9
go: downloading sigs.k8s.io/yaml v1.4.0
go: downloading github.com/AlecAivazis/survey/v2 v2.3.7
go: downloading github.com/ktr0731/go-fuzzyfinder v0.8.0
go: downloading github.com/google/cel-go v0.20.1
go: downloading golang.org/x/exp v0.0.0-20240325151524-a685a6edb6d8
go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9
go: downloading github.com/blang/semver/v4 v4.0.0
go: downloading golang.org/x/sys v0.20.0
go: downloading golang.org/x/net v0.24.0
go: downloading gopkg.in/inf.v0 v0.9.1
go: downloading github.com/imdario/mergo v0.3.16
go: downloading golang.org/x/term v0.20.0
go: downloading github.com/google/gnostic-models v0.6.9-0.20230804172637-c7be7c783f49
go: downloading golang.org/x/time v0.5.0
go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
go: downloading github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc
go: downloading github.com/openshift/apiserver-library-go v0.0.0-20230816171015-6bfafa975bfb
go: downloading github.com/blendle/zapdriver v1.3.1
go: downloading github.com/google/uuid v1.6.0
go: downloading golang.org/x/sync v0.7.0
go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: downloading github.com/modern-go/reflect2 v1.0.2
go: downloading github.com/go-logr/logr v1.4.1
go: downloading github.com/hako/durafmt v0.0.0-20210608085754-5c1018a4e16b
go: downloading github.com/evanphx/json-patch/v5 v5.9.0
go: downloading github.com/mattn/go-colorable v0.1.13
go: downloading github.com/google/go-containerregistry v0.19.1
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading golang.org/x/text v0.15.0
go: downloading github.com/gdamore/tcell/v2 v2.6.0
go: downloading github.com/ktr0731/go-ansisgr v0.1.0
go: downloading github.com/mattn/go-runewidth v0.0.15
go: downloading github.com/evanphx/json-patch v5.9.0+incompatible
go: downloading github.com/nsf/termbox-go v1.1.1
go: downloading gopkg.in/yaml.v2 v2.4.0
go: downloading golang.org/x/oauth2 v0.19.0
go: downloading google.golang.org/genproto/googleapis/api v0.0.0-20240401170217-c3f982113cda
go: downloading sigs.k8s.io/controller-runtime v0.15.3
go: downloading contrib.go.opencensus.io/exporter/ocagent v0.7.1-0.20200907061046-05415f1de66d
go: downloading contrib.go.opencensus.io/exporter/prometheus v0.4.2
go: downloading google.golang.org/grpc v1.63.2
go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0
go: downloading golang.org/x/xerrors v0.0.0-20231012003039-104605ab7028
go: downloading knative.dev/eventing v0.40.3
go: downloading github.com/cloudevents/sdk-go/v2 v2.15.2
go: downloading github.com/tidwall/sjson v1.2.4
go: downloading github.com/kelseyhightower/envconfig v1.4.0
go: downloading github.com/hashicorp/go-multierror v1.1.1
go: downloading github.com/mgutz/ansi v0.0.0-20200706080929-d51e80ef957d
go: downloading github.com/emicklei/go-restful/v3 v3.12.0
go: downloading github.com/go-openapi/jsonreference v0.21.0
go: downloading github.com/go-openapi/swag v0.23.0
go: downloading github.com/rivo/uniseg v0.4.4
go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de
go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3
go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3
go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79
go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible
go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822
go: downloading github.com/stoewer/go-strcase v1.3.0
go: downloading github.com/antlr4-go/antlr/v4 v4.13.0
go: downloading github.com/gdamore/encoding v1.0.0
go: downloading github.com/lucasb-eyer/go-colorful v1.2.0
go: downloading k8s.io/apiextensions-apiserver v0.28.9
go: downloading github.com/census-instrumentation/opencensus-proto v0.4.1
go: downloading google.golang.org/api v0.172.0
go: downloading github.com/prometheus/statsd_exporter v0.26.1
go: downloading github.com/tidwall/gjson v1.12.1
go: downloading github.com/hashicorp/errwrap v1.1.0
go: downloading github.com/go-openapi/jsonpointer v0.21.0
go: downloading github.com/mailru/easyjson v0.7.7
go: downloading github.com/opencontainers/go-digest v1.0.0
go: downloading github.com/google/btree v1.1.2
go: downloading github.com/grpc-ecosystem/grpc-gateway/v2 v2.19.1
go: downloading github.com/beorn7/perks v1.0.1
go: downloading github.com/prometheus/procfs v0.13.0
go: downloading github.com/go-kit/log v0.2.1
go: downloading github.com/cespare/xxhash/v2 v2.2.0
go: downloading github.com/tidwall/pretty v1.2.0
go: downloading github.com/tidwall/match v1.1.1
go: downloading github.com/josharian/intern v1.0.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20240401170217-c3f982113cda
go: downloading github.com/go-logfmt/logfmt v0.6.0
go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510
go: downloading github.com/go-errors/errors v1.4.2
go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca
go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00
go: downloading github.com/xlab/treeprint v1.2.0
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 44917
Successfully made the connection with plugin with port: 44917
Starting Xml Report plugin
Attempting to connect to grpc server at port: 42787
Successfully made the connection with plugin with port: 42787
Initialising suite data store.
# Verify Clustertasks E2E spec
  ## S2I nodejs pipelinerun: PIPELINES-14-TC01	
2024/08/07 01:36:51 output: Now using project "releasetest-kczgv" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 01:36:51 Waiting for operator to be up and running....
2024/08/07 01:36:51 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:36:51 Verify SA "pipeline" is created in namespace "releasetest-kczgv"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:36:56 output: imagestream.image.openshift.io/nodejs-ex-git created
deploymentconfig.apps.openshift.io/nodejs-ex-git created
pipeline.tekton.dev/nodejs-ex-git created
pipelinerun.tekton.dev/nodejs-ex-git-pr created
      * Create 
      
         |S.NO|resource_dir                                            |
         |----|--------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/s2i-nodejs-pipelinerun.yaml|	 ...[PASS]
2024/08/07 01:36:56 validating pipeline run for success state...
2024/08/07 01:39:11 pipelineRun: nodejs-ex-git-pr is successful under namespace : releasetest-kczgv
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_lable_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |nodejs-ex-git-pr |successful|no                     |	 ...[PASS]
2024/08/07 01:39:26 output: project.project.openshift.io "releasetest-kczgv" deleted
  ## S2I java pipelinerun: PIPELINES-14-TC04	
2024/08/07 01:39:26 output: Now using project "releasetest-xm9wk" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:39:26 Verify SA "pipeline" is created in namespace "releasetest-xm9wk"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:39:31 output: pipeline.tekton.dev/s2i-java-pipeline created
2024/08/07 01:39:31 output: persistentvolumeclaim/shared-pvc created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/v1beta1/clustertask/pipelines/s2i-java.yaml|
         |2   |testdata/pvc/pvc.yaml                               |	 ...[PASS]
2024/08/07 01:39:31 Getting imagestream from the namespace openshift
      * Get tags of the imagestream "java" from namespace "openshift" and store to variable "java-tags"	 ...[PASS]
2024/08/07 01:39:31 Starting pipeline s2i-java-pipeline with param VERSION=11
2024/08/07 01:39:32 Pipelinerun s2i-java-pipeline-run-b5bjw started
2024/08/07 01:39:32 validating pipeline run for success state...
2024/08/07 01:41:12 pipelineRun: s2i-java-pipeline-run-b5bjw is successful under namespace : releasetest-xm9wk
2024/08/07 01:41:12 Starting pipeline s2i-java-pipeline with param VERSION=8
2024/08/07 01:41:12 Pipelinerun s2i-java-pipeline-run-6c68t started
2024/08/07 01:41:12 validating pipeline run for success state...
2024/08/07 01:42:37 pipelineRun: s2i-java-pipeline-run-6c68t is successful under namespace : releasetest-xm9wk
2024/08/07 01:42:37 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-el7
2024/08/07 01:42:37 Pipelinerun s2i-java-pipeline-run-9rccv started
2024/08/07 01:42:37 validating pipeline run for success state...
2024/08/07 01:44:12 pipelineRun: s2i-java-pipeline-run-9rccv is successful under namespace : releasetest-xm9wk
2024/08/07 01:44:12 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-ubi8
2024/08/07 01:44:12 Pipelinerun s2i-java-pipeline-run-7dbhr started
2024/08/07 01:44:12 validating pipeline run for success state...
2024/08/07 01:45:07 pipelineRun: s2i-java-pipeline-run-7dbhr is successful under namespace : releasetest-xm9wk
2024/08/07 01:45:07 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-17-ubi8
2024/08/07 01:45:07 Pipelinerun s2i-java-pipeline-run-xb92g started
2024/08/07 01:45:07 validating pipeline run for success state...
2024/08/07 01:46:02 pipelineRun: s2i-java-pipeline-run-xb92g is successful under namespace : releasetest-xm9wk
2024/08/07 01:46:02 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-el7
2024/08/07 01:46:02 Pipelinerun s2i-java-pipeline-run-fdv5w started
2024/08/07 01:46:02 validating pipeline run for success state...
2024/08/07 01:47:32 pipelineRun: s2i-java-pipeline-run-fdv5w is successful under namespace : releasetest-xm9wk
2024/08/07 01:47:32 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-ubi8
2024/08/07 01:47:32 Pipelinerun s2i-java-pipeline-run-jfd6j started
2024/08/07 01:47:32 validating pipeline run for success state...
2024/08/07 01:48:37 pipelineRun: s2i-java-pipeline-run-jfd6j is successful under namespace : releasetest-xm9wk
      * Start and verify pipeline "s2i-java-pipeline" with param "VERSION" with values stored in variable "java-tags" with workspace "name=source,claimName=shared-pvc"	 ...[PASS]
2024/08/07 01:48:52 output: project.project.openshift.io "releasetest-xm9wk" deleted

Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 01.48.53

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_01.48.53/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	722.014s
Runner with PID:4218 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Total time taken: 12m1.914s
gauge run specs/clustertasks/clustertask.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/clustertasks/clustertask.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 40547
Successfully made the connection with plugin with port: 40547
Starting Xml Report plugin
Attempting to connect to grpc server at port: 35329
Successfully made the connection with plugin with port: 35329
Initialising suite data store.
# Verify Clustertasks E2E spec
  ## buildah pipelinerun: PIPELINES-16-TC01	
2024/08/07 01:48:56 output: Now using project "releasetest-27787" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 01:48:57 Waiting for operator to be up and running....
2024/08/07 01:48:57 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:48:57 Verify SA "pipeline" is created in namespace "releasetest-27787"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:49:02 output: pipeline.tekton.dev/buildah-pipeline created
2024/08/07 01:49:02 output: persistentvolumeclaim/shared-pvc created
2024/08/07 01:49:02 output: pipelinerun.tekton.dev/buildah-run created
      * Create 
      
         |S.NO|resource_dir                                     |
         |----|-------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelines/buildah.yaml   |
         |2   |testdata/pvc/pvc.yaml                            |
         |3   |testdata/v1/clustertask/pipelineruns/buildah.yaml|	 ...[PASS]
2024/08/07 01:49:02 validating pipeline run for success state...
2024/08/07 01:49:42 pipelineRun: buildah-run is successful under namespace : releasetest-27787
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |buildah-run      |successful|no                     |	 ...[PASS]
2024/08/07 01:49:56 output: project.project.openshift.io "releasetest-27787" deleted
  ## git-clone read private repo taskrun PIPELINES-16-TC12	
2024/08/07 01:49:56 output: Now using project "releasetest-76nn7" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:49:56 Verify SA "pipeline" is created in namespace "releasetest-76nn7"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:50:01 output: pipeline.tekton.dev/git-clone-read-private-pipeline created
2024/08/07 01:50:02 output: persistentvolumeclaim/shared-pvc created
2024/08/07 01:50:02 output: secret/ssh-key created
      * Create 
      
         |S.NO|resource_dir                                                 |
         |----|-------------------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelines/git-clone-read-private.yaml|
         |2   |testdata/pvc/pvc.yaml                                        |
         |3   |testdata/v1/clustertask/secrets/ssh-key.yaml                 |	 ...[PASS]
2024/08/07 01:50:02 output:
      * Link secret "ssh-key" to service account "pipeline"	 ...[PASS]
2024/08/07 01:50:02 output: pipelinerun.tekton.dev/git-clone-read-private-pipeline-run created
      * Create 
      
         |S.NO|resource_dir                                                    |
         |----|----------------------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelineruns/git-clone-read-private.yaml|	 ...[PASS]
2024/08/07 01:50:02 validating pipeline run for success state...
2024/08/07 01:50:07 pipelineRun: git-clone-read-private-pipeline-run is successful under namespace : releasetest-76nn7
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                  |status    |check_label_propagation|
         |----|-----------------------------------|----------|-----------------------|
         |1   |git-clone-read-private-pipeline-run|successful|no                     |	 ...[PASS]
2024/08/07 01:50:21 output: project.project.openshift.io "releasetest-76nn7" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_01.50.21/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 01.50.21

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	84.432s
Runner with PID:24561 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Total time taken: 1m24.367s
gauge run specs/pipelines/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
6 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/pipelines/bundles-resolver.spec
specs/pipelines/cluster-resolvers.spec
specs/pipelines/fail.spec
specs/pipelines/git-resolvers.spec
specs/pipelines/hub-resolvers.spec
specs/pipelines/run.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 42253
Successfully made the connection with plugin with port: 42253
Starting Xml Report plugin
Attempting to connect to grpc server at port: 37935
Successfully made the connection with plugin with port: 37935
Initialising suite data store.
# Bundles resolver spec
  ## Test the functionality of bundles resolver with parameter: PIPELINES-25-TC02	
2024/08/07 01:50:24 output: Now using project "releasetest-bqvrp" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 01:50:24 Waiting for operator to be up and running....
2024/08/07 01:50:24 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:50:24 Verify SA "pipeline" is created in namespace "releasetest-bqvrp"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:50:30 output: pipelinerun.tekton.dev/bundles-resolver-pipelinerun-param created
      * Create 
      
         |S.NO|resource_dir                                                           |
         |----|-----------------------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/bundles-resolver-pipelinerun-param.yaml|	 ...[PASS]
2024/08/07 01:50:30 validating pipeline run for success state...
2024/08/07 01:50:55 pipelineRun: bundles-resolver-pipelinerun-param is successful under namespace : releasetest-bqvrp
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                 |status    |check_label_propagation|
         |----|----------------------------------|----------|-----------------------|
         |1   |bundles-resolver-pipelinerun-param|successful|no                     |	 ...[PASS]
2024/08/07 01:51:09 output: project.project.openshift.io "releasetest-bqvrp" deleted

# Cluster resolvers spec
  ## Checking the functionality of cluster resolvers#1: PIPELINES-23-TC01	
2024/08/07 01:51:09 output: Now using project "releasetest-vq4wk" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 01:51:09 Check if project releasetest-tasks already exists
2024/08/07 01:51:09 Creating project releasetest-tasks
2024/08/07 01:51:09 output: Now using project "releasetest-tasks" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-tasks"	 ...[PASS]
2024/08/07 01:51:10 output: task.tekton.dev/resolver-task2 created
      * Create 
      
         |S.NO|resource_dir                                |
         |----|--------------------------------------------|
         |1   |testdata/resolvers/tasks/resolver-task2.yaml|	 ...[PASS]
2024/08/07 01:51:10 Check if project releasetest-pipelines already exists
2024/08/07 01:51:10 Creating project releasetest-pipelines
2024/08/07 01:51:10 output: Now using project "releasetest-pipelines" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-pipelines"	 ...[PASS]
2024/08/07 01:51:10 output: pipeline.tekton.dev/resolver-pipeline created
      * Create 
      
         |S.NO|resource_dir                                       |
         |----|---------------------------------------------------|
         |1   |testdata/resolvers/pipelines/resolver-pipeline.yaml|	 ...[PASS]
2024/08/07 01:51:10 Check if project releasetest-pipelineruns already exists
2024/08/07 01:51:11 Creating project releasetest-pipelineruns
2024/08/07 01:51:11 output: Now using project "releasetest-pipelineruns" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-pipelineruns"	 ...[PASS]
2024/08/07 01:51:11 Verify SA "pipeline" is created in namespace "releasetest-pipelineruns"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:51:16 output: pipelinerun.tekton.dev/resolver-pipelinerun created
      * Create 
      
         |S.NO|resource_dir                                             |
         |----|---------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/resolver-pipelinerun.yaml|	 ...[PASS]
2024/08/07 01:51:16 validating pipeline run for success state...
2024/08/07 01:51:36 pipelineRun: resolver-pipelinerun is successful under namespace : releasetest-pipelineruns
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name   |status    |check_label_propagation|
         |----|--------------------|----------|-----------------------|
         |1   |resolver-pipelinerun|successful|no                     |	 ...[PASS]
2024/08/07 01:51:36 Deleting project releasetest-tasks
2024/08/07 01:51:44 output: project.project.openshift.io "releasetest-tasks" deleted
      * Delete project "releasetest-tasks"	 ...[PASS]
2024/08/07 01:51:44 Deleting project releasetest-pipelines
2024/08/07 01:51:51 output: project.project.openshift.io "releasetest-pipelines" deleted
      * Delete project "releasetest-pipelines"	 ...[PASS]
2024/08/07 01:51:51 Deleting project releasetest-pipelineruns
2024/08/07 01:52:05 output: project.project.openshift.io "releasetest-pipelineruns" deleted
      * Delete project "releasetest-pipelineruns"	 ...[PASS]
2024/08/07 01:52:13 output: project.project.openshift.io "releasetest-vq4wk" deleted

# Verify Pipeline Failures
  ## Run Pipeline with a non-existent ServiceAccount: PIPELINES-02-TC01	
2024/08/07 01:52:13 output: Now using project "releasetest-9k248" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:52:13 Verify SA "foobar" is absent in namespace "releasetest-9k248"
      * Verify ServiceAccount "foobar" does not exist	 ...[PASS]
2024/08/07 01:52:14 output: task.tekton.dev/create-file-vb created
task.tekton.dev/check-stuff-file-exists-vb created
pipeline.tekton.dev/output-pipeline-vb created
pipelinerun.tekton.dev/output-pipeline-run-vb created
      * Create 
      
         |S.NO|resource_dir                              |
         |----|------------------------------------------|
         |1   |testdata/negative/v1beta1/pipelinerun.yaml|	 ...[PASS]
2024/08/07 01:52:14 validating pipeline run for failure state...
2024/08/07 01:52:14 Waiting for PipelineRun in namespace releasetest-9k248 to fail
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name     |status |check_label_propagation|
         |----|----------------------|-------|-----------------------|
         |1   |output-pipeline-run-vb|Failure|no                     |	 ...[PASS]
2024/08/07 01:52:32 output: project.project.openshift.io "releasetest-9k248" deleted

# Git resolvers spec
  ## Test the functionality of git resolvers: PIPELINES-24-TC01	
2024/08/07 01:52:33 output: Now using project "releasetest-89nnh" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:52:33 Verify SA "pipeline" is created in namespace "releasetest-89nnh"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:52:38 output: pipelinerun.tekton.dev/git-resolver-pipelinerun created
      * Create 
      
         |S.NO|resource_dir                                                 |
         |----|-------------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/git-resolver-pipelinerun.yaml|	 ...[PASS]
2024/08/07 01:52:38 validating pipeline run for success state...
2024/08/07 01:52:48 pipelineRun: git-resolver-pipelinerun is successful under namespace : releasetest-89nnh
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status    |check_label_propagation|
         |----|------------------------|----------|-----------------------|
         |1   |git-resolver-pipelinerun|successful|no                     |	 ...[PASS]
2024/08/07 01:53:01 output: project.project.openshift.io "releasetest-89nnh" deleted

# HUB resolvers spec
  ## Test the functionality of hub resolvers	
2024/08/07 01:53:02 output: Now using project "releasetest-stzwx" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:53:02 Verify SA "pipeline" is created in namespace "releasetest-stzwx"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:53:09 output: pipeline.tekton.dev/hub-git-cli-pipeline created
2024/08/07 01:53:12 output: persistentvolumeclaim/shared-pvc created
2024/08/07 01:53:12 output: pipelinerun.tekton.dev/hub-git-cli-run created
      * Apply 
      
         |S.NO|resource_dir                                    |
         |----|------------------------------------------------|
         |1   |testdata/resolvers/pipelines/git-cli-hub.yaml   |
         |2   |testdata/pvc/pvc.yaml                           |
         |3   |testdata/resolvers/pipelineruns/git-cli-hub.yaml|	 ...[PASS]
2024/08/07 01:53:12 validating pipeline run for success state...
2024/08/07 01:53:37 pipelineRun: hub-git-cli-run is successful under namespace : releasetest-stzwx
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |hub-git-cli-run  |successful|no                     |	 ...[PASS]
2024/08/07 01:53:52 output: project.project.openshift.io "releasetest-stzwx" deleted

# Verify Pipeline E2E spec
  ## Pipelinerun Timeout failure Test: PIPELINES-03-TC04	
2024/08/07 01:53:52 output: Now using project "releasetest-qs7fs" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:53:52 Verify SA "pipeline" is created in namespace "releasetest-qs7fs"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:53:57 output: task.tekton.dev/banana created
pipeline.tekton.dev/tomatoes created
pipelinerun.tekton.dev/pear created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/pipelineruntimeout.yaml|	 ...[PASS]
2024/08/07 01:53:57 validating pipeline run timeout...
2024/08/07 01:53:57 Waiting for Pipelinerun pear in namespace releasetest-qs7fs to be started
2024/08/07 01:54:02 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-qs7fs to be running
2024/08/07 01:54:02 Waiting for PipelineRun pear in namespace releasetest-qs7fs to be timed out
2024/08/07 01:54:07 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-qs7fs to be cancelled
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status |check_label_propagation|
         |----|-----------------|-------|-----------------------|
         |1   |pear             |timeout|no                     |	 ...[PASS]
2024/08/07 01:54:22 output: project.project.openshift.io "releasetest-qs7fs" deleted
  ## Configure execution results at the Task level Test: PIPELINES-03-TC05	
2024/08/07 01:54:22 output: Now using project "releasetest-f95qc" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:54:22 Verify SA "pipeline" is created in namespace "releasetest-f95qc"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:54:27 output: pipeline.tekton.dev/sum-and-multiply-pipeline created
task.tekton.dev/sum created
task.tekton.dev/multiply created
pipelinerun.tekton.dev/task-level-results created
      * Create 
      
         |S.NO|resource_dir                                          |
         |----|------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/task_results_example.yaml|	 ...[PASS]
2024/08/07 01:54:27 validating pipeline run for success state...
2024/08/07 01:54:37 pipelineRun: task-level-results is successful under namespace : releasetest-f95qc
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name |status    |check_label_propagation|
         |----|------------------|----------|-----------------------|
         |1   |task-level-results|successful|no                     |	 ...[PASS]
2024/08/07 01:54:51 output: project.project.openshift.io "releasetest-f95qc" deleted
  ## Cancel pipelinerun Test: PIPELINES-03-TC06	
2024/08/07 01:54:51 output: Now using project "releasetest-r8xwg" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:54:51 Verify SA "pipeline" is created in namespace "releasetest-r8xwg"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:54:56 output: persistentvolumeclaim/shared-pvc created
2024/08/07 01:54:56 output: task.tekton.dev/create-file-v1b1 created
task.tekton.dev/check-file-exists-v1b1 created
pipeline.tekton.dev/output-pipeline-v1b1 created
pipelinerun.tekton.dev/output-pipeline-run-v1b1 created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pvc/pvc.yaml                        |
         |2   |testdata/v1beta1/pipelinerun/pipelinerun.yaml|	 ...[PASS]
2024/08/07 01:54:56 validating pipeline run timeout...
2024/08/07 01:54:56 Waiting for Pipelinerun output-pipeline-run-v1b1 in namespace releasetest-r8xwg to be started
2024/08/07 01:55:01 Canceling pipeline run: PipelineRun cancelled: output-pipeline-run-v1b1
2024/08/07 01:55:07 Waiting for TaskRuns in PipelineRun output-pipeline-run-v1b1 in namespace releasetest-r8xwg to be cancelled
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status   |check_label_propagation|
         |----|------------------------|---------|-----------------------|
         |1   |output-pipeline-run-v1b1|cancelled|no                     |	 ...[PASS]
2024/08/07 01:55:20 output: project.project.openshift.io "releasetest-r8xwg" deleted
  ## Pipelinerun with large result: PIPELINES-03-TC08	
2024/08/07 01:55:20 output: Now using project "releasetest-8fq8p" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:55:20 Verify SA "pipeline" is created in namespace "releasetest-8fq8p"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 01:55:26 output: task.tekton.dev/print-result created
task.tekton.dev/generate-result created
pipeline.tekton.dev/result-test created
pipelinerun.tekton.dev/result-test-run created
      * Create 
      
         |S.NO|resource_dir                                                   |
         |----|---------------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/pipelinerun-with-large-result.yaml|	 ...[PASS]
2024/08/07 01:55:26 validating pipeline run for success state...
2024/08/07 01:55:36 pipelineRun: result-test-run is successful under namespace : releasetest-8fq8p
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |result-test-run  |successful|no                     |	 ...[PASS]
2024/08/07 01:55:50 output: project.project.openshift.io "releasetest-8fq8p" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_01.55.50/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 01.55.50

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	325.887s
Runner with PID:25299 has exited
Specifications:	6 executed	6 passed	0 failed	0 skipped
Scenarios:	9 executed	9 passed	0 failed	0 skipped

Total time taken: 5m25.816s
gauge run specs/triggers/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
4 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/triggers/cron.spec
specs/triggers/eventlistener.spec
specs/triggers/triggerbinding.spec
specs/triggers/tutorial.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 44995
Successfully made the connection with plugin with port: 44995
Starting Xml Report plugin
Attempting to connect to grpc server at port: 40679
Successfully made the connection with plugin with port: 40679
Initialising suite data store.
# Verify Triggers with cronjob
  ## Create Triggers using k8s cronJob: PIPELINES-04-TC01	
2024/08/07 01:55:54 output: Now using project "releasetest-4k7fl" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 01:55:54 Waiting for operator to be up and running....
2024/08/07 01:55:54 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 01:55:54 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/08/07 01:55:54 output: triggerbinding.triggers.tekton.dev/cron-binding created
2024/08/07 01:55:55 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/08/07 01:55:55 output: eventlistener.triggers.tekton.dev/cron-listener created
      * Create 
      
         |S.NO|resource_dir                                |
         |----|--------------------------------------------|
         |1   |testdata/triggers/cron/example-pipeline.yaml|
         |2   |testdata/triggers/cron/triggerbinding.yaml  |
         |3   |testdata/triggers/cron/triggertemplate.yaml |
         |4   |testdata/triggers/cron/eventlistener.yaml   |	 ...[PASS]
2024/08/07 01:55:55 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 01:55:55 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 01:56:00 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 01:55:55 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:55:55 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:55:55 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-cron-listener-65bc5f75bd" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 01:55:55 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:55:55 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000889860 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/08/07 01:56:05 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:56:03 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:56:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:56:03 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cron-listener-65bc5f75bd" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:56:03 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 01:56:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000889a70 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/08/07 01:56:05 sinkpod name: el-cron-listener-65bc5f75bd-2jdgk
2024/08/07 01:56:05 Route url: 'http://el-cron-listener-releasetest-4k7fl.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "cron-listener"	 ...[PASS]
2024/08/07 01:56:10 Verify that image stream "golang" exists in namespace "openshift"
      * Verify that image stream "golang" exists	 ...[PASS]
2024/08/07 01:56:10 Cronjob: hello created in namespace: releasetest-4k7fl
      * Create cron job with schedule "*/1 * * * *"	 ...[PASS]
2024/08/07 01:57:00 pipeline run : simple-pipeline-run-5lxnd
2024/08/07 01:58:00 pipeline run : simple-pipeline-run-jll6l
2024/08/07 01:59:00 pipeline run : simple-pipeline-run-pkkzx
2024/08/07 02:00:00 pipeline run : simple-pipeline-run-gv8cn
2024/08/07 02:01:01 pipeline run : simple-pipeline-run-nk2wb
      * Watch for pipelinerun resources	 ...[PASS]
      * Delete cron job	 ...[PASS]
      * Assert no new pipelineruns created	 ...[PASS]
2024/08/07 02:02:10 Deleted EventListener
2024/08/07 02:02:15 EventListener's Deployment was deleted
2024/08/07 02:02:15 EventListener's Service was deleted
2024/08/07 02:02:15 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:02:30 output: project.project.openshift.io "releasetest-4k7fl" deleted

# Verify eventlisteners spec
  ## Create Eventlistener embedded TriggersBindings specs: PIPELINES-05-TC08	
2024/08/07 02:02:30 output: Now using project "releasetest-2mbp2" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:02:31 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/08/07 02:02:31 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/08/07 02:02:31 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/08/07 02:02:31 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/sample-pipeline.yaml                             |
         |2   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |3   |testdata/triggers/triggertemplate/triggertemplate.yaml             |
         |4   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/08/07 02:02:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:02:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:02:36 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:02:33 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:02:33 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:02:33 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-86498d8fc5" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:02:33 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:02:33 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0008805a0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/08/07 02:02:36 sinkpod name: el-listener-embed-binding-86498d8fc5-qpxmq
2024/08/07 02:02:36 Route url: 'http://el-listener-embed-binding-releasetest-2mbp2.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/08/07 02:02:41 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:02:42 validating pipeline run for success state...
2024/08/07 02:02:57 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-2mbp2
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name  |status    |check_label_propagation|
         |----|-------------------|----------|-----------------------|
         |1   |simple-pipeline-run|successful|no                     |	 ...[PASS]
2024/08/07 02:02:57 Deleted EventListener
2024/08/07 02:03:02 EventListener's Deployment was deleted
2024/08/07 02:03:02 EventListener's Service was deleted
2024/08/07 02:03:02 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:03:17 output: project.project.openshift.io "releasetest-2mbp2" deleted
  ## Create embedded TriggersTemplate: PIPELINES-05-TC09	
2024/08/07 02:03:17 output: Now using project "releasetest-cmwcq" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:03:17 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/08/07 02:03:17 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/08/07 02:03:17 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |2   |testdata/triggers/triggertemplate/embed-triggertemplate.yaml       |
         |3   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/08/07 02:03:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:03:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:03:22 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-embed-binding-86b8bc5d7f" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000e13230 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/08/07 02:03:27 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-embed-binding-86b8bc5d7f" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:17 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d32c30 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/08/07 02:03:32 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:28 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:28 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:28 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-86b8bc5d7f" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:28 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:03:28 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000e13680 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/08/07 02:03:32 sinkpod name: el-listener-embed-binding-86b8bc5d7f-ghqkr
2024/08/07 02:03:32 Route url: 'http://el-listener-embed-binding-releasetest-cmwcq.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/08/07 02:03:37 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:03:38 validating pipeline run for success state...
2024/08/07 02:03:43 pipelineRun: pipelinerun-with-taskspec-to-echo-message is successful under namespace : releasetest-cmwcq
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                        |status    |check_label_propagation|
         |----|-----------------------------------------|----------|-----------------------|
         |1   |pipelinerun-with-taskspec-to-echo-message|successful|no                     |	 ...[PASS]
2024/08/07 02:03:43 Deleted EventListener
2024/08/07 02:03:48 EventListener's Deployment was deleted
2024/08/07 02:03:48 EventListener's Service was deleted
2024/08/07 02:03:48 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:04:03 output: project.project.openshift.io "releasetest-cmwcq" deleted
  ## Verify Github push event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC12	
2024/08/07 02:04:03 output: Now using project "releasetest-hx6wq" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:04:03 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-push created
2024/08/07 02:04:03 output: eventlistener.triggers.tekton.dev/listener-ctb-github-push created
      * Create 
      
         |S.NO|resource_dir                                                      |
         |----|------------------------------------------------------------------|
         |1   |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-push.yaml|
         |2   |testdata/triggers/github-ctb/eventlistener-ctb-git-push.yaml      |	 ...[PASS]
2024/08/07 02:04:03 Verify SA "pipeline" is created in namespace "releasetest-hx6wq"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:04:03 output: secret/github-secret created
2024/08/07 02:04:03 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/08/07 02:04:03 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-777f6ff7d" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d567e0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/08/07 02:04:03 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-777f6ff7d" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d57230 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/08/07 02:04:08 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-777f6ff7d" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d576b0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/08/07 02:04:13 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-777f6ff7d" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0006b0930 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/08/07 02:04:18 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:14 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:14 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:14 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-ctb-github-push-777f6ff7d" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:14 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:14 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc00101ce40 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/08/07 02:04:18 sinkpod name: el-listener-ctb-github-push-777f6ff7d-d9qds
2024/08/07 02:04:19 Route url: 'http://el-listener-ctb-github-push-releasetest-hx6wq.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "listener-ctb-github-push"	 ...[PASS]
2024/08/07 02:04:24 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/triggers/github-ctb/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:04:24 validating pipeline run for success state...
2024/08/07 02:04:29 pipelineRun: pipelinerun-git-push-ctb is successful under namespace : releasetest-hx6wq
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status    |check_label_propagation|
         |----|------------------------|----------|-----------------------|
         |1   |pipelinerun-git-push-ctb|successful|no                     |	 ...[PASS]
2024/08/07 02:04:29 Deleted EventListener
2024/08/07 02:04:29 EventListener's Deployment was deleted
2024/08/07 02:04:29 EventListener's Service was deleted
2024/08/07 02:04:29 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:04:44 output: project.project.openshift.io "releasetest-hx6wq" deleted
  ## Verify Github pull_request event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC13	
2024/08/07 02:04:44 output: Now using project "releasetest-rflsv" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:04:44 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-pr created
2024/08/07 02:04:44 output: eventlistener.triggers.tekton.dev/listener-clustertriggerbinding-github-pr created
      * Create 
      
         |S.NO|resource_dir                                                    |
         |----|----------------------------------------------------------------|
         |1   |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-pr.yaml|
         |2   |testdata/triggers/github-ctb/eventlistener-ctb-git-pr.yaml      |	 ...[PASS]
2024/08/07 02:04:44 Verify SA "pipeline" is created in namespace "releasetest-rflsv"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:04:49 output: secret/github-secret created
2024/08/07 02:04:50 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/08/07 02:04:50 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:47 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:47 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:47 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-6d488774c6" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:47 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:04:47 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000e90e40 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/08/07 02:04:50 sinkpod name: el-listener-clustertriggerbinding-github-pr-6d488774c6-bkgtl
2024/08/07 02:04:50 Route url: 'http://el-listener-clustertriggerbinding-github-pr-releasetest-rflsv.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "listener-clustertriggerbinding-github-pr"	 ...[PASS]
2024/08/07 02:04:55 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/github-ctb/pr.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:04:55 validating pipeline run for success state...
2024/08/07 02:05:00 pipelineRun: pipelinerun-git-pr-ctb is successful under namespace : releasetest-rflsv
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name     |status    |check_label_propagation|
         |----|----------------------|----------|-----------------------|
         |1   |pipelinerun-git-pr-ctb|successful|no                     |	 ...[PASS]
2024/08/07 02:05:00 Deleted EventListener
2024/08/07 02:05:05 EventListener's Deployment was deleted
2024/08/07 02:05:05 EventListener's Service was deleted
2024/08/07 02:05:05 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:05:20 output: project.project.openshift.io "releasetest-rflsv" deleted
  ## Create TriggersCRD resource with CEL interceptors (overlays): PIPELINES-05-TC15	
2024/08/07 02:05:20 output: Now using project "releasetest-9scxh" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:05:21 output: eventlistener.triggers.tekton.dev/listener-triggerref created
2024/08/07 02:05:21 output: trigger.triggers.tekton.dev/trigger created
2024/08/07 02:05:21 output: triggerbinding.triggers.tekton.dev/github-pr-binding created
2024/08/07 02:05:21 output: triggertemplate.triggers.tekton.dev/github-template created
2024/08/07 02:05:21 output: pipeline.tekton.dev/parallel-pipeline created
task.tekton.dev/persist-param created
task.tekton.dev/to-upper created
task.tekton.dev/to-lower created
task.tekton.dev/result-reporter created
task.tekton.dev/validator created
      * Create 
      
         |S.NO|resource_dir                                               |
         |----|-----------------------------------------------------------|
         |1   |testdata/triggers/triggersCRD/eventlistener-triggerref.yaml|
         |2   |testdata/triggers/triggersCRD/trigger.yaml                 |
         |3   |testdata/triggers/triggersCRD/triggerbindings.yaml         |
         |4   |testdata/triggers/triggersCRD/triggertemplate.yaml         |
         |5   |testdata/triggers/triggersCRD/pipeline.yaml                |	 ...[PASS]
2024/08/07 02:05:21 Verify SA "pipeline" is created in namespace "releasetest-9scxh"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:05:21 output: secret/github-secret created
2024/08/07 02:05:21 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/08/07 02:05:21 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-7c8f6bb6bc" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d33290 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/08/07 02:05:21 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-7c8f6bb6bc" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:21 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000e1d530 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/08/07 02:05:26 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:23 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:23 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:23 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-triggerref-7c8f6bb6bc" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:23 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:05:23 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000e1d710 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/08/07 02:05:26 sinkpod name: el-listener-triggerref-7c8f6bb6bc-j8j7p
2024/08/07 02:05:27 Route url: 'http://el-listener-triggerref-releasetest-9scxh.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "listener-triggerref"	 ...[PASS]
2024/08/07 02:05:32 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/triggersCRD/pull-request.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:05:32 validating pipeline run for success state...
2024/08/07 02:06:12 pipelineRun: parallel-pipelinerun is successful under namespace : releasetest-9scxh
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name   |status    |check_label_propagation|
         |----|--------------------|----------|-----------------------|
         |1   |parallel-pipelinerun|successful|no                     |	 ...[PASS]
2024/08/07 02:06:12 Deleted EventListener
2024/08/07 02:06:17 EventListener's Deployment was deleted
2024/08/07 02:06:17 EventListener's Service was deleted
2024/08/07 02:06:17 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:06:32 output: project.project.openshift.io "releasetest-9scxh" deleted
  ## Create Eventlistener with github interceptor And verify Kuberenetes Events: PIPELINES-05-TC17	
2024/08/07 02:06:32 output: Now using project "releasetest-d6qqv" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:06:32 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/08/07 02:06:32 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/08/07 02:06:32 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/08/07 02:06:32 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/sample-pipeline.yaml                             |
         |2   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |3   |testdata/triggers/triggertemplate/triggertemplate.yaml             |
         |4   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/08/07 02:06:33 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:06:33 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:06:38 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:06:33 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:06:33 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:06:33 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-57f5c4d6b7" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:06:33 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:06:33 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc001009020 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/08/07 02:06:38 sinkpod name: el-listener-embed-binding-57f5c4d6b7-82vlf
2024/08/07 02:06:38 Route url: 'http://el-listener-embed-binding-releasetest-d6qqv.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/08/07 02:06:43 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
      * Verify kubernetes events for eventlistener	 ...[PASS]
2024/08/07 02:06:43 validating pipeline run for success state...
2024/08/07 02:06:58 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-d6qqv
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name  |status    |check_label_propagation|
         |----|-------------------|----------|-----------------------|
         |1   |simple-pipeline-run|successful|no                     |	 ...[PASS]
2024/08/07 02:06:58 Deleted EventListener
2024/08/07 02:07:03 EventListener's Deployment was deleted
2024/08/07 02:07:03 EventListener's Service was deleted
2024/08/07 02:07:03 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:07:18 output: project.project.openshift.io "releasetest-d6qqv" deleted

# Verify triggerbindings spec
  ## Verify CEL marshaljson function Test: PIPELINES-10-TC01	
2024/08/07 02:07:18 output: Now using project "releasetest-g2989" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:07:18 output: eventlistener.triggers.tekton.dev/cel-marshaljson created
      * Create 
      
         |S.NO|resource_dir                                          |
         |----|------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/cel-marshalJson.yaml|	 ...[PASS]
2024/08/07 02:07:18 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:07:18 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:07:23 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:20 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:20 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:20 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cel-marshaljson-676d8d9c94" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:20 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:20 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000992a50 Addresses:[]} Configuration:{GeneratedResourceName:el-cel-marshaljson}}
2024/08/07 02:07:23 sinkpod name: el-cel-marshaljson-676d8d9c94-rkzqr
2024/08/07 02:07:24 Route url: 'http://el-cel-marshaljson-releasetest-g2989.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "cel-marshaljson"	 ...[PASS]
2024/08/07 02:07:29 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:07:29 Waiting for TaskRun cel-trig-marshaljson in namespace releasetest-g2989 to succeed
      * Verify taskrun 
      
         |S.NO|task_run_name       |status |
         |----|--------------------|-------|
         |1   |cel-trig-marshaljson|Success|	 ...[PASS]
2024/08/07 02:07:34 Deleted EventListener
2024/08/07 02:07:34 EventListener's Deployment was deleted
2024/08/07 02:07:34 EventListener's Service was deleted
2024/08/07 02:07:34 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:07:49 output: project.project.openshift.io "releasetest-g2989" deleted
  ## Verify event message body parsing with old annotation Test: PIPELINES-10-TC02	
2024/08/07 02:07:49 output: Now using project "releasetest-kjg6s" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:07:49 output: triggertemplate.triggers.tekton.dev/taskrun-with-annotation created
eventlistener.triggers.tekton.dev/parse-json-body-with-annotation created
      * Create 
      
         |S.NO|resource_dir                                                          |
         |----|----------------------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/parse-json-body-with-annotation.yaml|	 ...[PASS]
2024/08/07 02:07:49 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:07:49 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:07:54 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:52 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:52 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:52 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-parse-json-body-with-annotation-59ddc755d9" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:52 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:07:52 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d32c60 Addresses:[]} Configuration:{GeneratedResourceName:el-parse-json-body-with-annotation}}
2024/08/07 02:07:55 sinkpod name: el-parse-json-body-with-annotation-59ddc755d9-c8wx5
2024/08/07 02:07:55 Route url: 'http://el-parse-json-body-with-annotation-releasetest-kjg6s.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "parse-json-body-with-annotation"	 ...[PASS]
2024/08/07 02:08:00 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:08:00 Waiting for TaskRun trig-parse-json-body-with-annotation in namespace releasetest-kjg6s to succeed
      * Verify taskrun 
      
         |S.NO|task_run_name                       |status |
         |----|------------------------------------|-------|
         |1   |trig-parse-json-body-with-annotation|Success|	 ...[PASS]
2024/08/07 02:08:05 Deleted EventListener
2024/08/07 02:08:10 EventListener's Deployment was deleted
2024/08/07 02:08:10 EventListener's Service was deleted
2024/08/07 02:08:10 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/08/07 02:08:25 output: project.project.openshift.io "releasetest-kjg6s" deleted

# Verify triggers tutorial
  ## Run pipelines tutorial using triggers: PIPELINES-06-TC02	
2024/08/07 02:08:25 output: Now using project "releasetest-l6sph" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:08:25 Verify SA "pipeline" is created in namespace "releasetest-l6sph"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:08:31 output: task.tekton.dev/apply-manifests created
2024/08/07 02:08:31 output: task.tekton.dev/update-deployment created
2024/08/07 02:08:31 output: persistentvolumeclaim/source-pvc created
2024/08/07 02:08:31 output: pipeline.tekton.dev/build-and-deploy created
2024/08/07 02:08:31 output: triggerbinding.triggers.tekton.dev/vote-app created
2024/08/07 02:08:32 output: triggertemplate.triggers.tekton.dev/vote-app created
2024/08/07 02:08:32 output: trigger.triggers.tekton.dev/vote-trigger created
secret/github-secret created
2024/08/07 02:08:32 output: eventlistener.triggers.tekton.dev/vote-app created
      * Create remote 
      
         |S.NO|resource_dir                                                                                                                    |
         |----|--------------------------------------------------------------------------------------------------------------------------------|
         |1   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/01_apply_manifest_task.yaml    |
         |2   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/02_update_deployment_task.yaml |
         |3   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/03_persistent_volume_claim.yaml|
         |4   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/04_pipeline.yaml               |
         |5   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/01_binding.yaml                |
         |6   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/02_template.yaml               |
         |7   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/03_trigger.yaml                |
         |8   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/04_event_listener.yaml         |	 ...[PASS]
2024/08/07 02:08:32 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:08:32 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/08/07 02:08:37 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:08:34 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:08:34 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:08:34 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-vote-app-67d8fd47b5" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:08:34 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-08-07 02:08:34 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000e13d70 Addresses:[]} Configuration:{GeneratedResourceName:el-vote-app}}
2024/08/07 02:08:37 sinkpod name: el-vote-app-67d8fd47b5-mbd4r
2024/08/07 02:08:37 Route url: 'http://el-vote-app-releasetest-l6sph.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Expose Event listener "vote-app"	 ...[PASS]
2024/08/07 02:08:42 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push-vote-api.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:08:43 validating pipeline run for success state...
2024/08/07 02:10:23 pipelineRun: build-deploy-pipelines-vote-api-hfzqj is successful under namespace : releasetest-l6sph
      * Verify the latest pipelinerun for "successful" state	 ...[PASS]
2024/08/07 02:10:23 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push-vote-ui.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/08/07 02:10:23 validating pipeline run for success state...
2024/08/07 02:11:43 pipelineRun: build-deploy-pipelines-vote-ui-4gq2w is successful under namespace : releasetest-l6sph
      * Verify the latest pipelinerun for "successful" state	 ...[PASS]
2024/08/07 02:11:43 Route url: 'http://pipelines-vote-ui-releasetest-l6sph.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org'
      * Get route url of the route "pipelines-vote-ui"	 ...[PASS]
      * Wait for pipelines-vote-ui deployment	 ...[PASS]
      * Validate route url for pipelines tutorial	 ...[FAIL]
        
        Failed Step: Validate route url for pipelines tutorial
        Specification: specs/triggers/tutorial.spec:73
        Error Message: [assertion failed: 
        Command:  lynx http://pipelines-vote-ui-releasetest-l6sph.apps.ci-rosa-s-pl1j.vq11.s1.devshift.org --dump
        ExitCode: 0 (timeout)
        Stdout:   
        Stderr:   
        
        Failures:
        Expected command to finish, but it hit the timeout]
        Stacktrace: 
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/testing.go:46
        github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...)
        	/tmp/release-tests/pkg/cmd/cmd.go:34
        gotest.tools/v3/internal/assert.RunComparison({0x7f52d0dc2818, 0x524d3e0}, 0x38a4408, 0xc000b09310, {0x0, 0x0, 0x0})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/internal/assert/result.go:60 +0x205
        gotest.tools/v3/internal/assert.Eval({0x7f52d0dc2818, 0x524d3e0}, 0x38a4408, {0x32ad080, 0xc000b09310}, {0x0, 0x0, 0x0})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/internal/assert/assert.go:56 +0x13d
        gotest.tools/v3/assert.Assert({0x3b3d4f8, 0x524d3e0}, {0x32ad080, 0xc000b09310}, {0x0, 0x0, 0x0})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/assert/assert.go:145 +0xce
        gotest.tools/v3/icmd.(*Result).Assert(0xc00088e880, {0x3b3d4f8, 0x524d3e0}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/icmd/command.go:62 +0x145
        github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000f02ae0, 0x3, ...})
        	/tmp/release-tests/pkg/cmd/cmd.go:50 +0x105
        github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...)
        	/tmp/release-tests/pkg/cmd/cmd.go:43
        github.com/openshift-pipelines/release-tests/steps/utility.init.func4()
        	/tmp/release-tests/steps/utility/utility.go:48 +0x11a
        reflect.Value.call({0x3132500?, 0x38a3f88?, 0x1c0?}, {0x37378cb, 0x4}, {0x524d3e0, 0x0, 0xc001049a40?})
        	/usr/lib/golang/src/reflect/value.go:596 +0xca6
        reflect.Value.Call({0x3132500?, 0x38a3f88?, 0xc0007f7be0?}, {0x524d3e0?, 0xc0007f7c48?, 0x17ca14b?})
        	/usr/lib/golang/src/reflect/value.go:380 +0xb9
        github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x3132500?, 0x38a3f88?, 0x26?}, {0x0, 0x0, 0x5d?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/funcExecutor.go:47 +0x235
        github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc00068fe00?, {0x0?, 0x29?, 0x5f?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/step.go:17 +0x8c
        github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x336a6a0?, 0xc0001f8d20, 0xc000000007?)
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/messageprocessors/ExecuteStepProcessor.go:20 +0xa6
        github.com/getgauge-contrib/gauge-go/gauge.Run()
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/gauge/runner.go:219 +0x227
        command-line-arguments.init.0()
        	/tmp/gauge_temp1722995750992891720/gauge_test.go:32 +0xf
        
2024/08/07 02:12:08 Skipping deletion of the namespace 'releasetest-l6sph' as the test got failed

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_02.12.08/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 02.12.08

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	974.270s
Runner with PID:26548 has exited
Specifications:	4 executed	3 passed	1 failed	0 skipped
Scenarios:	10 executed	9 passed	1 failed	0 skipped

Total time taken: 16m14.192s
gauge run specs/metrics/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/metrics/metrics.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 38925
Successfully made the connection with plugin with port: 38925
Starting Xml Report plugin
Attempting to connect to grpc server at port: 43739
Successfully made the connection with plugin with port: 43739
Initialising suite data store.
# Verify openshift pipelines monitoring
  ## Openshift pipelines metrics acceptance tests: PIPELINES-01-TC01	
2024/08/07 02:12:12 output: Now using project "releasetest-xdrtf" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 02:12:12 Waiting for operator to be up and running....
2024/08/07 02:12:12 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:12:12 Target Job: [node-exporter] ready/up status, Actual: [1], Expected: [1]
2024/08/07 02:12:12 Target Job: [kube-state-metrics] ready/up status, Actual: [1], Expected: [1]
2024/08/07 02:12:12 Target Job: [prometheus-k8s] ready/up status, Actual: [1], Expected: [1]
2024/08/07 02:12:12 Target Job: [prometheus-operator] ready/up status, Actual: [1], Expected: [1]
2024/08/07 02:12:13 Target Job: [alertmanager-main] ready/up status, Actual: [1], Expected: [1]
2024/08/07 02:12:13 Target Job: [tekton-pipelines-controller] ready/up status, Actual: [1], Expected: [1]
      * Verify job health status metrics 
      
         |S.NO|Job_name                   |Expected_value|
         |----|---------------------------|--------------|
         |1   |node-exporter              |1             |
         |2   |kube-state-metrics         |1             |
         |3   |prometheus-k8s             |1             |
         |4   |prometheus-operator        |1             |
         |5   |alertmanager-main          |1             |
         |6   |tekton-pipelines-controller|1             |	 ...[PASS]
      * Verify pipelines controlPlane metrics	 ...[PASS]
2024/08/07 02:12:20 output: project.project.openshift.io "releasetest-xdrtf" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_02.12.20/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 02.12.20

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	8.884s
Runner with PID:29004 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	1 executed	1 passed	0 failed	0 skipped

Total time taken: 8.822s
gauge run specs/operator/addon.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/operator/addon.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 33345
Successfully made the connection with plugin with port: 33345
Starting Xml Report plugin
Attempting to connect to grpc server at port: 44031
Successfully made the connection with plugin with port: 44031
Initialising suite data store.
# Verify Addon E2E spec
  ## Disable/Enable community clustertasks: PIPELINES-15-TC01	
2024/08/07 02:12:24 output: Now using project "releasetest-6qwgr" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 02:12:24 Waiting for operator to be up and running....
2024/08/07 02:12:24 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:12:24 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:12:24 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/08/07 02:12:29 Verifying if the clustertask jib-maven is present
2024/08/07 02:12:29 Clustertask jib-maven is present
2024/08/07 02:12:34 Verifying if the clustertask helm-upgrade-from-source is present
2024/08/07 02:12:34 Clustertask helm-upgrade-from-source is present
2024/08/07 02:12:39 Verifying if the clustertask helm-upgrade-from-repo is present
2024/08/07 02:12:39 Clustertask helm-upgrade-from-repo is present
2024/08/07 02:12:44 Verifying if the clustertask trigger-jenkins-job is present
2024/08/07 02:12:44 Clustertask trigger-jenkins-job is present
2024/08/07 02:12:50 Verifying if the clustertask git-cli is present
2024/08/07 02:12:50 Clustertask git-cli is present
2024/08/07 02:12:55 Verifying if the clustertask pull-request is present
2024/08/07 02:12:55 Clustertask pull-request is present
2024/08/07 02:13:00 Verifying if the clustertask kubeconfig-creator is present
2024/08/07 02:13:00 Clustertask kubeconfig-creator is present
2024/08/07 02:13:05 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/08/07 02:13:05 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/08/07 02:13:05 Checking if clustertasks tkn,openshift-client is/are present
2024/08/07 02:13:10 Verifying if the clustertask tkn is present
2024/08/07 02:13:10 Clustertask tkn is present
2024/08/07 02:13:15 Verifying if the clustertask openshift-client is present
2024/08/07 02:13:15 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/08/07 02:13:15 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "false" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:13:15 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are not present
2024/08/07 02:13:20 Verifying if the clustertask jib-maven is not present
2024/08/07 02:13:20 Clustertask jib-maven is not present
2024/08/07 02:13:25 Verifying if the clustertask helm-upgrade-from-source is not present
2024/08/07 02:13:25 Clustertask helm-upgrade-from-source is not present
2024/08/07 02:13:30 Verifying if the clustertask helm-upgrade-from-repo is not present
2024/08/07 02:13:30 Clustertask helm-upgrade-from-repo is not present
2024/08/07 02:13:35 Verifying if the clustertask trigger-jenkins-job is not present
2024/08/07 02:13:35 Clustertask trigger-jenkins-job is not present
2024/08/07 02:13:40 Verifying if the clustertask git-cli is not present
2024/08/07 02:13:40 Clustertask git-cli is not present
2024/08/07 02:13:45 Verifying if the clustertask pull-request is not present
2024/08/07 02:13:45 Clustertask pull-request is not present
2024/08/07 02:13:50 Verifying if the clustertask kubeconfig-creator is not present
2024/08/07 02:13:50 Clustertask kubeconfig-creator is not present
2024/08/07 02:13:55 Verifying if the clustertask argocd-task-sync-and-wait is not present
2024/08/07 02:13:55 Clustertask argocd-task-sync-and-wait is not present
      * "community" clustertasks are "not present"	 ...[PASS]
2024/08/07 02:13:55 Checking if clustertasks tkn,openshift-client is/are present
2024/08/07 02:14:00 Verifying if the clustertask tkn is present
2024/08/07 02:14:00 Clustertask tkn is present
2024/08/07 02:14:05 Verifying if the clustertask openshift-client is present
2024/08/07 02:14:05 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/08/07 02:14:05 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:14:05 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/08/07 02:14:10 Verifying if the clustertask jib-maven is present
2024/08/07 02:14:10 Clustertask jib-maven is present
2024/08/07 02:14:15 Verifying if the clustertask helm-upgrade-from-source is present
2024/08/07 02:14:15 Clustertask helm-upgrade-from-source is present
2024/08/07 02:14:20 Verifying if the clustertask helm-upgrade-from-repo is present
2024/08/07 02:14:20 Clustertask helm-upgrade-from-repo is present
2024/08/07 02:14:25 Verifying if the clustertask trigger-jenkins-job is present
2024/08/07 02:14:25 Clustertask trigger-jenkins-job is present
2024/08/07 02:14:30 Verifying if the clustertask git-cli is present
2024/08/07 02:14:30 Clustertask git-cli is present
2024/08/07 02:14:35 Verifying if the clustertask pull-request is present
2024/08/07 02:14:35 Clustertask pull-request is present
2024/08/07 02:14:40 Verifying if the clustertask kubeconfig-creator is present
2024/08/07 02:14:40 Clustertask kubeconfig-creator is present
2024/08/07 02:14:45 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/08/07 02:14:45 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/08/07 02:14:45 Checking if clustertasks tkn,openshift-client is/are present
2024/08/07 02:14:50 Verifying if the clustertask tkn is present
2024/08/07 02:14:50 Clustertask tkn is present
2024/08/07 02:14:55 Verifying if the clustertask openshift-client is present
2024/08/07 02:14:55 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/08/07 02:15:02 output: project.project.openshift.io "releasetest-6qwgr" deleted
  ## Disable/Enable clustertasks: PIPELINES-15-TC02	
2024/08/07 02:15:03 output: Now using project "releasetest-5nhnb" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:15:03 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:15:03 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/08/07 02:15:08 Verifying if the clustertask jib-maven is present
2024/08/07 02:15:08 Clustertask jib-maven is present
2024/08/07 02:15:13 Verifying if the clustertask helm-upgrade-from-source is present
2024/08/07 02:15:13 Clustertask helm-upgrade-from-source is present
2024/08/07 02:15:18 Verifying if the clustertask helm-upgrade-from-repo is present
2024/08/07 02:15:18 Clustertask helm-upgrade-from-repo is present
2024/08/07 02:15:23 Verifying if the clustertask trigger-jenkins-job is present
2024/08/07 02:15:23 Clustertask trigger-jenkins-job is present
2024/08/07 02:15:28 Verifying if the clustertask git-cli is present
2024/08/07 02:15:28 Clustertask git-cli is present
2024/08/07 02:15:33 Verifying if the clustertask pull-request is present
2024/08/07 02:15:33 Clustertask pull-request is present
2024/08/07 02:15:38 Verifying if the clustertask kubeconfig-creator is present
2024/08/07 02:15:38 Clustertask kubeconfig-creator is present
2024/08/07 02:15:43 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/08/07 02:15:43 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/08/07 02:15:43 Checking if clustertasks tkn,openshift-client is/are present
2024/08/07 02:15:48 Verifying if the clustertask tkn is present
2024/08/07 02:15:48 Clustertask tkn is present
2024/08/07 02:15:53 Verifying if the clustertask openshift-client is present
2024/08/07 02:15:53 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/08/07 02:15:58 Verifying that 27 pipelines are present in namespace openshift
2024/08/07 02:15:58 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/08/07 02:15:58 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "false" communityClustertasks as "false" and pipelineTemplates as "false" and expect message ""	 ...[PASS]
2024/08/07 02:15:58 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are not present
2024/08/07 02:16:03 Verifying if the clustertask jib-maven is not present
2024/08/07 02:16:03 Clustertask jib-maven is not present
2024/08/07 02:16:08 Verifying if the clustertask helm-upgrade-from-source is not present
2024/08/07 02:16:08 Clustertask helm-upgrade-from-source is not present
2024/08/07 02:16:13 Verifying if the clustertask helm-upgrade-from-repo is not present
2024/08/07 02:16:13 Clustertask helm-upgrade-from-repo is not present
2024/08/07 02:16:18 Verifying if the clustertask trigger-jenkins-job is not present
2024/08/07 02:16:18 Clustertask trigger-jenkins-job is not present
2024/08/07 02:16:23 Verifying if the clustertask git-cli is not present
2024/08/07 02:16:23 Clustertask git-cli is not present
2024/08/07 02:16:28 Verifying if the clustertask pull-request is not present
2024/08/07 02:16:28 Clustertask pull-request is not present
2024/08/07 02:16:33 Verifying if the clustertask kubeconfig-creator is not present
2024/08/07 02:16:33 Clustertask kubeconfig-creator is not present
2024/08/07 02:16:38 Verifying if the clustertask argocd-task-sync-and-wait is not present
2024/08/07 02:16:38 Clustertask argocd-task-sync-and-wait is not present
      * "community" clustertasks are "not present"	 ...[PASS]
2024/08/07 02:16:38 Checking if clustertasks tkn,openshift-client is/are not present
2024/08/07 02:16:43 Verifying if the clustertask tkn is not present
2024/08/07 02:16:43 Clustertask tkn is not present
2024/08/07 02:16:48 Verifying if the clustertask openshift-client is not present
2024/08/07 02:16:48 Clustertask openshift-client is not present
      * "tkn,openshift-client" clustertasks are "not present"	 ...[PASS]
2024/08/07 02:16:53 Verifying if 0 pipelines are not present in namespace openshift
2024/08/07 02:16:53 Pipelines are present in namespace openshift
      * Assert pipelines are "not present" in "openshift" namespace	 ...[PASS]
2024/08/07 02:16:53 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:16:53 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/08/07 02:16:58 Verifying if the clustertask jib-maven is present
2024/08/07 02:16:58 Clustertask jib-maven is present
2024/08/07 02:17:03 Verifying if the clustertask helm-upgrade-from-source is present
2024/08/07 02:17:03 Clustertask helm-upgrade-from-source is present
2024/08/07 02:17:08 Verifying if the clustertask helm-upgrade-from-repo is present
2024/08/07 02:17:08 Clustertask helm-upgrade-from-repo is present
2024/08/07 02:17:13 Verifying if the clustertask trigger-jenkins-job is present
2024/08/07 02:17:13 Clustertask trigger-jenkins-job is present
2024/08/07 02:17:18 Verifying if the clustertask git-cli is present
2024/08/07 02:17:18 Clustertask git-cli is present
2024/08/07 02:17:23 Verifying if the clustertask pull-request is present
2024/08/07 02:17:23 Clustertask pull-request is present
2024/08/07 02:17:28 Verifying if the clustertask kubeconfig-creator is present
2024/08/07 02:17:28 Clustertask kubeconfig-creator is present
2024/08/07 02:17:33 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/08/07 02:17:33 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/08/07 02:17:33 Checking if clustertasks tkn,openshift-client is/are present
2024/08/07 02:17:38 Verifying if the clustertask tkn is present
2024/08/07 02:17:38 Clustertask tkn is present
2024/08/07 02:17:43 Verifying if the clustertask openshift-client is present
2024/08/07 02:17:43 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/08/07 02:17:48 Verifying that 27 pipelines are present in namespace openshift
2024/08/07 02:17:48 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/08/07 02:17:56 output: project.project.openshift.io "releasetest-5nhnb" deleted
  ## Disable/Enable pipeline templates: PIPELINES-15-TC03	
2024/08/07 02:17:56 output: Now using project "releasetest-cj48v" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:17:56 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:18:01 Verifying that 27 pipelines are present in namespace openshift
2024/08/07 02:18:01 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/08/07 02:18:01 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "false" and expect message ""	 ...[PASS]
2024/08/07 02:18:06 Verifying if 0 pipelines are not present in namespace openshift
2024/08/07 02:18:06 Pipelines are present in namespace openshift
      * Assert pipelines are "not present" in "openshift" namespace	 ...[PASS]
2024/08/07 02:18:07 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/08/07 02:18:12 Verifying that 27 pipelines are present in namespace openshift
2024/08/07 02:18:12 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/08/07 02:18:19 output: project.project.openshift.io "releasetest-cj48v" deleted

Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 02.18.19

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_02.18.19/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	355.253s
Runner with PID:29562 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	3 executed	3 passed	0 failed	0 skipped

Total time taken: 5m55.183s
gauge run specs/operator/auto-prune.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin xml-report is already installed.
Plugin go is already installed.
Plugin html-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/operator/auto-prune.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 36011
Successfully made the connection with plugin with port: 36011
Starting Xml Report plugin
Attempting to connect to grpc server at port: 41709
Successfully made the connection with plugin with port: 41709
Initialising suite data store.
# Verify auto-prune E2E
2024/08/07 02:18:23 output: Now using project "releasetest-69qn5" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 02:18:23 Annotating the namespaces with 'operator.tekton.dev/prune.skip=true' so that the pipelineruns should not get deleted
2024/08/07 02:18:23 output: namespace/dedicated-admin annotated
2024/08/07 02:18:23 output: namespace/openshift annotated
2024/08/07 02:18:23 output: namespace/releasetest-69qn5 annotated
2024/08/07 02:18:24 output: namespace/releasetest-l6sph annotated
  ## Verify auto prune for taskrun: PIPELINES-12-TC01	
2024/08/07 02:18:24 output: Now using project "releasetest-n8s2n" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 02:18:24 Waiting for operator to be up and running....
2024/08/07 02:18:24 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/08/07 02:18:24 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/08/07 02:18:29 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:18:29 Verify SA "pipeline" is created in namespace "releasetest-n8s2n"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:18:29 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:18:29 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/08/07 02:18:29 output: pipelinerun.tekton.dev/echo-pipeline-run-72mzf created
pipelinerun.tekton.dev/echo-pipeline-run-5vwp7 created
pipelinerun.tekton.dev/echo-pipeline-run-7xp8s created
pipelinerun.tekton.dev/echo-pipeline-run-fcb5k created
pipelinerun.tekton.dev/echo-pipeline-run-jkv7p created
2024/08/07 02:18:29 output: task.tekton.dev/echo-task created
2024/08/07 02:18:30 output: taskrun.tekton.dev/echo-task-run-zh9cx created
taskrun.tekton.dev/echo-task-run-d2jbv created
taskrun.tekton.dev/echo-task-run-btqsh created
taskrun.tekton.dev/echo-task-run-dbqmn created
taskrun.tekton.dev/echo-task-run-mvj9g created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/08/07 02:18:30 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "*/1 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/08/07 02:18:30 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:18:35 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:18:35 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/08/07 02:18:35 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:19:30 Verifying if 5 number of pipelinerun are present
      * "5" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:19:35 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:19:35 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/08/07 02:19:40 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:19:40 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/08/07 02:19:55 output: project.project.openshift.io "releasetest-n8s2n" deleted
  ## Verify auto prune with keep-since: PIPELINES-12-TC04	
2024/08/07 02:19:55 output: Now using project "releasetest-z4865" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:19:55 Verify SA "pipeline" is created in namespace "releasetest-z4865"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:20:00 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:20:00 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/08/07 02:20:01 output: pipelinerun.tekton.dev/echo-pipeline-run-c9x6b created
pipelinerun.tekton.dev/echo-pipeline-run-5hcg6 created
pipelinerun.tekton.dev/echo-pipeline-run-hww5c created
pipelinerun.tekton.dev/echo-pipeline-run-8xwkp created
pipelinerun.tekton.dev/echo-pipeline-run-nbhr5 created
2024/08/07 02:20:01 output: task.tekton.dev/echo-task created
2024/08/07 02:20:01 output: taskrun.tekton.dev/echo-task-run-vtg4g created
taskrun.tekton.dev/echo-task-run-ts2kx created
taskrun.tekton.dev/echo-task-run-59mjv created
taskrun.tekton.dev/echo-task-run-5b5xv created
taskrun.tekton.dev/echo-task-run-j76lw created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/08/07 02:20:01 Sleeping for 120 seconds
      * Sleep for "120" seconds	 ...[PASS]
2024/08/07 02:22:01 output: pipelinerun.tekton.dev/echo-pipeline-run-pthdb created
pipelinerun.tekton.dev/echo-pipeline-run-48qrq created
pipelinerun.tekton.dev/echo-pipeline-run-w2v9b created
pipelinerun.tekton.dev/echo-pipeline-run-f9tkk created
pipelinerun.tekton.dev/echo-pipeline-run-825nq created
2024/08/07 02:22:01 output: taskrun.tekton.dev/echo-task-run-jpnct created
taskrun.tekton.dev/echo-task-run-v6v5h created
taskrun.tekton.dev/echo-task-run-kt9r9 created
taskrun.tekton.dev/echo-task-run-sxjl5 created
taskrun.tekton.dev/echo-task-run-rh24t created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |2   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/08/07 02:22:01 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "without" keep "" schedule "*/1 * * * *" resources "pipelinerun,taskrun" and "with" keep-since "2"	 ...[PASS]
2024/08/07 02:22:01 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:22:06 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:22:06 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/08/07 02:22:06 Verifying if 5 number of pipelinerun are present
      * "5" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:23:01 Verifying if 10 number of taskruns are present
      * "10" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:23:06 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:23:07 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/08/07 02:23:12 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:23:12 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/08/07 02:23:27 output: project.project.openshift.io "releasetest-z4865" deleted
  ## Verify auto prune add resources taskrun and pipelinerun per namespace with annotation: PIPELINES-12-TC07	
2024/08/07 02:23:27 output: Now using project "releasetest-5ndbd" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:23:27 Verify SA "pipeline" is created in namespace "releasetest-5ndbd"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:23:32 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:23:32 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/08/07 02:23:32 output: pipelinerun.tekton.dev/echo-pipeline-run-j5ftc created
pipelinerun.tekton.dev/echo-pipeline-run-b9rph created
pipelinerun.tekton.dev/echo-pipeline-run-frqpl created
pipelinerun.tekton.dev/echo-pipeline-run-4dz8g created
pipelinerun.tekton.dev/echo-pipeline-run-wznx5 created
2024/08/07 02:23:32 output: task.tekton.dev/echo-task created
2024/08/07 02:23:32 output: taskrun.tekton.dev/echo-task-run-5lhqb created
taskrun.tekton.dev/echo-task-run-mc57v created
taskrun.tekton.dev/echo-task-run-5phx7 created
taskrun.tekton.dev/echo-task-run-kxql5 created
taskrun.tekton.dev/echo-task-run-f4czs created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/08/07 02:23:32 Annotating namespace releasetest-5ndbd with operator.tekton.dev/prune.resources=pipelinerun,taskrun
2024/08/07 02:23:33 output: namespace/releasetest-5ndbd annotated
      * Annotate namespace with "operator.tekton.dev/prune.resources=pipelinerun,taskrun"	 ...[PASS]
2024/08/07 02:23:33 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "*/1 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/08/07 02:23:33 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:23:38 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:23:38 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/08/07 02:23:38 Verifying if 2 number of pipelinerun are present
      * "2" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:24:03 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:24:08 Removing annotation releasetest-5ndbd from namespace operator.tekton.dev/prune.resources
2024/08/07 02:24:08 output: namespace/releasetest-5ndbd annotated
      * Remove annotation "operator.tekton.dev/prune.resources" from namespace	 ...[PASS]
2024/08/07 02:24:08 output: pipelinerun.tekton.dev/echo-pipeline-run-6txf9 created
pipelinerun.tekton.dev/echo-pipeline-run-9gkvn created
pipelinerun.tekton.dev/echo-pipeline-run-v52zc created
pipelinerun.tekton.dev/echo-pipeline-run-c5fbr created
pipelinerun.tekton.dev/echo-pipeline-run-nhvrx created
2024/08/07 02:24:08 output: taskrun.tekton.dev/echo-task-run-gsxqt created
taskrun.tekton.dev/echo-task-run-dp68z created
taskrun.tekton.dev/echo-task-run-mggw4 created
taskrun.tekton.dev/echo-task-run-gg2wz created
taskrun.tekton.dev/echo-task-run-wr5cv created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |2   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/08/07 02:24:08 Verifying if 7 number of pipelinerun are present
      * "7" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:24:13 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/08/07 02:25:03 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:25:03 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/08/07 02:25:08 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:25:08 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/08/07 02:25:23 output: project.project.openshift.io "releasetest-5ndbd" deleted
  ## Verify auto prune cronjob contains single container: PIPELINES-12-TC14	
2024/08/07 02:25:24 output: Now using project "releasetest-p4fxw" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:25:24 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "20 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/08/07 02:25:24 Check if project test-project-1 already exists
2024/08/07 02:25:24 Creating project test-project-1
2024/08/07 02:25:24 output: Now using project "test-project-1" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "test-project-1"	 ...[PASS]
2024/08/07 02:25:24 Check if project test-project-2 already exists
2024/08/07 02:25:24 Creating project test-project-2
2024/08/07 02:25:24 output: Now using project "test-project-2" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "test-project-2"	 ...[PASS]
2024/08/07 02:25:24 Sleeping for 10 seconds
      * Sleep for "10" seconds	 ...[PASS]
2024/08/07 02:25:34 Verifying if the cronjob with prefix tekton-resource-pruner in namespace openshift-pipelines contains 1 number of containers
2024/08/07 02:25:34 1 containers found in the cronjob spec
      * Assert pruner cronjob(s) in namespace "target namespace" contains "1" number of container(s)	 ...[PASS]
2024/08/07 02:25:34 Deleting project test-project-1
2024/08/07 02:25:42 output: project.project.openshift.io "test-project-1" deleted
      * Delete project "test-project-1"	 ...[PASS]
2024/08/07 02:25:42 Deleting project test-project-2
2024/08/07 02:25:50 output: project.project.openshift.io "test-project-2" deleted
      * Delete project "test-project-2"	 ...[PASS]
2024/08/07 02:25:50 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:25:58 output: project.project.openshift.io "releasetest-p4fxw" deleted
  ## Verify that the operator is up and running after deleting namespace with pruner annotation: PIPELINES-12-TC15	
2024/08/07 02:25:58 output: Now using project "releasetest-d8nl9" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:25:58 Verify SA "pipeline" is created in namespace "releasetest-d8nl9"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/08/07 02:26:03 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/08/07 02:26:03 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/08/07 02:26:08 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:08 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/08/07 02:26:08 output: namespace/namespace-one created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pruner/namespaces/namespace-one.yaml|	 ...[PASS]
2024/08/07 02:26:08 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:13 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:13 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/08/07 02:26:13 Deleting project namespace-one
2024/08/07 02:26:20 output: project.project.openshift.io "namespace-one" deleted
      * Delete project "namespace-one"	 ...[PASS]
2024/08/07 02:26:20 Sleeping for 5 seconds
      * Sleep for "5" seconds	 ...[PASS]
2024/08/07 02:26:25 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/08/07 02:26:30 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:30 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:26:31 output: namespace/namespace-two created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pruner/namespaces/namespace-two.yaml|	 ...[PASS]
2024/08/07 02:26:31 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:36 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:36 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/08/07 02:26:36 Deleting project namespace-two
2024/08/07 02:26:43 output: project.project.openshift.io "namespace-two" deleted
      * Delete project "namespace-two"	 ...[PASS]
2024/08/07 02:26:43 Sleeping for 5 seconds
      * Sleep for "5" seconds	 ...[PASS]
2024/08/07 02:26:48 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/08/07 02:26:53 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/08/07 02:26:53 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/08/07 02:27:00 output: project.project.openshift.io "releasetest-d8nl9" deleted
2024/08/07 02:27:01 output: tektonconfig.operator.tekton.dev/config patched

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_02.27.01/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 02.27.01

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	517.847s
Runner with PID:30376 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	5 executed	5 passed	0 failed	0 skipped

Total time taken: 8m37.773s
gauge run specs/operator/rbac.spec
log-level : [debug]
tags : [sanity]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity
The following specifications satisfy filter criteria:
specs/operator/rbac.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 36833
Successfully made the connection with plugin with port: 36833
Starting Xml Report plugin
Attempting to connect to grpc server at port: 38041
Successfully made the connection with plugin with port: 38041
Initialising suite data store.
# Verify RBAC Resources
  ## Disable RBAC resource creation: PIPELINES-11-TC01	
2024/08/07 02:27:04 output: Now using project "releasetest-ss5md" on server "https://api.ci-rosa-s-pl1j.vq11.s1.devshift.org:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/08/07 02:27:04 Waiting for operator to be up and running....
2024/08/07 02:27:04 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/08/07 02:27:04 enable auto creation of RBAC resources
2024/08/07 02:27:05 output: tektonconfig.operator.tekton.dev/config patched (no change)
      * Update TektonConfig CR to use param with name createRbacResource and value "true" to "enable" auto creation of RBAC resources	 ...[PASS]
2024/08/07 02:27:05 Verifying that TektonConfig status is "installed"
2024/08/07 02:27:10 Verifying that service account pipeline exists
2024/08/07 02:27:15 Verifying that cluster role pipelines-scc-clusterrole exists
2024/08/07 02:27:20 Verifying that config map config-service-cabundle exists
2024/08/07 02:27:25 Verifying that config map config-trusted-cabundle exists
2024/08/07 02:27:30 Verifying that role binding openshift-pipelines-edit exists
2024/08/07 02:27:35 Verifying that role binding pipelines-scc-rolebinding exists
2024/08/07 02:27:40 Verifying that security context constraint pipelines-scc exists
      * Verify RBAC resources are auto created successfully	 ...[PASS]
2024/08/07 02:27:40 disable auto creation of RBAC resources
2024/08/07 02:27:40 output: tektonconfig.operator.tekton.dev/config patched
      * Update TektonConfig CR to use param with name createRbacResource and value "false" to "disable" auto creation of RBAC resources	 ...[PASS]
2024/08/07 02:27:45 Verifying that service account pipeline exists
2024/08/07 02:27:50 Verifying that cluster role pipelines-scc-clusterrole doesn't exist
2024/08/07 02:27:55 Verifying that config map config-service-cabundle doesn't exist
2024/08/07 02:28:00 Verifying that config map config-trusted-cabundle doesn't exist
2024/08/07 02:28:05 Verifying that role binding edit doesn't exist
2024/08/07 02:28:10 Verifying that role binding pipelines-scc-rolebinding doesn't exist
2024/08/07 02:28:15 Verifying that security context constraint pipelines-scc doesn't exist
      * Verify RBAC resources disabled successfully	 ...[PASS]
2024/08/07 02:28:15 enable auto creation of RBAC resources
2024/08/07 02:28:15 output: tektonconfig.operator.tekton.dev/config patched
      * Update TektonConfig CR to use param with name createRbacResource and value "true" to "enable" auto creation of RBAC resources	 ...[PASS]
2024/08/07 02:28:15 Verifying that TektonConfig status is "installed"
2024/08/07 02:28:20 Verifying that service account pipeline exists
2024/08/07 02:28:25 Verifying that cluster role pipelines-scc-clusterrole exists
2024/08/07 02:28:30 Verifying that config map config-service-cabundle exists
2024/08/07 02:28:35 Verifying that config map config-trusted-cabundle exists
2024/08/07 02:28:40 Verifying that role binding openshift-pipelines-edit exists
2024/08/07 02:28:45 Verifying that role binding pipelines-scc-rolebinding exists
2024/08/07 02:28:50 Verifying that security context constraint pipelines-scc exists
      * Verify RBAC resources are auto created successfully	 ...[PASS]
2024/08/07 02:28:58 output: project.project.openshift.io "releasetest-ss5md" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-08-07_02.28.58/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-08-07 02.28.58

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	114.143s
Runner with PID:31956 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	1 executed	1 passed	0 failed	0 skipped

Total time taken: 1m54.083s
Rename xml files to junit_test_*.xml