WARNING: Using insecure TLS client config. Setting this option is not supported!

Login successful.

You have access to 72 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
Running gauge specs
gauge run specs/clustertasks/clustertask-s2i.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Compatible version of plugin html-report not found. Installing plugin html-report...
Gathering metadata for html-report
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=&o=linux&a=amd64
Downloading https://github.com/getgauge/html-report/releases/download/v4.3.1/html-report-4.3.1-linux.x86_64.zip
.......................
Installing plugin html-report 4.3.1
Successfully installed plugin 'html-report' version 4.3.1
Compatible version of plugin xml-report not found. Installing plugin xml-report...
Gathering metadata for xml-report
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=html-report&o=linux&a=amd64
Downloading https://github.com/getgauge/xml-report/releases/download/v0.5.1/xml-report-0.5.1-linux.x86_64.zip
........................
Installing plugin xml-report 0.5.1
Successfully installed plugin 'xml-report' version 0.5.1
Compatible version of plugin go not found. Installing plugin go...
Gathering metadata for go
Downloading https://downloads.gauge.org/plugin/go?l=go&p=html-report,xml-report&o=linux&a=amd64
Downloading https://github.com/getgauge-contrib/gauge-go/releases/download/v0.4.0/gauge-go-0.4.0-linux.x86_64.zip
.......................
Running plugin hook command => [go install github.com/go-delve/delve/cmd/dlv@latest]
go: downloading github.com/go-delve/delve v1.23.1
go: downloading github.com/sirupsen/logrus v1.9.3
go: downloading github.com/mattn/go-isatty v0.0.20
go: downloading github.com/spf13/cobra v1.7.0
go: downloading github.com/hashicorp/golang-lru v1.0.2
go: downloading golang.org/x/arch v0.6.0
go: downloading gopkg.in/yaml.v3 v3.0.1
go: downloading github.com/spf13/pflag v1.0.5
go: downloading github.com/cosiner/argv v0.1.0
go: downloading github.com/derekparker/trie v0.0.0-20230829180723-39f4de51ef7d
go: downloading github.com/go-delve/liner v1.2.3-0.20231231155935-4726ab1d7f62
go: downloading github.com/google/go-dap v0.12.0
go: downloading github.com/cilium/ebpf v0.11.0
go: downloading go.starlark.net v0.0.0-20231101134539-556fd59b42f6
go: downloading golang.org/x/sys v0.17.0
go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2
go: downloading github.com/mattn/go-runewidth v0.0.13
go: downloading github.com/russross/blackfriday/v2 v2.1.0
go: downloading github.com/rivo/uniseg v0.2.0
go: downloading golang.org/x/exp v0.0.0-20230224173230-c95f2b4c22f2
Running plugin hook command => [go install github.com/getgauge-contrib/gauge-go@latest]
go: downloading github.com/getgauge-contrib/gauge-go v0.4.0
go: downloading github.com/getgauge/common v0.0.0-20211105093448-e0aee1ccb217
go: downloading github.com/golang/protobuf v1.5.3
go: downloading github.com/dmotylev/goproperties v0.0.0-20140630191356-7cbffbaada47
go: downloading google.golang.org/protobuf v1.31.0
Installing plugin go 0.4.0
Successfully installed plugin 'go' version 0.4.0
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/clustertasks/clustertask-s2i.spec
Parsing completed.
Starting go runner
go: downloading github.com/pkg/errors v0.9.1
go: downloading k8s.io/apimachinery v0.28.9
go: downloading github.com/tektoncd/operator v0.71.0
go: downloading gotest.tools/v3 v3.5.1
go: downloading github.com/openshift-pipelines/manual-approval-gate v0.2.2
go: downloading github.com/openshift/client-go v0.0.0-20240422164335-6c851f4919dd
go: downloading github.com/operator-framework/operator-lifecycle-manager v0.22.0
go: downloading github.com/operator-framework/api v0.16.0
go: downloading github.com/tektoncd/pipeline v0.59.0
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
go: downloading github.com/openshift/api v0.0.0-20240422085825-2624175e9673
go: downloading go.opencensus.io v0.24.0
go: downloading k8s.io/api v0.28.9
go: downloading github.com/prometheus/client_golang v1.19.0
go: downloading knative.dev/pkg v0.0.0-20240116073220-b488e7be5902
go: downloading github.com/tektoncd/cli v0.37.0
go: downloading github.com/tektoncd/triggers v0.27.0
go: downloading github.com/prometheus/common v0.52.2
go: downloading k8s.io/client-go v0.28.9
go: downloading github.com/google/go-cmp v0.6.0
go: downloading github.com/golang/protobuf v1.5.4
go: downloading github.com/gogo/protobuf v1.3.2
go: downloading github.com/google/gofuzz v1.2.0
go: downloading k8s.io/utils v0.0.0-20240310230437-4693a0247e57
go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
go: downloading k8s.io/klog/v2 v2.120.1
go: downloading github.com/manifestival/manifestival v0.7.2
go: downloading go.uber.org/zap v1.27.0
go: downloading github.com/openshift-pipelines/pipelines-as-code v0.27.0
go: downloading github.com/json-iterator/go v1.1.12
go: downloading github.com/prometheus/client_model v0.6.1
go: downloading google.golang.org/protobuf v1.33.0
go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.4.1
go: downloading github.com/google/cel-go v0.20.1
go: downloading golang.org/x/exp v0.0.0-20240325151524-a685a6edb6d8
go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9
go: downloading github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc
go: downloading github.com/google/gnostic-models v0.6.9-0.20230804172637-c7be7c783f49
go: downloading golang.org/x/net v0.24.0
go: downloading github.com/imdario/mergo v0.3.16
go: downloading golang.org/x/term v0.20.0
go: downloading github.com/blang/semver/v4 v4.0.0
go: downloading golang.org/x/sys v0.20.0
go: downloading gopkg.in/inf.v0 v0.9.1
go: downloading golang.org/x/time v0.5.0
go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
go: downloading github.com/evanphx/json-patch/v5 v5.9.0
go: downloading github.com/go-logr/logr v1.4.1
go: downloading go.uber.org/multierr v1.11.0
go: downloading github.com/openshift/apiserver-library-go v0.0.0-20230816171015-6bfafa975bfb
go: downloading github.com/evanphx/json-patch v5.9.0+incompatible
go: downloading sigs.k8s.io/yaml v1.4.0
go: downloading golang.org/x/xerrors v0.0.0-20231012003039-104605ab7028
go: downloading knative.dev/eventing v0.40.3
go: downloading github.com/cloudevents/sdk-go/v2 v2.15.2
go: downloading github.com/tidwall/sjson v1.2.4
go: downloading github.com/google/uuid v1.6.0
go: downloading golang.org/x/sync v0.7.0
go: downloading github.com/blendle/zapdriver v1.3.1
go: downloading github.com/google/go-containerregistry v0.19.1
go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: downloading github.com/modern-go/reflect2 v1.0.2
go: downloading gopkg.in/yaml.v2 v2.4.0
go: downloading google.golang.org/genproto/googleapis/api v0.0.0-20240401170217-c3f982113cda
go: downloading golang.org/x/oauth2 v0.19.0
go: downloading github.com/fatih/color v1.16.0
go: downloading github.com/jonboulle/clockwork v0.4.0
go: downloading github.com/spf13/cobra v1.8.0
go: downloading k8s.io/cli-runtime v0.28.9
go: downloading github.com/AlecAivazis/survey/v2 v2.3.7
go: downloading github.com/ktr0731/go-fuzzyfinder v0.8.0
go: downloading contrib.go.opencensus.io/exporter/ocagent v0.7.1-0.20200907061046-05415f1de66d
go: downloading contrib.go.opencensus.io/exporter/prometheus v0.4.2
go: downloading google.golang.org/grpc v1.63.2
go: downloading k8s.io/apiextensions-apiserver v0.28.9
go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0
go: downloading github.com/emicklei/go-restful/v3 v3.12.0
go: downloading github.com/go-openapi/jsonreference v0.21.0
go: downloading github.com/go-openapi/swag v0.23.0
go: downloading github.com/tidwall/gjson v1.12.1
go: downloading github.com/kelseyhightower/envconfig v1.4.0
go: downloading github.com/hashicorp/go-multierror v1.1.1
go: downloading sigs.k8s.io/controller-runtime v0.15.3
go: downloading golang.org/x/text v0.15.0
go: downloading github.com/stoewer/go-strcase v1.3.0
go: downloading github.com/antlr4-go/antlr/v4 v4.13.0
go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822
go: downloading github.com/mattn/go-colorable v0.1.13
go: downloading github.com/hako/durafmt v0.0.0-20210608085754-5c1018a4e16b
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading github.com/gdamore/tcell/v2 v2.6.0
go: downloading github.com/ktr0731/go-ansisgr v0.1.0
go: downloading github.com/mattn/go-runewidth v0.0.15
go: downloading github.com/nsf/termbox-go v1.1.1
go: downloading github.com/prometheus/statsd_exporter v0.26.1
go: downloading github.com/census-instrumentation/opencensus-proto v0.4.1
go: downloading google.golang.org/api v0.172.0
go: downloading github.com/go-openapi/jsonpointer v0.21.0
go: downloading github.com/mailru/easyjson v0.7.7
go: downloading github.com/tidwall/match v1.1.1
go: downloading github.com/tidwall/pretty v1.2.0
go: downloading github.com/hashicorp/errwrap v1.1.0
go: downloading github.com/opencontainers/go-digest v1.0.0
go: downloading github.com/mgutz/ansi v0.0.0-20200706080929-d51e80ef957d
go: downloading github.com/beorn7/perks v1.0.1
go: downloading github.com/cespare/xxhash/v2 v2.2.0
go: downloading github.com/prometheus/procfs v0.13.0
go: downloading github.com/rivo/uniseg v0.4.4
go: downloading github.com/gdamore/encoding v1.0.0
go: downloading github.com/lucasb-eyer/go-colorful v1.2.0
go: downloading github.com/go-kit/log v0.2.1
go: downloading github.com/grpc-ecosystem/grpc-gateway/v2 v2.19.1
go: downloading github.com/josharian/intern v1.0.0
go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de
go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79
go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible
go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3
go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20240401170217-c3f982113cda
go: downloading github.com/go-logfmt/logfmt v0.6.0
go: downloading github.com/google/btree v1.1.2
go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510
go: downloading github.com/go-errors/errors v1.4.2
go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca
go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00
go: downloading github.com/xlab/treeprint v1.2.0
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 35547
Successfully made the connection with plugin with port: 35547
Starting Xml Report plugin
Attempting to connect to grpc server at port: 42483
Successfully made the connection with plugin with port: 42483
Initialising suite data store.
# Verify Clustertasks E2E spec
  ## S2I nodejs pipelinerun: PIPELINES-14-TC01	
2024/10/16 02:20:05 output: Now using project "releasetest-p79h2" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:20:05 Waiting for operator to be up and running....
2024/10/16 02:20:05 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:20:05 Verify SA "pipeline" is created in namespace "releasetest-p79h2"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:20:05 output: imagestream.image.openshift.io/nodejs-ex-git created
deploymentconfig.apps.openshift.io/nodejs-ex-git created
pipeline.tekton.dev/nodejs-ex-git created
pipelinerun.tekton.dev/nodejs-ex-git-pr created
      * Create 
      
         |S.NO|resource_dir                                            |
         |----|--------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/s2i-nodejs-pipelinerun.yaml|	 ...[PASS]
2024/10/16 02:20:05 validating pipeline run nodejs-ex-git-pr for success state...
2024/10/16 02:22:25 pipelineRun: nodejs-ex-git-pr is successful under namespace : releasetest-p79h2
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_lable_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |nodejs-ex-git-pr |successful|no                     |	 ...[PASS]
2024/10/16 02:22:45 output: project.project.openshift.io "releasetest-p79h2" deleted
  ## S2I java pipelinerun: PIPELINES-14-TC04	
2024/10/16 02:22:46 output: Now using project "releasetest-z5nnw" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:22:46 Verify SA "pipeline" is created in namespace "releasetest-z5nnw"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:22:46 output: pipeline.tekton.dev/s2i-java-pipeline created
2024/10/16 02:22:46 output: persistentvolumeclaim/shared-pvc created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/v1beta1/clustertask/pipelines/s2i-java.yaml|
         |2   |testdata/pvc/pvc.yaml                               |	 ...[PASS]
2024/10/16 02:22:46 Getting imagestream from the namespace openshift
      * Get tags of the imagestream "java" from namespace "openshift" and store to variable "java-tags"	 ...[PASS]
2024/10/16 02:22:46 Starting pipeline s2i-java-pipeline with param VERSION=11
2024/10/16 02:22:46 Pipelinerun s2i-java-pipeline-run-cnhn7 started
2024/10/16 02:22:46 validating pipeline run s2i-java-pipeline-run-cnhn7 for success state...
2024/10/16 02:22:49 Starting pipeline s2i-java-pipeline with param VERSION=8
2024/10/16 02:22:49 Pipelinerun s2i-java-pipeline-run-9nxff started
2024/10/16 02:22:49 validating pipeline run s2i-java-pipeline-run-9nxff for success state...
2024/10/16 02:22:52 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-el7
2024/10/16 02:22:52 Pipelinerun s2i-java-pipeline-run-rkgcz started
2024/10/16 02:22:52 validating pipeline run s2i-java-pipeline-run-rkgcz for success state...
2024/10/16 02:22:55 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-ubi8
2024/10/16 02:22:55 Pipelinerun s2i-java-pipeline-run-k52zs started
2024/10/16 02:22:55 validating pipeline run s2i-java-pipeline-run-k52zs for success state...
2024/10/16 02:22:58 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-17-ubi8
2024/10/16 02:22:58 Pipelinerun s2i-java-pipeline-run-6n68q started
2024/10/16 02:22:58 validating pipeline run s2i-java-pipeline-run-6n68q for success state...
2024/10/16 02:23:01 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-el7
2024/10/16 02:23:01 Pipelinerun s2i-java-pipeline-run-9gmf5 started
2024/10/16 02:23:01 validating pipeline run s2i-java-pipeline-run-9gmf5 for success state...
2024/10/16 02:23:04 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-ubi8
2024/10/16 02:23:04 Pipelinerun s2i-java-pipeline-run-tcrcd started
2024/10/16 02:23:04 validating pipeline run s2i-java-pipeline-run-tcrcd for success state...
2024/10/16 02:24:55 pipelineRun: s2i-java-pipeline-run-k52zs is successful under namespace : releasetest-z5nnw
2024/10/16 02:25:04 pipelineRun: s2i-java-pipeline-run-tcrcd is successful under namespace : releasetest-z5nnw
2024/10/16 02:25:13 pipelineRun: s2i-java-pipeline-run-6n68q is successful under namespace : releasetest-z5nnw
2024/10/16 02:26:22 pipelineRun: s2i-java-pipeline-run-cnhn7 is successful under namespace : releasetest-z5nnw
2024/10/16 02:26:24 pipelineRun: s2i-java-pipeline-run-9nxff is successful under namespace : releasetest-z5nnw
2024/10/16 02:26:26 pipelineRun: s2i-java-pipeline-run-9gmf5 is successful under namespace : releasetest-z5nnw
2024/10/16 02:26:27 pipelineRun: s2i-java-pipeline-run-rkgcz is successful under namespace : releasetest-z5nnw
      * Start and verify pipeline "s2i-java-pipeline" with param "VERSION" with values stored in variable "java-tags" with workspace "name=source,claimName=shared-pvc"	 ...[PASS]
2024/10/16 02:26:47 output: project.project.openshift.io "releasetest-z5nnw" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_02.26.47/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 02.26.47

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	403.376s
Runner with PID:4199 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Total time taken: 6m43.255s
gauge run specs/clustertasks/clustertask.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin html-report is already installed.
Plugin xml-report is already installed.
Plugin go is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/clustertasks/clustertask.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 35699
Successfully made the connection with plugin with port: 35699
Starting Xml Report plugin
Attempting to connect to grpc server at port: 40307
Successfully made the connection with plugin with port: 40307
Initialising suite data store.
# Verify Clustertasks E2E spec
  ## buildah pipelinerun: PIPELINES-16-TC01	
2024/10/16 02:26:52 output: Now using project "releasetest-hr9ws" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:26:52 Waiting for operator to be up and running....
2024/10/16 02:26:52 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:26:52 Verify SA "pipeline" is created in namespace "releasetest-hr9ws"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:26:52 output: pipeline.tekton.dev/buildah-pipeline created
2024/10/16 02:26:52 output: persistentvolumeclaim/shared-pvc created
2024/10/16 02:26:52 output: pipelinerun.tekton.dev/buildah-run created
      * Create 
      
         |S.NO|resource_dir                                     |
         |----|-------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelines/buildah.yaml   |
         |2   |testdata/pvc/pvc.yaml                            |
         |3   |testdata/v1/clustertask/pipelineruns/buildah.yaml|	 ...[PASS]
2024/10/16 02:26:52 validating pipeline run buildah-run for success state...
2024/10/16 02:27:33 pipelineRun: buildah-run is successful under namespace : releasetest-hr9ws
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |buildah-run      |successful|no                     |	 ...[PASS]
2024/10/16 02:27:53 output: project.project.openshift.io "releasetest-hr9ws" deleted
  ## git-clone read private repo taskrun PIPELINES-16-TC12	
2024/10/16 02:27:53 output: Now using project "releasetest-zmncn" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:27:53 Verify SA "pipeline" is created in namespace "releasetest-zmncn"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:27:58 output: pipeline.tekton.dev/git-clone-read-private-pipeline created
2024/10/16 02:27:58 output: persistentvolumeclaim/shared-pvc created
2024/10/16 02:27:58 output: secret/ssh-key created
      * Create 
      
         |S.NO|resource_dir                                                 |
         |----|-------------------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelines/git-clone-read-private.yaml|
         |2   |testdata/pvc/pvc.yaml                                        |
         |3   |testdata/v1/clustertask/secrets/ssh-key.yaml                 |	 ...[PASS]
2024/10/16 02:27:59 output:
      * Link secret "ssh-key" to service account "pipeline"	 ...[PASS]
2024/10/16 02:27:59 output: pipelinerun.tekton.dev/git-clone-read-private-pipeline-run created
      * Create 
      
         |S.NO|resource_dir                                                    |
         |----|----------------------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelineruns/git-clone-read-private.yaml|	 ...[PASS]
2024/10/16 02:27:59 validating pipeline run git-clone-read-private-pipeline-run for success state...
2024/10/16 02:28:09 pipelineRun: git-clone-read-private-pipeline-run is successful under namespace : releasetest-zmncn
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                  |status    |check_label_propagation|
         |----|-----------------------------------|----------|-----------------------|
         |1   |git-clone-read-private-pipeline-run|successful|no                     |	 ...[PASS]
2024/10/16 02:28:29 output: project.project.openshift.io "releasetest-zmncn" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_02.28.29/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 02.28.29

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	97.340s
Runner with PID:26121 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Total time taken: 1m37.273s
gauge run specs/pipelines/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
6 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/pipelines/bundles-resolver.spec
specs/pipelines/cluster-resolvers.spec
specs/pipelines/fail.spec
specs/pipelines/git-resolvers.spec
specs/pipelines/hub-resolvers.spec
specs/pipelines/run.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 35955
Successfully made the connection with plugin with port: 35955
Starting Xml Report plugin
Attempting to connect to grpc server at port: 45111
Successfully made the connection with plugin with port: 45111
Initialising suite data store.
# Bundles resolver spec
  ## Test the functionality of bundles resolver with parameter: PIPELINES-25-TC02	
2024/10/16 02:28:33 output: Now using project "releasetest-sqc5h" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:28:33 Waiting for operator to be up and running....
2024/10/16 02:28:33 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:28:33 Verify SA "pipeline" is created in namespace "releasetest-sqc5h"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:28:33 output: pipelinerun.tekton.dev/bundles-resolver-pipelinerun-param created
      * Create 
      
         |S.NO|resource_dir                                                           |
         |----|-----------------------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/bundles-resolver-pipelinerun-param.yaml|	 ...[PASS]
2024/10/16 02:28:33 validating pipeline run bundles-resolver-pipelinerun-param for success state...
2024/10/16 02:28:58 pipelineRun: bundles-resolver-pipelinerun-param is successful under namespace : releasetest-sqc5h
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                 |status    |check_label_propagation|
         |----|----------------------------------|----------|-----------------------|
         |1   |bundles-resolver-pipelinerun-param|successful|no                     |	 ...[PASS]
2024/10/16 02:29:18 output: project.project.openshift.io "releasetest-sqc5h" deleted

# Cluster resolvers spec
  ## Checking the functionality of cluster resolvers#1: PIPELINES-23-TC01	
2024/10/16 02:29:19 output: Now using project "releasetest-6l94f" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:29:19 Check if project releasetest-tasks already exists
2024/10/16 02:29:19 Creating project releasetest-tasks
2024/10/16 02:29:19 output: Now using project "releasetest-tasks" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-tasks"	 ...[PASS]
2024/10/16 02:29:19 Verify SA "pipeline" is created in namespace "releasetest-tasks"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:29:25 output: task.tekton.dev/resolver-task2 created
      * Create 
      
         |S.NO|resource_dir                                |
         |----|--------------------------------------------|
         |1   |testdata/resolvers/tasks/resolver-task2.yaml|	 ...[PASS]
2024/10/16 02:29:25 Check if project releasetest-pipelines already exists
2024/10/16 02:29:25 Creating project releasetest-pipelines
2024/10/16 02:29:25 output: Now using project "releasetest-pipelines" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-pipelines"	 ...[PASS]
2024/10/16 02:29:25 Verify SA "pipeline" is created in namespace "releasetest-pipelines"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:29:30 output: pipeline.tekton.dev/resolver-pipeline created
      * Create 
      
         |S.NO|resource_dir                                       |
         |----|---------------------------------------------------|
         |1   |testdata/resolvers/pipelines/resolver-pipeline.yaml|	 ...[PASS]
2024/10/16 02:29:30 Check if project releasetest-pipelineruns already exists
2024/10/16 02:29:30 Creating project releasetest-pipelineruns
2024/10/16 02:29:31 output: Now using project "releasetest-pipelineruns" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-pipelineruns"	 ...[PASS]
2024/10/16 02:29:31 Verify SA "pipeline" is created in namespace "releasetest-pipelineruns"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:29:36 output: pipelinerun.tekton.dev/resolver-pipelinerun created
      * Create 
      
         |S.NO|resource_dir                                             |
         |----|---------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/resolver-pipelinerun.yaml|	 ...[PASS]
2024/10/16 02:29:36 validating pipeline run resolver-pipelinerun for success state...
2024/10/16 02:29:46 pipelineRun: resolver-pipelinerun is successful under namespace : releasetest-pipelineruns
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name   |status    |check_label_propagation|
         |----|--------------------|----------|-----------------------|
         |1   |resolver-pipelinerun|successful|no                     |	 ...[PASS]
2024/10/16 02:29:46 Deleting project releasetest-tasks
2024/10/16 02:29:54 output: project.project.openshift.io "releasetest-tasks" deleted
      * Delete project "releasetest-tasks"	 ...[PASS]
2024/10/16 02:29:54 Deleting project releasetest-pipelines
2024/10/16 02:30:02 output: project.project.openshift.io "releasetest-pipelines" deleted
      * Delete project "releasetest-pipelines"	 ...[PASS]
2024/10/16 02:30:02 Deleting project releasetest-pipelineruns
2024/10/16 02:30:22 output: project.project.openshift.io "releasetest-pipelineruns" deleted
      * Delete project "releasetest-pipelineruns"	 ...[PASS]
2024/10/16 02:30:29 output: project.project.openshift.io "releasetest-6l94f" deleted

# Verify Pipeline Failures
  ## Run Pipeline with a non-existent ServiceAccount: PIPELINES-02-TC01	
2024/10/16 02:30:29 output: Now using project "releasetest-7pwx5" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:30:29 Verify SA "foobar" is absent in namespace "releasetest-7pwx5"
      * Verify ServiceAccount "foobar" does not exist	 ...[PASS]
2024/10/16 02:30:29 output: task.tekton.dev/create-file-vb created
task.tekton.dev/check-stuff-file-exists-vb created
pipeline.tekton.dev/output-pipeline-vb created
pipelinerun.tekton.dev/output-pipeline-run-vb created
      * Create 
      
         |S.NO|resource_dir                              |
         |----|------------------------------------------|
         |1   |testdata/negative/v1beta1/pipelinerun.yaml|	 ...[PASS]
2024/10/16 02:30:29 validating pipeline run output-pipeline-run-vb for failure state...
2024/10/16 02:30:29 Waiting for PipelineRun in namespace releasetest-7pwx5 to fail
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name     |status |check_label_propagation|
         |----|----------------------|-------|-----------------------|
         |1   |output-pipeline-run-vb|Failure|no                     |	 ...[PASS]
2024/10/16 02:30:54 output: project.project.openshift.io "releasetest-7pwx5" deleted

# Git resolvers spec
  ## Test the functionality of git resolvers: PIPELINES-24-TC01	
2024/10/16 02:30:55 output: Now using project "releasetest-7xzw6" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:30:55 Verify SA "pipeline" is created in namespace "releasetest-7xzw6"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:31:00 output: pipelinerun.tekton.dev/git-resolver-pipelinerun created
      * Create 
      
         |S.NO|resource_dir                                                 |
         |----|-------------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/git-resolver-pipelinerun.yaml|	 ...[PASS]
2024/10/16 02:31:00 validating pipeline run git-resolver-pipelinerun for success state...
2024/10/16 02:31:10 pipelineRun: git-resolver-pipelinerun is successful under namespace : releasetest-7xzw6
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status    |check_label_propagation|
         |----|------------------------|----------|-----------------------|
         |1   |git-resolver-pipelinerun|successful|no                     |	 ...[PASS]
2024/10/16 02:31:30 output: project.project.openshift.io "releasetest-7xzw6" deleted

# HUB resolvers spec
  ## Test the functionality of hub resolvers	
2024/10/16 02:31:30 output: Now using project "releasetest-mm8vj" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:31:30 Verify SA "pipeline" is created in namespace "releasetest-mm8vj"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:31:30 output: pipeline.tekton.dev/hub-git-cli-pipeline created
2024/10/16 02:31:31 output: persistentvolumeclaim/shared-pvc created
2024/10/16 02:31:31 output: pipelinerun.tekton.dev/hub-git-cli-run created
      * Apply 
      
         |S.NO|resource_dir                                    |
         |----|------------------------------------------------|
         |1   |testdata/resolvers/pipelines/git-cli-hub.yaml   |
         |2   |testdata/pvc/pvc.yaml                           |
         |3   |testdata/resolvers/pipelineruns/git-cli-hub.yaml|	 ...[PASS]
2024/10/16 02:31:31 validating pipeline run hub-git-cli-run for success state...
2024/10/16 02:31:56 pipelineRun: hub-git-cli-run is successful under namespace : releasetest-mm8vj
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |hub-git-cli-run  |successful|no                     |	 ...[PASS]
2024/10/16 02:32:16 output: project.project.openshift.io "releasetest-mm8vj" deleted

# Verify Pipeline E2E spec
  ## Pipelinerun Timeout failure Test: PIPELINES-03-TC04	
2024/10/16 02:32:16 output: Now using project "releasetest-9mgjx" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:32:16 Verify SA "pipeline" is created in namespace "releasetest-9mgjx"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:32:22 output: task.tekton.dev/banana created
pipeline.tekton.dev/tomatoes created
pipelinerun.tekton.dev/pear created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/pipelineruntimeout.yaml|	 ...[PASS]
2024/10/16 02:32:22 validating pipeline run pear to time out...
2024/10/16 02:32:22 Waiting for Pipelinerun pear in namespace releasetest-9mgjx to be started
2024/10/16 02:32:27 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-9mgjx to be running
2024/10/16 02:32:27 Waiting for PipelineRun pear in namespace releasetest-9mgjx to be timed out
2024/10/16 02:32:32 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-9mgjx to be cancelled
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status |check_label_propagation|
         |----|-----------------|-------|-----------------------|
         |1   |pear             |timeout|no                     |	 ...[PASS]
2024/10/16 02:32:52 output: project.project.openshift.io "releasetest-9mgjx" deleted
  ## Configure execution results at the Task level Test: PIPELINES-03-TC05	
2024/10/16 02:32:52 output: Now using project "releasetest-k9spv" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:32:52 Verify SA "pipeline" is created in namespace "releasetest-k9spv"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:32:57 output: pipeline.tekton.dev/sum-and-multiply-pipeline created
task.tekton.dev/sum created
task.tekton.dev/multiply created
pipelinerun.tekton.dev/task-level-results created
      * Create 
      
         |S.NO|resource_dir                                          |
         |----|------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/task_results_example.yaml|	 ...[PASS]
2024/10/16 02:32:57 validating pipeline run task-level-results for success state...
2024/10/16 02:33:13 pipelineRun: task-level-results is successful under namespace : releasetest-k9spv
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name |status    |check_label_propagation|
         |----|------------------|----------|-----------------------|
         |1   |task-level-results|successful|no                     |	 ...[PASS]
2024/10/16 02:33:33 output: project.project.openshift.io "releasetest-k9spv" deleted
  ## Cancel pipelinerun Test: PIPELINES-03-TC06	
2024/10/16 02:33:33 output: Now using project "releasetest-s76jv" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:33:33 Verify SA "pipeline" is created in namespace "releasetest-s76jv"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:33:38 output: persistentvolumeclaim/shared-pvc created
2024/10/16 02:33:38 output: task.tekton.dev/create-file-v1b1 created
task.tekton.dev/check-file-exists-v1b1 created
pipeline.tekton.dev/output-pipeline-v1b1 created
pipelinerun.tekton.dev/output-pipeline-run-v1b1 created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pvc/pvc.yaml                        |
         |2   |testdata/v1beta1/pipelinerun/pipelinerun.yaml|	 ...[PASS]
2024/10/16 02:33:38 validating pipeline run output-pipeline-run-v1b1 to be cancelled...
2024/10/16 02:33:38 Waiting for Pipelinerun output-pipeline-run-v1b1 in namespace releasetest-s76jv to be started
2024/10/16 02:33:44 Canceling pipeline run: PipelineRun cancelled: output-pipeline-run-v1b1
2024/10/16 02:33:49 Waiting for TaskRuns in PipelineRun output-pipeline-run-v1b1 in namespace releasetest-s76jv to be cancelled
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status   |check_label_propagation|
         |----|------------------------|---------|-----------------------|
         |1   |output-pipeline-run-v1b1|cancelled|no                     |	 ...[PASS]
2024/10/16 02:34:09 output: project.project.openshift.io "releasetest-s76jv" deleted
  ## Pipelinerun with large result: PIPELINES-03-TC08	
2024/10/16 02:34:09 output: Now using project "releasetest-l5tmc" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:34:09 Verify SA "pipeline" is created in namespace "releasetest-l5tmc"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:34:14 output: task.tekton.dev/print-result created
task.tekton.dev/generate-result created
pipeline.tekton.dev/result-test created
pipelinerun.tekton.dev/result-test-run created
      * Create 
      
         |S.NO|resource_dir                                                   |
         |----|---------------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/pipelinerun-with-large-result.yaml|	 ...[PASS]
2024/10/16 02:34:14 validating pipeline run result-test-run for success state...
2024/10/16 02:34:29 pipelineRun: result-test-run is successful under namespace : releasetest-l5tmc
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |result-test-run  |successful|no                     |	 ...[PASS]
2024/10/16 02:34:49 output: project.project.openshift.io "releasetest-l5tmc" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_02.34.49/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 02.34.49

Sending kill message to Xml Report plugin.
Sending kill message to Html Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	376.836s
Runner with PID:26848 has exited
Specifications:	6 executed	6 passed	0 failed	0 skipped
Scenarios:	9 executed	9 passed	0 failed	0 skipped

Total time taken: 6m16.763s
gauge run specs/triggers/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin html-report is already installed.
Plugin xml-report is already installed.
Plugin go is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
4 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/triggers/cron.spec
specs/triggers/eventlistener.spec
specs/triggers/triggerbinding.spec
specs/triggers/tutorial.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Attempting to connect to grpc server at port: 34957
Successfully made the connection with plugin with port: 34957
Starting Xml Report plugin
Attempting to connect to grpc server at port: 40347
Successfully made the connection with plugin with port: 40347
Initialising suite data store.
# Verify Triggers with cronjob
  ## Create Triggers using k8s cronJob: PIPELINES-04-TC01	
2024/10/16 02:34:54 output: Now using project "releasetest-z526c" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:34:54 Waiting for operator to be up and running....
2024/10/16 02:34:54 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:34:55 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/10/16 02:34:55 output: triggerbinding.triggers.tekton.dev/cron-binding created
2024/10/16 02:34:55 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/10/16 02:34:55 output: eventlistener.triggers.tekton.dev/cron-listener created
      * Create 
      
         |S.NO|resource_dir                                |
         |----|--------------------------------------------|
         |1   |testdata/triggers/cron/example-pipeline.yaml|
         |2   |testdata/triggers/cron/triggerbinding.yaml  |
         |3   |testdata/triggers/cron/triggertemplate.yaml |
         |4   |testdata/triggers/cron/eventlistener.yaml   |	 ...[PASS]
2024/10/16 02:34:55 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:34:55 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:35:00 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-cron-listener-85b7f8957d" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000aca2a0 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/10/16 02:35:05 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-cron-listener-85b7f8957d" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:34:55 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000902930 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/10/16 02:35:10 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:35:09 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:35:09 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:35:09 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cron-listener-85b7f8957d" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:35:09 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:35:09 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000b463c0 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/10/16 02:35:10 sinkpod name: el-cron-listener-85b7f8957d-7pxrn
2024/10/16 02:35:11 Route url: 'http://el-cron-listener-releasetest-z526c.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "cron-listener"	 ...[PASS]
2024/10/16 02:35:16 Verify that image stream "golang" exists in namespace "openshift"
      * Verify that image stream "golang" exists	 ...[PASS]
2024/10/16 02:35:16 Cronjob: hello created in namespace: releasetest-z526c
      * Create cron job with schedule "*/1 * * * *"	 ...[PASS]
2024/10/16 02:36:01 pipeline run : simple-pipeline-run-42mrj
2024/10/16 02:37:01 pipeline run : simple-pipeline-run-jqgz9
2024/10/16 02:38:01 pipeline run : simple-pipeline-run-psgdm
2024/10/16 02:39:01 pipeline run : simple-pipeline-run-h4k56
2024/10/16 02:40:01 pipeline run : simple-pipeline-run-b9zpw
      * Watch for pipelinerun resources	 ...[PASS]
      * Delete cron job	 ...[PASS]
      * Assert no new pipelineruns created	 ...[PASS]
2024/10/16 02:41:16 Deleted EventListener
2024/10/16 02:41:16 EventListener's Deployment was deleted
2024/10/16 02:41:16 EventListener's Service was deleted
2024/10/16 02:41:16 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:41:36 output: project.project.openshift.io "releasetest-z526c" deleted

# Verify eventlisteners spec
  ## Create Eventlistener embedded TriggersBindings specs: PIPELINES-05-TC08	
2024/10/16 02:41:36 output: Now using project "releasetest-lmkq6" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:41:37 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/10/16 02:41:37 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/10/16 02:41:37 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/10/16 02:41:37 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/sample-pipeline.yaml                             |
         |2   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |3   |testdata/triggers/triggertemplate/triggertemplate.yaml             |
         |4   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/10/16 02:41:37 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:41:37 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:41:42 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:41:39 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:41:39 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:41:39 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-5db89665cf" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:41:39 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:41:39 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000c86150 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/10/16 02:41:42 sinkpod name: el-listener-embed-binding-5db89665cf-vxtbk
2024/10/16 02:41:43 Route url: 'http://el-listener-embed-binding-releasetest-lmkq6.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/10/16 02:41:48 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:41:48 validating pipeline run simple-pipeline-run for success state...
2024/10/16 02:42:03 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-lmkq6
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name  |status    |check_label_propagation|
         |----|-------------------|----------|-----------------------|
         |1   |simple-pipeline-run|successful|no                     |	 ...[PASS]
2024/10/16 02:42:03 Deleted EventListener
2024/10/16 02:42:03 EventListener's Deployment was deleted
2024/10/16 02:42:03 EventListener's Service was deleted
2024/10/16 02:42:03 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:42:23 output: project.project.openshift.io "releasetest-lmkq6" deleted
  ## Create embedded TriggersTemplate: PIPELINES-05-TC09	
2024/10/16 02:42:24 output: Now using project "releasetest-cj7gn" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:42:24 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/10/16 02:42:24 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/10/16 02:42:24 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |2   |testdata/triggers/triggertemplate/embed-triggertemplate.yaml       |
         |3   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/10/16 02:42:24 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:42:24 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:24 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:24 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:24 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000f025a0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/10/16 02:42:29 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:26 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:26 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:26 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-86859b58d7" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:26 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:42:26 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc00084e600 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/10/16 02:42:29 sinkpod name: el-listener-embed-binding-86859b58d7-tfsnl
2024/10/16 02:42:30 Route url: 'http://el-listener-embed-binding-releasetest-cj7gn.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/10/16 02:42:35 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:42:35 validating pipeline run pipelinerun-with-taskspec-to-echo-message for success state...
2024/10/16 02:42:40 pipelineRun: pipelinerun-with-taskspec-to-echo-message is successful under namespace : releasetest-cj7gn
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                        |status    |check_label_propagation|
         |----|-----------------------------------------|----------|-----------------------|
         |1   |pipelinerun-with-taskspec-to-echo-message|successful|no                     |	 ...[PASS]
2024/10/16 02:42:40 Deleted EventListener
2024/10/16 02:42:40 EventListener's Deployment was deleted
2024/10/16 02:42:40 EventListener's Service was deleted
2024/10/16 02:42:40 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:43:00 output: project.project.openshift.io "releasetest-cj7gn" deleted
  ## Verify Github push event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC12	
2024/10/16 02:43:01 output: Now using project "releasetest-8nqfj" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:43:01 Verify SA "pipeline" is created in namespace "releasetest-8nqfj"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:43:06 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-push created
2024/10/16 02:43:06 output: eventlistener.triggers.tekton.dev/listener-ctb-github-push created
      * Create 
      
         |S.NO|resource_dir                                                      |
         |----|------------------------------------------------------------------|
         |1   |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-push.yaml|
         |2   |testdata/triggers/github-ctb/eventlistener-ctb-git-push.yaml      |	 ...[PASS]
2024/10/16 02:43:06 output: secret/github-secret created
2024/10/16 02:43:06 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/10/16 02:43:06 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-78d6557b84" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0004dd050 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/10/16 02:43:06 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-78d6557b84" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:06 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0005007b0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/10/16 02:43:11 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:08 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:08 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:08 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-ctb-github-push-78d6557b84" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:08 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:08 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0006ae120 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/10/16 02:43:11 sinkpod name: el-listener-ctb-github-push-78d6557b84-jdlr9
2024/10/16 02:43:12 Route url: 'http://el-listener-ctb-github-push-releasetest-8nqfj.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-ctb-github-push"	 ...[PASS]
2024/10/16 02:43:17 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/triggers/github-ctb/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:43:17 validating pipeline run pipelinerun-git-push-ctb for success state...
2024/10/16 02:43:22 pipelineRun: pipelinerun-git-push-ctb is successful under namespace : releasetest-8nqfj
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status    |check_label_propagation|
         |----|------------------------|----------|-----------------------|
         |1   |pipelinerun-git-push-ctb|successful|no                     |	 ...[PASS]
2024/10/16 02:43:22 Deleted EventListener
2024/10/16 02:43:22 EventListener's Deployment was deleted
2024/10/16 02:43:22 EventListener's Service was deleted
2024/10/16 02:43:23 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:43:43 output: project.project.openshift.io "releasetest-8nqfj" deleted
  ## Verify Github pull_request event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC13	
2024/10/16 02:43:43 output: Now using project "releasetest-qxp82" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:43:43 Verify SA "pipeline" is created in namespace "releasetest-qxp82"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:43:48 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-pr created
2024/10/16 02:43:48 output: eventlistener.triggers.tekton.dev/listener-clustertriggerbinding-github-pr created
      * Create 
      
         |S.NO|resource_dir                                                    |
         |----|----------------------------------------------------------------|
         |1   |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-pr.yaml|
         |2   |testdata/triggers/github-ctb/eventlistener-ctb-git-pr.yaml      |	 ...[PASS]
2024/10/16 02:43:48 output: secret/github-secret created
2024/10/16 02:43:49 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/10/16 02:43:49 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-7dd4f7d9c4" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000894330 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/10/16 02:43:49 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-7dd4f7d9c4" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:48 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc00082e1b0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/10/16 02:43:54 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:49 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:49 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:49 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-7dd4f7d9c4" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:49 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:43:49 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc00082e600 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/10/16 02:43:54 sinkpod name: el-listener-clustertriggerbinding-github-pr-7dd4f7d9c4-ngc4p
2024/10/16 02:43:54 Route url: 'http://el-listener-clustertriggerbinding-github-pr-releasetest-qxp82.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-clustertriggerbinding-github-pr"	 ...[PASS]
2024/10/16 02:43:59 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/github-ctb/pr.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:44:00 validating pipeline run pipelinerun-git-pr-ctb for success state...
2024/10/16 02:44:05 pipelineRun: pipelinerun-git-pr-ctb is successful under namespace : releasetest-qxp82
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name     |status    |check_label_propagation|
         |----|----------------------|----------|-----------------------|
         |1   |pipelinerun-git-pr-ctb|successful|no                     |	 ...[PASS]
2024/10/16 02:44:05 Deleted EventListener
2024/10/16 02:44:05 EventListener's Deployment was deleted
2024/10/16 02:44:05 EventListener's Service was deleted
2024/10/16 02:44:05 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:44:25 output: project.project.openshift.io "releasetest-qxp82" deleted
  ## Create TriggersCRD resource with CEL interceptors (overlays): PIPELINES-05-TC15	
2024/10/16 02:44:25 output: Now using project "releasetest-k8wts" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:44:25 Verify SA "pipeline" is created in namespace "releasetest-k8wts"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:44:30 output: eventlistener.triggers.tekton.dev/listener-triggerref created
2024/10/16 02:44:30 output: trigger.triggers.tekton.dev/trigger created
2024/10/16 02:44:31 output: triggerbinding.triggers.tekton.dev/github-pr-binding created
2024/10/16 02:44:31 output: triggertemplate.triggers.tekton.dev/github-template created
2024/10/16 02:44:31 output: pipeline.tekton.dev/parallel-pipeline created
task.tekton.dev/persist-param created
task.tekton.dev/to-upper created
task.tekton.dev/to-lower created
task.tekton.dev/result-reporter created
task.tekton.dev/validator created
      * Create 
      
         |S.NO|resource_dir                                               |
         |----|-----------------------------------------------------------|
         |1   |testdata/triggers/triggersCRD/eventlistener-triggerref.yaml|
         |2   |testdata/triggers/triggersCRD/trigger.yaml                 |
         |3   |testdata/triggers/triggersCRD/triggerbindings.yaml         |
         |4   |testdata/triggers/triggersCRD/triggertemplate.yaml         |
         |5   |testdata/triggers/triggersCRD/pipeline.yaml                |	 ...[PASS]
2024/10/16 02:44:31 output: secret/github-secret created
2024/10/16 02:44:31 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/10/16 02:44:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-98659b6bc" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000b3d320 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/10/16 02:44:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-98659b6bc" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:30 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000b3d710 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/10/16 02:44:36 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:32 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:32 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:32 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-triggerref-98659b6bc" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:32 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:44:32 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000b3db60 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/10/16 02:44:36 sinkpod name: el-listener-triggerref-98659b6bc-kqnhg
2024/10/16 02:44:37 Route url: 'http://el-listener-triggerref-releasetest-k8wts.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-triggerref"	 ...[PASS]
2024/10/16 02:44:42 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/triggersCRD/pull-request.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:44:42 validating pipeline run parallel-pipelinerun for success state...
2024/10/16 02:45:22 pipelineRun: parallel-pipelinerun is successful under namespace : releasetest-k8wts
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name   |status    |check_label_propagation|
         |----|--------------------|----------|-----------------------|
         |1   |parallel-pipelinerun|successful|no                     |	 ...[PASS]
2024/10/16 02:45:22 Deleted EventListener
2024/10/16 02:45:22 EventListener's Deployment was deleted
2024/10/16 02:45:22 EventListener's Service was deleted
2024/10/16 02:45:22 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:45:42 output: project.project.openshift.io "releasetest-k8wts" deleted
  ## Create Eventlistener with github interceptor And verify Kuberenetes Events: PIPELINES-05-TC17	
2024/10/16 02:45:43 output: Now using project "releasetest-5s2qf" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:45:43 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/10/16 02:45:43 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/10/16 02:45:43 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/10/16 02:45:43 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/sample-pipeline.yaml                             |
         |2   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |3   |testdata/triggers/triggertemplate/triggertemplate.yaml             |
         |4   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/10/16 02:45:44 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:45:44 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:43 +0000 UTC} Reason: Message:Deployment exists} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:44 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:44 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0007f1bf0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/10/16 02:45:49 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:45 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:45 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:45 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-658f65bb8c" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:45 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:45:45 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0009892c0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/10/16 02:45:49 sinkpod name: el-listener-embed-binding-658f65bb8c-gdlmm
2024/10/16 02:45:49 Route url: 'http://el-listener-embed-binding-releasetest-5s2qf.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/10/16 02:45:54 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
      * Verify kubernetes events for eventlistener	 ...[PASS]
2024/10/16 02:45:55 validating pipeline run simple-pipeline-run for success state...
2024/10/16 02:46:10 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-5s2qf
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name  |status    |check_label_propagation|
         |----|-------------------|----------|-----------------------|
         |1   |simple-pipeline-run|successful|no                     |	 ...[PASS]
2024/10/16 02:46:10 Deleted EventListener
2024/10/16 02:46:10 EventListener's Deployment was deleted
2024/10/16 02:46:10 EventListener's Service was deleted
2024/10/16 02:46:10 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:46:30 output: project.project.openshift.io "releasetest-5s2qf" deleted

# Verify triggerbindings spec
  ## Verify CEL marshaljson function Test: PIPELINES-10-TC01	
2024/10/16 02:46:30 output: Now using project "releasetest-pvp25" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:46:31 output: eventlistener.triggers.tekton.dev/cel-marshaljson created
      * Create 
      
         |S.NO|resource_dir                                          |
         |----|------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/cel-marshalJson.yaml|	 ...[PASS]
2024/10/16 02:46:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:46:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:46:36 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:46:32 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:46:32 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:46:32 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cel-marshaljson-54c5b9f888" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:46:32 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:46:32 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000aa52c0 Addresses:[]} Configuration:{GeneratedResourceName:el-cel-marshaljson}}
2024/10/16 02:46:36 sinkpod name: el-cel-marshaljson-54c5b9f888-nht4t
2024/10/16 02:46:36 Route url: 'http://el-cel-marshaljson-releasetest-pvp25.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "cel-marshaljson"	 ...[PASS]
2024/10/16 02:46:41 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:46:42 Waiting for TaskRun cel-trig-marshaljson in namespace releasetest-pvp25 to succeed
      * Verify taskrun 
      
         |S.NO|task_run_name       |status |
         |----|--------------------|-------|
         |1   |cel-trig-marshaljson|Success|	 ...[PASS]
2024/10/16 02:46:47 Deleted EventListener
2024/10/16 02:46:47 EventListener's Deployment was deleted
2024/10/16 02:46:47 EventListener's Service was deleted
2024/10/16 02:46:47 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:47:07 output: project.project.openshift.io "releasetest-pvp25" deleted
  ## Verify event message body parsing with old annotation Test: PIPELINES-10-TC02	
2024/10/16 02:47:07 output: Now using project "releasetest-d9958" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:47:07 output: triggertemplate.triggers.tekton.dev/taskrun-with-annotation created
eventlistener.triggers.tekton.dev/parse-json-body-with-annotation created
      * Create 
      
         |S.NO|resource_dir                                                          |
         |----|----------------------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/parse-json-body-with-annotation.yaml|	 ...[PASS]
2024/10/16 02:47:07 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:47:07 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:47:12 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:10 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:10 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:10 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-parse-json-body-with-annotation-5549d659b9" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:10 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:10 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000c86ab0 Addresses:[]} Configuration:{GeneratedResourceName:el-parse-json-body-with-annotation}}
2024/10/16 02:47:12 sinkpod name: el-parse-json-body-with-annotation-5549d659b9-n7b8x
2024/10/16 02:47:13 Route url: 'http://el-parse-json-body-with-annotation-releasetest-d9958.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "parse-json-body-with-annotation"	 ...[PASS]
2024/10/16 02:47:18 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:47:18 Waiting for TaskRun trig-parse-json-body-with-annotation in namespace releasetest-d9958 to succeed
      * Verify taskrun 
      
         |S.NO|task_run_name                       |status |
         |----|------------------------------------|-------|
         |1   |trig-parse-json-body-with-annotation|Success|	 ...[PASS]
2024/10/16 02:47:23 Deleted EventListener
2024/10/16 02:47:23 EventListener's Deployment was deleted
2024/10/16 02:47:23 EventListener's Service was deleted
2024/10/16 02:47:23 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/10/16 02:47:43 output: project.project.openshift.io "releasetest-d9958" deleted

# Verify triggers tutorial
  ## Run pipelines tutorial using triggers: PIPELINES-06-TC02	
2024/10/16 02:47:44 output: Now using project "releasetest-fd4kg" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:47:44 Verify SA "pipeline" is created in namespace "releasetest-fd4kg"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:47:49 output: task.tekton.dev/apply-manifests created
2024/10/16 02:47:49 output: task.tekton.dev/update-deployment created
2024/10/16 02:47:50 output: persistentvolumeclaim/source-pvc created
2024/10/16 02:47:50 output: pipeline.tekton.dev/build-and-deploy created
2024/10/16 02:47:50 output: triggerbinding.triggers.tekton.dev/vote-app created
2024/10/16 02:47:50 output: triggertemplate.triggers.tekton.dev/vote-app created
2024/10/16 02:47:51 output: trigger.triggers.tekton.dev/vote-trigger created
secret/github-secret created
2024/10/16 02:47:51 output: eventlistener.triggers.tekton.dev/vote-app created
      * Create remote 
      
         |S.NO|resource_dir                                                                                                                    |
         |----|--------------------------------------------------------------------------------------------------------------------------------|
         |1   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/01_apply_manifest_task.yaml    |
         |2   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/02_update_deployment_task.yaml |
         |3   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/03_persistent_volume_claim.yaml|
         |4   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/04_pipeline.yaml               |
         |5   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/01_binding.yaml                |
         |6   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/02_template.yaml               |
         |7   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/03_trigger.yaml                |
         |8   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/04_event_listener.yaml         |	 ...[PASS]
2024/10/16 02:47:51 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:47:51 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/10/16 02:47:56 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:53 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:53 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:53 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-vote-app-56fb4695df" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:53 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-10-16 02:47:53 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000b3c090 Addresses:[]} Configuration:{GeneratedResourceName:el-vote-app}}
2024/10/16 02:47:56 sinkpod name: el-vote-app-56fb4695df-bzm75
2024/10/16 02:47:57 Route url: 'http://el-vote-app-releasetest-fd4kg.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "vote-app"	 ...[PASS]
2024/10/16 02:48:02 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push-vote-api.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:48:02 Verifying if 1 number of pipelinerun are present
      * "1" pipelinerun(s) should be present within "15" seconds	 ...[PASS]
2024/10/16 02:48:07 validating pipeline run build-deploy-pipelines-vote-api-wmsll for success state...
2024/10/16 02:49:22 pipelineRun: build-deploy-pipelines-vote-api-wmsll is successful under namespace : releasetest-fd4kg
      * Verify the latest pipelinerun for "successful" state	 ...[PASS]
2024/10/16 02:49:22 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push-vote-ui.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/10/16 02:49:22 Verifying if 2 number of pipelinerun are present
      * "2" pipelinerun(s) should be present within "15" seconds	 ...[PASS]
2024/10/16 02:49:27 validating pipeline run build-deploy-pipelines-vote-ui-wkrg5 for success state...
2024/10/16 02:50:43 pipelineRun: build-deploy-pipelines-vote-ui-wkrg5 is successful under namespace : releasetest-fd4kg
      * Verify the latest pipelinerun for "successful" state	 ...[PASS]
2024/10/16 02:50:43 Route url: 'http://pipelines-vote-ui-releasetest-fd4kg.apps.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com'
      * Get route url of the route "pipelines-vote-ui"	 ...[PASS]
      * Wait for pipelines-vote-ui deployment	 ...[PASS]
2024/10/16 02:50:53 Cat 🐺 vs Dog 🐶!
(a) Cat 🐺 (b) Dog 🐶
(Tip: you can change your vote)
Processed by container ID pipelines-vote-ui-57dd5cd97-tpzvh
      * Validate route url for pipelines tutorial	 ...[PASS]
2024/10/16 02:51:13 output: project.project.openshift.io "releasetest-fd4kg" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_02.51.13/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 02.51.13

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	979.128s
Runner with PID:28153 has exited
Specifications:	4 executed	4 passed	0 failed	0 skipped
Scenarios:	10 executed	10 passed	0 failed	0 skipped

Total time taken: 16m19.033s
gauge run specs/metrics/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin html-report is already installed.
Plugin xml-report is already installed.
Plugin go is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/metrics/metrics.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 36595
Successfully made the connection with plugin with port: 36595
Starting Xml Report plugin
Attempting to connect to grpc server at port: 37933
Successfully made the connection with plugin with port: 37933
Initialising suite data store.
# Verify openshift pipelines monitoring
  ## Openshift pipelines metrics acceptance tests: PIPELINES-01-TC01	
2024/10/16 02:51:19 output: Now using project "releasetest-fz2bp" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:51:19 Waiting for operator to be up and running....
2024/10/16 02:51:19 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/10/16 02:51:19 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/10/16 02:51:24 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:51:25 Target Job: [node-exporter] ready/up status, Actual: [1], Expected: [1]
2024/10/16 02:51:25 Target Job: [kube-state-metrics] ready/up status, Actual: [1], Expected: [1]
2024/10/16 02:51:25 Target Job: [prometheus-k8s] ready/up status, Actual: [1], Expected: [1]
2024/10/16 02:51:25 Target Job: [prometheus-operator] ready/up status, Actual: [1], Expected: [1]
2024/10/16 02:51:25 Target Job: [alertmanager-main] ready/up status, Actual: [1], Expected: [1]
2024/10/16 02:51:25 Target Job: [tekton-pipelines-controller] ready/up status, Actual: [1], Expected: [1]
      * Verify job health status metrics 
      
         |S.NO|Job_name                   |Expected_value|
         |----|---------------------------|--------------|
         |1   |node-exporter              |1             |
         |2   |kube-state-metrics         |1             |
         |3   |prometheus-k8s             |1             |
         |4   |prometheus-operator        |1             |
         |5   |alertmanager-main          |1             |
         |6   |tekton-pipelines-controller|1             |	 ...[PASS]
      * Verify pipelines controlPlane metrics	 ...[PASS]
2024/10/16 02:51:33 output: project.project.openshift.io "releasetest-fz2bp" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_02.51.33/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 02.51.33

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	14.862s
Runner with PID:30759 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	1 executed	1 passed	0 failed	0 skipped

Total time taken: 14.787s
gauge run specs/operator/addon.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/operator/addon.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 44981
Successfully made the connection with plugin with port: 44981
Starting Xml Report plugin
Attempting to connect to grpc server at port: 39435
Successfully made the connection with plugin with port: 39435
Initialising suite data store.
# Verify Addon E2E spec
  ## Disable/Enable community clustertasks: PIPELINES-15-TC01	
2024/10/16 02:51:39 output: Now using project "releasetest-kq996" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:51:39 Waiting for operator to be up and running....
2024/10/16 02:51:39 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:51:39 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:51:39 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/10/16 02:51:44 Verifying if the clustertask jib-maven is present
2024/10/16 02:51:44 Clustertask jib-maven is present
2024/10/16 02:51:49 Verifying if the clustertask helm-upgrade-from-source is present
2024/10/16 02:51:49 Clustertask helm-upgrade-from-source is present
2024/10/16 02:51:54 Verifying if the clustertask helm-upgrade-from-repo is present
2024/10/16 02:51:54 Clustertask helm-upgrade-from-repo is present
2024/10/16 02:51:59 Verifying if the clustertask trigger-jenkins-job is present
2024/10/16 02:51:59 Clustertask trigger-jenkins-job is present
2024/10/16 02:52:04 Verifying if the clustertask git-cli is present
2024/10/16 02:52:04 Clustertask git-cli is present
2024/10/16 02:52:09 Verifying if the clustertask pull-request is present
2024/10/16 02:52:09 Clustertask pull-request is present
2024/10/16 02:52:14 Verifying if the clustertask kubeconfig-creator is present
2024/10/16 02:52:14 Clustertask kubeconfig-creator is present
2024/10/16 02:52:19 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/10/16 02:52:19 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/10/16 02:52:19 Checking if clustertasks tkn,openshift-client is/are present
2024/10/16 02:52:24 Verifying if the clustertask tkn is present
2024/10/16 02:52:24 Clustertask tkn is present
2024/10/16 02:52:29 Verifying if the clustertask openshift-client is present
2024/10/16 02:52:29 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/10/16 02:52:29 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "false" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:52:29 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are not present
2024/10/16 02:52:35 Verifying if the clustertask jib-maven is not present
2024/10/16 02:52:35 Clustertask jib-maven is not present
2024/10/16 02:52:40 Verifying if the clustertask helm-upgrade-from-source is not present
2024/10/16 02:52:40 Clustertask helm-upgrade-from-source is not present
2024/10/16 02:52:45 Verifying if the clustertask helm-upgrade-from-repo is not present
2024/10/16 02:52:45 Clustertask helm-upgrade-from-repo is not present
2024/10/16 02:52:50 Verifying if the clustertask trigger-jenkins-job is not present
2024/10/16 02:52:50 Clustertask trigger-jenkins-job is not present
2024/10/16 02:52:55 Verifying if the clustertask git-cli is not present
2024/10/16 02:52:55 Clustertask git-cli is not present
2024/10/16 02:53:00 Verifying if the clustertask pull-request is not present
2024/10/16 02:53:00 Clustertask pull-request is not present
2024/10/16 02:53:05 Verifying if the clustertask kubeconfig-creator is not present
2024/10/16 02:53:05 Clustertask kubeconfig-creator is not present
2024/10/16 02:53:10 Verifying if the clustertask argocd-task-sync-and-wait is not present
2024/10/16 02:53:10 Clustertask argocd-task-sync-and-wait is not present
      * "community" clustertasks are "not present"	 ...[PASS]
2024/10/16 02:53:10 Checking if clustertasks tkn,openshift-client is/are present
2024/10/16 02:53:15 Verifying if the clustertask tkn is present
2024/10/16 02:53:15 Clustertask tkn is present
2024/10/16 02:53:20 Verifying if the clustertask openshift-client is present
2024/10/16 02:53:20 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/10/16 02:53:20 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:53:20 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/10/16 02:53:25 Verifying if the clustertask jib-maven is present
2024/10/16 02:53:25 Clustertask jib-maven is present
2024/10/16 02:53:30 Verifying if the clustertask helm-upgrade-from-source is present
2024/10/16 02:53:30 Clustertask helm-upgrade-from-source is present
2024/10/16 02:53:35 Verifying if the clustertask helm-upgrade-from-repo is present
2024/10/16 02:53:35 Clustertask helm-upgrade-from-repo is present
2024/10/16 02:53:40 Verifying if the clustertask trigger-jenkins-job is present
2024/10/16 02:53:40 Clustertask trigger-jenkins-job is present
2024/10/16 02:53:45 Verifying if the clustertask git-cli is present
2024/10/16 02:53:45 Clustertask git-cli is present
2024/10/16 02:53:50 Verifying if the clustertask pull-request is present
2024/10/16 02:53:50 Clustertask pull-request is present
2024/10/16 02:53:55 Verifying if the clustertask kubeconfig-creator is present
2024/10/16 02:53:55 Clustertask kubeconfig-creator is present
2024/10/16 02:54:00 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/10/16 02:54:00 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/10/16 02:54:00 Checking if clustertasks tkn,openshift-client is/are present
2024/10/16 02:54:05 Verifying if the clustertask tkn is present
2024/10/16 02:54:05 Clustertask tkn is present
2024/10/16 02:54:10 Verifying if the clustertask openshift-client is present
2024/10/16 02:54:10 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/10/16 02:54:17 output: project.project.openshift.io "releasetest-kq996" deleted
  ## Disable/Enable clustertasks: PIPELINES-15-TC02	
2024/10/16 02:54:17 output: Now using project "releasetest-54qfr" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:54:18 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:54:18 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/10/16 02:54:23 Verifying if the clustertask jib-maven is present
2024/10/16 02:54:23 Clustertask jib-maven is present
2024/10/16 02:54:28 Verifying if the clustertask helm-upgrade-from-source is present
2024/10/16 02:54:28 Clustertask helm-upgrade-from-source is present
2024/10/16 02:54:33 Verifying if the clustertask helm-upgrade-from-repo is present
2024/10/16 02:54:33 Clustertask helm-upgrade-from-repo is present
2024/10/16 02:54:38 Verifying if the clustertask trigger-jenkins-job is present
2024/10/16 02:54:38 Clustertask trigger-jenkins-job is present
2024/10/16 02:54:43 Verifying if the clustertask git-cli is present
2024/10/16 02:54:43 Clustertask git-cli is present
2024/10/16 02:54:48 Verifying if the clustertask pull-request is present
2024/10/16 02:54:48 Clustertask pull-request is present
2024/10/16 02:54:53 Verifying if the clustertask kubeconfig-creator is present
2024/10/16 02:54:53 Clustertask kubeconfig-creator is present
2024/10/16 02:54:58 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/10/16 02:54:58 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/10/16 02:54:58 Checking if clustertasks tkn,openshift-client is/are present
2024/10/16 02:55:03 Verifying if the clustertask tkn is present
2024/10/16 02:55:03 Clustertask tkn is present
2024/10/16 02:55:08 Verifying if the clustertask openshift-client is present
2024/10/16 02:55:08 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/10/16 02:55:13 Verifying that 27 pipelines are present in namespace openshift
2024/10/16 02:55:13 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/10/16 02:55:13 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "false" communityClustertasks as "false" and pipelineTemplates as "false" and expect message ""	 ...[PASS]
2024/10/16 02:55:13 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are not present
2024/10/16 02:55:18 Verifying if the clustertask jib-maven is not present
2024/10/16 02:55:18 Clustertask jib-maven is not present
2024/10/16 02:55:23 Verifying if the clustertask helm-upgrade-from-source is not present
2024/10/16 02:55:23 Clustertask helm-upgrade-from-source is not present
2024/10/16 02:55:28 Verifying if the clustertask helm-upgrade-from-repo is not present
2024/10/16 02:55:28 Clustertask helm-upgrade-from-repo is not present
2024/10/16 02:55:33 Verifying if the clustertask trigger-jenkins-job is not present
2024/10/16 02:55:33 Clustertask trigger-jenkins-job is not present
2024/10/16 02:55:38 Verifying if the clustertask git-cli is not present
2024/10/16 02:55:38 Clustertask git-cli is not present
2024/10/16 02:55:43 Verifying if the clustertask pull-request is not present
2024/10/16 02:55:43 Clustertask pull-request is not present
2024/10/16 02:55:48 Verifying if the clustertask kubeconfig-creator is not present
2024/10/16 02:55:48 Clustertask kubeconfig-creator is not present
2024/10/16 02:55:53 Verifying if the clustertask argocd-task-sync-and-wait is not present
2024/10/16 02:55:53 Clustertask argocd-task-sync-and-wait is not present
      * "community" clustertasks are "not present"	 ...[PASS]
2024/10/16 02:55:53 Checking if clustertasks tkn,openshift-client is/are not present
2024/10/16 02:55:58 Verifying if the clustertask tkn is not present
2024/10/16 02:55:58 Clustertask tkn is not present
2024/10/16 02:56:03 Verifying if the clustertask openshift-client is not present
2024/10/16 02:56:03 Clustertask openshift-client is not present
      * "tkn,openshift-client" clustertasks are "not present"	 ...[PASS]
2024/10/16 02:56:08 Verifying if 0 pipelines are not present in namespace openshift
2024/10/16 02:56:08 Pipelines are present in namespace openshift
      * Assert pipelines are "not present" in "openshift" namespace	 ...[PASS]
2024/10/16 02:56:08 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:56:08 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/10/16 02:56:13 Verifying if the clustertask jib-maven is present
2024/10/16 02:56:13 Clustertask jib-maven is present
2024/10/16 02:56:18 Verifying if the clustertask helm-upgrade-from-source is present
2024/10/16 02:56:18 Clustertask helm-upgrade-from-source is present
2024/10/16 02:56:23 Verifying if the clustertask helm-upgrade-from-repo is present
2024/10/16 02:56:23 Clustertask helm-upgrade-from-repo is present
2024/10/16 02:56:28 Verifying if the clustertask trigger-jenkins-job is present
2024/10/16 02:56:28 Clustertask trigger-jenkins-job is present
2024/10/16 02:56:33 Verifying if the clustertask git-cli is present
2024/10/16 02:56:33 Clustertask git-cli is present
2024/10/16 02:56:38 Verifying if the clustertask pull-request is present
2024/10/16 02:56:38 Clustertask pull-request is present
2024/10/16 02:56:43 Verifying if the clustertask kubeconfig-creator is present
2024/10/16 02:56:43 Clustertask kubeconfig-creator is present
2024/10/16 02:56:48 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/10/16 02:56:49 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/10/16 02:56:49 Checking if clustertasks tkn,openshift-client is/are present
2024/10/16 02:56:54 Verifying if the clustertask tkn is present
2024/10/16 02:56:54 Clustertask tkn is present
2024/10/16 02:56:59 Verifying if the clustertask openshift-client is present
2024/10/16 02:56:59 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/10/16 02:57:04 Verifying that 27 pipelines are present in namespace openshift
2024/10/16 02:57:04 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/10/16 02:57:12 output: project.project.openshift.io "releasetest-54qfr" deleted
  ## Disable/Enable pipeline templates: PIPELINES-15-TC03	
2024/10/16 02:57:12 output: Now using project "releasetest-plsht" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:57:12 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:57:17 Verifying that 27 pipelines are present in namespace openshift
2024/10/16 02:57:17 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/10/16 02:57:17 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "false" and expect message ""	 ...[PASS]
2024/10/16 02:57:22 Verifying if 0 pipelines are not present in namespace openshift
2024/10/16 02:57:22 Pipelines are present in namespace openshift
      * Assert pipelines are "not present" in "openshift" namespace	 ...[PASS]
2024/10/16 02:57:22 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/10/16 02:57:27 Verifying that 27 pipelines are present in namespace openshift
2024/10/16 02:57:27 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/10/16 02:57:34 output: project.project.openshift.io "releasetest-plsht" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_02.57.34/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 02.57.34

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	356.202s
Runner with PID:31310 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	3 executed	3 passed	0 failed	0 skipped

Total time taken: 5m56.111s
gauge run specs/operator/auto-prune.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/operator/auto-prune.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 44583
Successfully made the connection with plugin with port: 44583
Starting Xml Report plugin
Attempting to connect to grpc server at port: 40089
Successfully made the connection with plugin with port: 40089
Initialising suite data store.
# Verify auto-prune E2E
2024/10/16 02:57:39 output: Now using project "releasetest-qd8mt" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:57:39 Annotating the namespaces with 'operator.tekton.dev/prune.skip=true' so that the pipelineruns should not get deleted
2024/10/16 02:57:40 output: namespace/openshift annotated
2024/10/16 02:57:40 output: namespace/releasetest-qd8mt annotated
  ## Verify auto prune for taskrun: PIPELINES-12-TC01	
2024/10/16 02:57:40 output: Now using project "releasetest-cqs4s" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 02:57:40 Waiting for operator to be up and running....
2024/10/16 02:57:40 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/10/16 02:57:40 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/10/16 02:57:45 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:57:45 Verify SA "pipeline" is created in namespace "releasetest-cqs4s"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:57:45 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/10/16 02:57:46 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/10/16 02:57:46 output: pipelinerun.tekton.dev/echo-pipeline-run-94pcq created
pipelinerun.tekton.dev/echo-pipeline-run-fr7mt created
pipelinerun.tekton.dev/echo-pipeline-run-mn5l2 created
pipelinerun.tekton.dev/echo-pipeline-run-dvcdk created
pipelinerun.tekton.dev/echo-pipeline-run-z6d4m created
2024/10/16 02:57:46 output: task.tekton.dev/echo-task created
2024/10/16 02:57:46 output: taskrun.tekton.dev/echo-task-run-5cnc2 created
taskrun.tekton.dev/echo-task-run-f9ftg created
taskrun.tekton.dev/echo-task-run-fzktq created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
taskrun.tekton.dev/echo-task-run-6tbr2 created
taskrun.tekton.dev/echo-task-run-dr6jq created
2024/10/16 02:57:46 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "*/1 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/10/16 02:57:46 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 02:57:51 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 02:57:52 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/10/16 02:57:52 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[FAIL]
        
        Failed Step: "2" taskrun(s) should be present within "120" seconds
        Specification: specs/operator/auto-prune.spec:30
        Error Message: Error: Expected 2 number of taskruns but found 10 number of taskruns
        Stacktrace: 
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/testing.go:46
        github.com/openshift-pipelines/release-tests/pkg/pipelines.AssertNumberOfTaskruns(0xc000532000, {0xc000746330?, 0x379b709?}, {0x517ed90, 0x1}, {0xc000974ea0, 0x3})
        	/tmp/release-tests/pkg/pipelines/pipelines.go:321 +0x273
        github.com/openshift-pipelines/release-tests/steps/pipeline.init.func7({0x517ed90, 0x1}, {0xc000974ea0, 0x3})
        	/tmp/release-tests/steps/pipeline/pipeline.go:50 +0xd1
        reflect.Value.call({0x324a980?, 0x3906588?, 0x1c0?}, {0x3793271, 0x4}, {0xc000752930, 0x2, 0xc0008d2380?})
        	/usr/lib/golang/src/reflect/value.go:596 +0xca6
        reflect.Value.Call({0x324a980?, 0x3906588?, 0x20?}, {0xc000752930?, 0x528f601?, 0xc000ab8510?})
        	/usr/lib/golang/src/reflect/value.go:380 +0xb9
        github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x324a980?, 0x3906588?, 0x4?}, {0xc00083ef60, 0x2, 0x7c?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/funcExecutor.go:47 +0x235
        github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc00061bda0?, {0xc00083ef60?, 0x31?, 0x7f?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/step.go:17 +0x8c
        github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x33bda40?, 0xc0001cd590, 0xc000000007?)
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/messageprocessors/ExecuteStepProcessor.go:20 +0xa6
        github.com/getgauge-contrib/gauge-go/gauge.Run()
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/gauge/runner.go:219 +0x227
        command-line-arguments.init.0()
        	/tmp/gauge_temp1729047455604364984/gauge_test.go:34 +0xf
        
2024/10/16 02:59:52 Skipping deletion of the namespace 'releasetest-cqs4s' as the test got failed
  ## Verify auto prune with keep-since: PIPELINES-12-TC04	
2024/10/16 02:59:52 output: Now using project "releasetest-mw2qk" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 02:59:52 Verify SA "pipeline" is created in namespace "releasetest-mw2qk"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 02:59:57 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/10/16 02:59:57 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/10/16 02:59:58 output: pipelinerun.tekton.dev/echo-pipeline-run-x2ttp created
pipelinerun.tekton.dev/echo-pipeline-run-gkfgp created
pipelinerun.tekton.dev/echo-pipeline-run-2444z created
pipelinerun.tekton.dev/echo-pipeline-run-xhpvq created
pipelinerun.tekton.dev/echo-pipeline-run-ctblq created
2024/10/16 02:59:58 output: task.tekton.dev/echo-task created
2024/10/16 02:59:58 output: taskrun.tekton.dev/echo-task-run-wwpl8 created
taskrun.tekton.dev/echo-task-run-jdvr6 created
taskrun.tekton.dev/echo-task-run-lps9d created
taskrun.tekton.dev/echo-task-run-5qrlq created
taskrun.tekton.dev/echo-task-run-5pntf created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/10/16 02:59:58 Sleeping for 120 seconds
      * Sleep for "120" seconds	 ...[PASS]
2024/10/16 03:01:58 output: pipelinerun.tekton.dev/echo-pipeline-run-9mm75 created
pipelinerun.tekton.dev/echo-pipeline-run-prb79 created
pipelinerun.tekton.dev/echo-pipeline-run-qt6dc created
pipelinerun.tekton.dev/echo-pipeline-run-6pdhp created
pipelinerun.tekton.dev/echo-pipeline-run-nkfsx created
2024/10/16 03:01:59 output: taskrun.tekton.dev/echo-task-run-vch94 created
taskrun.tekton.dev/echo-task-run-cf7ct created
taskrun.tekton.dev/echo-task-run-2xsc7 created
taskrun.tekton.dev/echo-task-run-x8g27 created
taskrun.tekton.dev/echo-task-run-n7zmk created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |2   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/10/16 03:01:59 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "without" keep "" schedule "*/1 * * * *" resources "pipelinerun,taskrun" and "with" keep-since "2"	 ...[PASS]
2024/10/16 03:01:59 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:02:04 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:02:04 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/10/16 03:02:04 Verifying if 5 number of pipelinerun are present
      * "5" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/10/16 03:03:04 Verifying if 10 number of taskruns are present
      * "10" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/10/16 03:03:09 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/10/16 03:03:09 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/10/16 03:03:14 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:03:14 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/10/16 03:03:34 output: project.project.openshift.io "releasetest-mw2qk" deleted
  ## Verify auto prune add resources taskrun and pipelinerun per namespace with annotation: PIPELINES-12-TC07	
2024/10/16 03:03:34 output: Now using project "releasetest-4748q" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 03:03:35 Verify SA "pipeline" is created in namespace "releasetest-4748q"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 03:03:40 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/10/16 03:03:40 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/10/16 03:03:40 output: pipelinerun.tekton.dev/echo-pipeline-run-vbcdh created
pipelinerun.tekton.dev/echo-pipeline-run-gqbd5 created
pipelinerun.tekton.dev/echo-pipeline-run-47gzt created
pipelinerun.tekton.dev/echo-pipeline-run-rrbw8 created
pipelinerun.tekton.dev/echo-pipeline-run-m28p4 created
2024/10/16 03:03:40 output: task.tekton.dev/echo-task created
2024/10/16 03:03:41 output: taskrun.tekton.dev/echo-task-run-j62n2 created
taskrun.tekton.dev/echo-task-run-xprbd created
taskrun.tekton.dev/echo-task-run-scmzn created
taskrun.tekton.dev/echo-task-run-sc8gx created
taskrun.tekton.dev/echo-task-run-9xkq5 created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/10/16 03:03:41 Annotating namespace releasetest-4748q with operator.tekton.dev/prune.resources=pipelinerun,taskrun
2024/10/16 03:03:41 output: namespace/releasetest-4748q annotated
      * Annotate namespace with "operator.tekton.dev/prune.resources=pipelinerun,taskrun"	 ...[PASS]
2024/10/16 03:03:41 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "*/1 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/10/16 03:03:41 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:03:46 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:03:46 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/10/16 03:03:46 Verifying if 2 number of pipelinerun are present
      * "2" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/10/16 03:04:01 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[FAIL]
2024/10/16 03:06:01 Skipping deletion of the namespace 'releasetest-4748q' as the test got failed
        
        Failed Step: "2" taskrun(s) should be present within "120" seconds
        Specification: specs/operator/auto-prune.spec:208
        Error Message: Error: Expected 2 number of taskruns but found 10 number of taskruns
        Stacktrace: 
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/testing.go:46
        github.com/openshift-pipelines/release-tests/pkg/pipelines.AssertNumberOfTaskruns(0xc00003a000, {0xc000962000?, 0x379b709?}, {0x517ed90, 0x1}, {0xc00059b920, 0x3})
        	/tmp/release-tests/pkg/pipelines/pipelines.go:321 +0x273
        github.com/openshift-pipelines/release-tests/steps/pipeline.init.func7({0x517ed90, 0x1}, {0xc00059b920, 0x3})
        	/tmp/release-tests/steps/pipeline/pipeline.go:50 +0xd1
        reflect.Value.call({0x324a980?, 0x3906588?, 0x1c0?}, {0x3793271, 0x4}, {0xc0008430b0, 0x2, 0xc000855dc0?})
        	/usr/lib/golang/src/reflect/value.go:596 +0xca6
        reflect.Value.Call({0x324a980?, 0x3906588?, 0x20?}, {0xc0008430b0?, 0x528f601?, 0xc0002f3f50?})
        	/usr/lib/golang/src/reflect/value.go:380 +0xb9
        github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x324a980?, 0x3906588?, 0x4?}, {0xc0008a5f40, 0x2, 0x7c?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/funcExecutor.go:47 +0x235
        github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc00061bda0?, {0xc0008a5f40?, 0x31?, 0x7f?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/step.go:17 +0x8c
        github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x33bda40?, 0xc00089cff0, 0xc000000007?)
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/messageprocessors/ExecuteStepProcessor.go:20 +0xa6
        github.com/getgauge-contrib/gauge-go/gauge.Run()
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/gauge/runner.go:219 +0x227
        command-line-arguments.init.0()
        	/tmp/gauge_temp1729047455604364984/gauge_test.go:34 +0xf
        
  ## Verify auto prune cronjob contains single container: PIPELINES-12-TC14	
2024/10/16 03:06:01 output: Now using project "releasetest-pfx2z" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 03:06:02 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "20 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/10/16 03:06:02 Check if project test-project-1 already exists
2024/10/16 03:06:02 Creating project test-project-1
2024/10/16 03:06:02 output: Now using project "test-project-1" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "test-project-1"	 ...[PASS]
2024/10/16 03:06:02 Check if project test-project-2 already exists
2024/10/16 03:06:02 Creating project test-project-2
2024/10/16 03:06:03 output: Now using project "test-project-2" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "test-project-2"	 ...[PASS]
2024/10/16 03:06:03 Sleeping for 10 seconds
      * Sleep for "10" seconds	 ...[PASS]
2024/10/16 03:06:13 Verifying if the cronjob with prefix tekton-resource-pruner in namespace openshift-pipelines contains 1 number of containers
2024/10/16 03:06:13 1 containers found in the cronjob spec
      * Assert pruner cronjob(s) in namespace "target namespace" contains "1" number of container(s)	 ...[PASS]
2024/10/16 03:06:13 Deleting project test-project-1
2024/10/16 03:06:19 output: project.project.openshift.io "test-project-1" deleted
      * Delete project "test-project-1"	 ...[PASS]
2024/10/16 03:06:19 Deleting project test-project-2
2024/10/16 03:06:27 output: project.project.openshift.io "test-project-2" deleted
      * Delete project "test-project-2"	 ...[PASS]
2024/10/16 03:06:27 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/10/16 03:06:34 output: project.project.openshift.io "releasetest-pfx2z" deleted
  ## Verify that the operator is up and running after deleting namespace with pruner annotation: PIPELINES-12-TC15	
2024/10/16 03:06:34 output: Now using project "releasetest-dqspk" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 03:06:34 Verify SA "pipeline" is created in namespace "releasetest-dqspk"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/10/16 03:06:39 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/10/16 03:06:39 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/10/16 03:06:44 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:06:44 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/10/16 03:06:44 output: namespace/namespace-one created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pruner/namespaces/namespace-one.yaml|	 ...[PASS]
2024/10/16 03:06:44 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:06:49 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:06:49 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/10/16 03:06:49 Deleting project namespace-one
2024/10/16 03:06:57 output: project.project.openshift.io "namespace-one" deleted
      * Delete project "namespace-one"	 ...[PASS]
2024/10/16 03:06:57 Sleeping for 5 seconds
      * Sleep for "5" seconds	 ...[PASS]
2024/10/16 03:07:02 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/10/16 03:07:07 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:07:07 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 03:07:07 output: namespace/namespace-two created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pruner/namespaces/namespace-two.yaml|	 ...[PASS]
2024/10/16 03:07:07 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:07:12 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:07:12 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/10/16 03:07:12 Deleting project namespace-two
2024/10/16 03:07:18 output: project.project.openshift.io "namespace-two" deleted
      * Delete project "namespace-two"	 ...[PASS]
2024/10/16 03:07:19 Sleeping for 5 seconds
      * Sleep for "5" seconds	 ...[PASS]
2024/10/16 03:07:24 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/10/16 03:07:29 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/10/16 03:07:29 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/10/16 03:07:36 output: project.project.openshift.io "releasetest-dqspk" deleted
2024/10/16 03:07:36 output: tektonconfig.operator.tekton.dev/config patched

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_03.07.36/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 03.07.36

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	597.577s
Runner with PID:32073 has exited
Specifications:	1 executed	0 passed	1 failed	0 skipped
Scenarios:	5 executed	3 passed	2 failed	0 skipped

Total time taken: 9m57.498s
gauge run specs/operator/rbac.spec
log-level : [debug]
tags : [sanity]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity
The following specifications satisfy filter criteria:
specs/operator/rbac.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 41319
Successfully made the connection with plugin with port: 41319
Starting Xml Report plugin
Attempting to connect to grpc server at port: 35397
Successfully made the connection with plugin with port: 35397
Initialising suite data store.
# Verify RBAC Resources
  ## Disable RBAC resource creation: PIPELINES-11-TC01	
2024/10/16 03:07:41 output: Now using project "releasetest-c9k6x" on server "https://api.ci-op-s0fxnwx4-b99dc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/10/16 03:07:41 Waiting for operator to be up and running....
2024/10/16 03:07:41 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/10/16 03:07:41 enable auto creation of RBAC resources
2024/10/16 03:07:41 output: tektonconfig.operator.tekton.dev/config patched (no change)
      * Update TektonConfig CR to use param with name createRbacResource and value "true" to "enable" auto creation of RBAC resources	 ...[PASS]
2024/10/16 03:07:41 Verifying that TektonConfig status is "installed"
2024/10/16 03:07:41 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/10/16 03:07:41 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/10/16 03:07:51 Verifying that service account pipeline exists
2024/10/16 03:07:56 Verifying that cluster role pipelines-scc-clusterrole exists
2024/10/16 03:08:01 Verifying that config map config-service-cabundle exists
2024/10/16 03:08:06 Verifying that config map config-trusted-cabundle exists
2024/10/16 03:08:12 Verifying that role binding openshift-pipelines-edit exists
2024/10/16 03:08:17 Verifying that role binding pipelines-scc-rolebinding exists
2024/10/16 03:08:22 Verifying that security context constraint pipelines-scc exists
      * Verify RBAC resources are auto created successfully	 ...[PASS]
2024/10/16 03:08:22 disable auto creation of RBAC resources
2024/10/16 03:08:22 output: tektonconfig.operator.tekton.dev/config patched
      * Update TektonConfig CR to use param with name createRbacResource and value "false" to "disable" auto creation of RBAC resources	 ...[PASS]
2024/10/16 03:08:27 Verifying that service account pipeline exists
2024/10/16 03:08:32 Verifying that cluster role pipelines-scc-clusterrole doesn't exist
2024/10/16 03:08:37 Verifying that config map config-service-cabundle doesn't exist
2024/10/16 03:08:42 Verifying that config map config-trusted-cabundle doesn't exist
2024/10/16 03:08:47 Verifying that role binding edit doesn't exist
2024/10/16 03:08:52 Verifying that role binding pipelines-scc-rolebinding doesn't exist
2024/10/16 03:08:57 Verifying that security context constraint pipelines-scc doesn't exist
      * Verify RBAC resources disabled successfully	 ...[PASS]
2024/10/16 03:08:57 enable auto creation of RBAC resources
2024/10/16 03:08:57 output: tektonconfig.operator.tekton.dev/config patched
      * Update TektonConfig CR to use param with name createRbacResource and value "true" to "enable" auto creation of RBAC resources	 ...[PASS]
2024/10/16 03:08:57 Verifying that TektonConfig status is "installed"
2024/10/16 03:09:02 Verifying that service account pipeline exists
2024/10/16 03:09:07 Verifying that cluster role pipelines-scc-clusterrole exists
2024/10/16 03:09:12 Verifying that config map config-service-cabundle exists
2024/10/16 03:09:17 Verifying that config map config-trusted-cabundle exists
2024/10/16 03:09:22 Verifying that role binding openshift-pipelines-edit exists
2024/10/16 03:09:27 Verifying that role binding pipelines-scc-rolebinding exists
2024/10/16 03:09:32 Verifying that security context constraint pipelines-scc exists
      * Verify RBAC resources are auto created successfully	 ...[PASS]
2024/10/16 03:09:39 output: project.project.openshift.io "releasetest-c9k6x" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-10-16_03.09.39/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-10-16 03.09.39

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	118.948s
Runner with PID:33487 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	1 executed	1 passed	0 failed	0 skipped

Total time taken: 1m58.878s
Rename xml files to junit_test_*.xml