WARNING: Using insecure TLS client config. Setting this option is not supported!

Login successful.

You have access to 71 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
Running gauge specs
gauge run specs/clustertasks/clustertask-s2i.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Compatible version of plugin go not found. Installing plugin go...
Gathering metadata for go
Downloading https://downloads.gauge.org/plugin/go?l=go&p=&o=linux&a=amd64
Downloading https://github.com/getgauge-contrib/gauge-go/releases/download/v0.4.0/gauge-go-0.4.0-linux.x86_64.zip
.......................
Running plugin hook command => [go install github.com/go-delve/delve/cmd/dlv@latest]
go: downloading github.com/go-delve/delve v1.23.0
go: downloading github.com/sirupsen/logrus v1.9.3
go: downloading github.com/mattn/go-isatty v0.0.20
go: downloading github.com/spf13/cobra v1.7.0
go: downloading github.com/spf13/pflag v1.0.5
go: downloading gopkg.in/yaml.v3 v3.0.1
go: downloading github.com/google/go-dap v0.12.0
go: downloading github.com/cosiner/argv v0.1.0
go: downloading github.com/derekparker/trie v0.0.0-20230829180723-39f4de51ef7d
go: downloading github.com/go-delve/liner v1.2.3-0.20231231155935-4726ab1d7f62
go: downloading github.com/hashicorp/golang-lru v1.0.2
go: downloading golang.org/x/arch v0.6.0
go: downloading go.starlark.net v0.0.0-20231101134539-556fd59b42f6
go: downloading golang.org/x/sys v0.17.0
go: downloading github.com/cilium/ebpf v0.11.0
go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2
go: downloading github.com/russross/blackfriday/v2 v2.1.0
go: downloading github.com/mattn/go-runewidth v0.0.13
go: downloading github.com/rivo/uniseg v0.2.0
go: downloading golang.org/x/exp v0.0.0-20230224173230-c95f2b4c22f2
Running plugin hook command => [go install github.com/getgauge-contrib/gauge-go@latest]
go: downloading github.com/getgauge-contrib/gauge-go v0.4.0
go: downloading github.com/getgauge/common v0.0.0-20211105093448-e0aee1ccb217
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/protobuf v1.31.0
go: downloading github.com/dmotylev/goproperties v0.0.0-20140630191356-7cbffbaada47
Installing plugin go 0.4.0
Successfully installed plugin 'go' version 0.4.0
Compatible version of plugin html-report not found. Installing plugin html-report...
Gathering metadata for html-report
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go&o=linux&a=amd64
Downloading https://github.com/getgauge/html-report/releases/download/v4.3.1/html-report-4.3.1-linux.x86_64.zip
.......................
Installing plugin html-report 4.3.1
Successfully installed plugin 'html-report' version 4.3.1
Compatible version of plugin xml-report not found. Installing plugin xml-report...
Gathering metadata for xml-report
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report&o=linux&a=amd64
Downloading https://github.com/getgauge/xml-report/releases/download/v0.5.1/xml-report-0.5.1-linux.x86_64.zip
........................
Installing plugin xml-report 0.5.1
Successfully installed plugin 'xml-report' version 0.5.1
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/clustertasks/clustertask-s2i.spec
Parsing completed.
Starting go runner
go: downloading gotest.tools/v3 v3.5.1
go: downloading github.com/openshift-pipelines/manual-approval-gate v0.2.2
go: downloading github.com/openshift/client-go v0.0.0-20240422164335-6c851f4919dd
go: downloading k8s.io/apimachinery v0.28.9
go: downloading go.opencensus.io v0.24.0
go: downloading github.com/tektoncd/operator v0.71.0
go: downloading github.com/operator-framework/operator-lifecycle-manager v0.22.0
go: downloading github.com/tektoncd/cli v0.37.0
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
go: downloading k8s.io/api v0.28.9
go: downloading github.com/operator-framework/api v0.16.0
go: downloading github.com/openshift/api v0.0.0-20240422085825-2624175e9673
go: downloading github.com/pkg/errors v0.9.1
go: downloading knative.dev/pkg v0.0.0-20240116073220-b488e7be5902
go: downloading github.com/prometheus/client_golang v1.19.0
go: downloading github.com/tektoncd/pipeline v0.59.0
go: downloading github.com/prometheus/common v0.52.2
go: downloading github.com/google/go-cmp v0.6.0
go: downloading github.com/tektoncd/triggers v0.27.0
go: downloading k8s.io/client-go v0.28.9
go: downloading github.com/golang/protobuf v1.5.4
go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
go: downloading github.com/gogo/protobuf v1.3.2
go: downloading github.com/google/gofuzz v1.2.0
go: downloading k8s.io/utils v0.0.0-20240310230437-4693a0247e57
go: downloading go.uber.org/zap v1.27.0
go: downloading github.com/manifestival/manifestival v0.7.2
go: downloading github.com/openshift-pipelines/pipelines-as-code v0.27.0
go: downloading github.com/json-iterator/go v1.1.12
go: downloading github.com/fatih/color v1.16.0
go: downloading github.com/jonboulle/clockwork v0.4.0
go: downloading github.com/AlecAivazis/survey/v2 v2.3.7
go: downloading github.com/ktr0731/go-fuzzyfinder v0.8.0
go: downloading github.com/spf13/cobra v1.8.0
go: downloading go.uber.org/multierr v1.11.0
go: downloading k8s.io/cli-runtime v0.28.9
go: downloading sigs.k8s.io/yaml v1.4.0
go: downloading github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc
go: downloading k8s.io/klog/v2 v2.120.1
go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.4.1
go: downloading github.com/prometheus/client_model v0.6.1
go: downloading google.golang.org/protobuf v1.33.0
go: downloading github.com/imdario/mergo v0.3.16
go: downloading golang.org/x/term v0.20.0
go: downloading golang.org/x/net v0.24.0
go: downloading github.com/google/gnostic-models v0.6.9-0.20230804172637-c7be7c783f49
go: downloading github.com/blang/semver/v4 v4.0.0
go: downloading golang.org/x/sys v0.20.0
go: downloading gopkg.in/inf.v0 v0.9.1
go: downloading github.com/evanphx/json-patch/v5 v5.9.0
go: downloading github.com/go-logr/logr v1.4.1
go: downloading github.com/openshift/apiserver-library-go v0.0.0-20230816171015-6bfafa975bfb
go: downloading golang.org/x/xerrors v0.0.0-20231012003039-104605ab7028
go: downloading knative.dev/eventing v0.40.3
go: downloading github.com/cloudevents/sdk-go/v2 v2.15.2
go: downloading github.com/google/uuid v1.6.0
go: downloading github.com/blendle/zapdriver v1.3.1
go: downloading golang.org/x/sync v0.7.0
go: downloading github.com/evanphx/json-patch v5.9.0+incompatible
go: downloading golang.org/x/time v0.5.0
go: downloading github.com/tidwall/sjson v1.2.4
go: downloading github.com/mattn/go-colorable v0.1.13
go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: downloading github.com/modern-go/reflect2 v1.0.2
go: downloading github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
go: downloading golang.org/x/text v0.15.0
go: downloading github.com/hako/durafmt v0.0.0-20210608085754-5c1018a4e16b
go: downloading github.com/google/cel-go v0.20.1
go: downloading golang.org/x/exp v0.0.0-20240325151524-a685a6edb6d8
go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9
go: downloading github.com/google/go-containerregistry v0.19.1
go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
go: downloading github.com/gdamore/tcell/v2 v2.6.0
go: downloading github.com/ktr0731/go-ansisgr v0.1.0
go: downloading github.com/mattn/go-runewidth v0.0.15
go: downloading github.com/nsf/termbox-go v1.1.1
go: downloading golang.org/x/oauth2 v0.19.0
go: downloading gopkg.in/yaml.v2 v2.4.0
go: downloading google.golang.org/grpc v1.63.2
go: downloading k8s.io/apiextensions-apiserver v0.28.9
go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0
go: downloading github.com/kelseyhightower/envconfig v1.4.0
go: downloading contrib.go.opencensus.io/exporter/ocagent v0.7.1-0.20200907061046-05415f1de66d
go: downloading contrib.go.opencensus.io/exporter/prometheus v0.4.2
go: downloading github.com/tidwall/gjson v1.12.1
go: downloading github.com/mgutz/ansi v0.0.0-20200706080929-d51e80ef957d
go: downloading sigs.k8s.io/controller-runtime v0.15.3
go: downloading github.com/hashicorp/go-multierror v1.1.1
go: downloading google.golang.org/genproto/googleapis/api v0.0.0-20240401170217-c3f982113cda
go: downloading github.com/gdamore/encoding v1.0.0
go: downloading github.com/lucasb-eyer/go-colorful v1.2.0
go: downloading github.com/opencontainers/go-digest v1.0.0
go: downloading github.com/emicklei/go-restful/v3 v3.12.0
go: downloading github.com/go-openapi/jsonreference v0.21.0
go: downloading github.com/go-openapi/swag v0.23.0
go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822
go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de
go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79
go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible
go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3
go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3
go: downloading github.com/rivo/uniseg v0.4.4
go: downloading github.com/tidwall/match v1.1.1
go: downloading github.com/tidwall/pretty v1.2.0
go: downloading github.com/stoewer/go-strcase v1.3.0
go: downloading github.com/antlr4-go/antlr/v4 v4.13.0
go: downloading github.com/prometheus/statsd_exporter v0.26.1
go: downloading github.com/census-instrumentation/opencensus-proto v0.4.1
go: downloading google.golang.org/api v0.172.0
go: downloading github.com/hashicorp/errwrap v1.1.0
go: downloading github.com/go-openapi/jsonpointer v0.21.0
go: downloading github.com/mailru/easyjson v0.7.7
go: downloading github.com/google/btree v1.1.2
go: downloading github.com/beorn7/perks v1.0.1
go: downloading github.com/cespare/xxhash/v2 v2.2.0
go: downloading github.com/prometheus/procfs v0.13.0
go: downloading github.com/go-kit/log v0.2.1
go: downloading github.com/grpc-ecosystem/grpc-gateway/v2 v2.19.1
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20240401170217-c3f982113cda
go: downloading github.com/go-logfmt/logfmt v0.6.0
go: downloading github.com/josharian/intern v1.0.0
go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510
go: downloading github.com/go-errors/errors v1.4.2
go: downloading github.com/xlab/treeprint v1.2.0
go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00
go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Attempting to connect to grpc server at port: 46177
Successfully made the connection with plugin with port: 46177
Starting Xml Report plugin
Attempting to connect to grpc server at port: 34907
Successfully made the connection with plugin with port: 34907
Initialising suite data store.
# Verify Clustertasks E2E spec
  ## S2I nodejs pipelinerun: PIPELINES-14-TC01	
2024/09/02 07:24:59 output: Now using project "releasetest-c2mxl" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:25:00 Waiting for operator to be up and running....
2024/09/02 07:25:00 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:25:00 Verify SA "pipeline" is created in namespace "releasetest-c2mxl"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:25:00 output: imagestream.image.openshift.io/nodejs-ex-git created
deploymentconfig.apps.openshift.io/nodejs-ex-git created
pipeline.tekton.dev/nodejs-ex-git created
pipelinerun.tekton.dev/nodejs-ex-git-pr created
      * Create 
      
         |S.NO|resource_dir                                            |
         |----|--------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/s2i-nodejs-pipelinerun.yaml|	 ...[PASS]
2024/09/02 07:25:00 validating pipeline run for success state...
2024/09/02 07:27:10 pipelineRun: nodejs-ex-git-pr is successful under namespace : releasetest-c2mxl
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_lable_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |nodejs-ex-git-pr |successful|no                     |	 ...[PASS]
2024/09/02 07:27:23 output: project.project.openshift.io "releasetest-c2mxl" deleted
  ## S2I java pipelinerun: PIPELINES-14-TC04	
2024/09/02 07:27:23 output: Now using project "releasetest-5mjpt" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:27:23 Verify SA "pipeline" is created in namespace "releasetest-5mjpt"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:27:28 output: pipeline.tekton.dev/s2i-java-pipeline created
2024/09/02 07:27:29 output: persistentvolumeclaim/shared-pvc created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/v1beta1/clustertask/pipelines/s2i-java.yaml|
         |2   |testdata/pvc/pvc.yaml                               |	 ...[PASS]
2024/09/02 07:27:29 Getting imagestream from the namespace openshift
      * Get tags of the imagestream "java" from namespace "openshift" and store to variable "java-tags"	 ...[PASS]
2024/09/02 07:27:29 Starting pipeline s2i-java-pipeline with param VERSION=11
2024/09/02 07:27:29 Pipelinerun s2i-java-pipeline-run-zcx64 started
2024/09/02 07:27:29 validating pipeline run for success state...
2024/09/02 07:29:04 pipelineRun: s2i-java-pipeline-run-zcx64 is successful under namespace : releasetest-5mjpt
2024/09/02 07:29:04 Starting pipeline s2i-java-pipeline with param VERSION=8
2024/09/02 07:29:04 Pipelinerun s2i-java-pipeline-run-9qh5m started
2024/09/02 07:29:04 validating pipeline run for success state...
2024/09/02 07:30:34 pipelineRun: s2i-java-pipeline-run-9qh5m is successful under namespace : releasetest-5mjpt
2024/09/02 07:30:34 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-el7
2024/09/02 07:30:34 Pipelinerun s2i-java-pipeline-run-mdj85 started
2024/09/02 07:30:34 validating pipeline run for success state...
2024/09/02 07:32:04 pipelineRun: s2i-java-pipeline-run-mdj85 is successful under namespace : releasetest-5mjpt
2024/09/02 07:32:04 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-11-ubi8
2024/09/02 07:32:05 Pipelinerun s2i-java-pipeline-run-2v8tz started
2024/09/02 07:32:05 validating pipeline run for success state...
2024/09/02 07:33:00 pipelineRun: s2i-java-pipeline-run-2v8tz is successful under namespace : releasetest-5mjpt
2024/09/02 07:33:00 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-17-ubi8
2024/09/02 07:33:00 Pipelinerun s2i-java-pipeline-run-s2qtt started
2024/09/02 07:33:00 validating pipeline run for success state...
2024/09/02 07:33:50 pipelineRun: s2i-java-pipeline-run-s2qtt is successful under namespace : releasetest-5mjpt
2024/09/02 07:33:50 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-el7
2024/09/02 07:33:50 Pipelinerun s2i-java-pipeline-run-fwxss started
2024/09/02 07:33:50 validating pipeline run for success state...
2024/09/02 07:35:15 pipelineRun: s2i-java-pipeline-run-fwxss is successful under namespace : releasetest-5mjpt
2024/09/02 07:35:15 Starting pipeline s2i-java-pipeline with param VERSION=openjdk-8-ubi8
2024/09/02 07:35:15 Pipelinerun s2i-java-pipeline-run-gnzqw started
2024/09/02 07:35:15 validating pipeline run for success state...
2024/09/02 07:36:20 pipelineRun: s2i-java-pipeline-run-gnzqw is successful under namespace : releasetest-5mjpt
      * Start and verify pipeline "s2i-java-pipeline" with param "VERSION" with values stored in variable "java-tags" with workspace "name=source,claimName=shared-pvc"	 ...[PASS]
2024/09/02 07:36:35 output: project.project.openshift.io "releasetest-5mjpt" deleted

Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 07.36.35

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_07.36.35/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	696.320s
Runner with PID:4131 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Total time taken: 11m36.206s
gauge run specs/clustertasks/clustertask.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/clustertasks/clustertask.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 34765
Successfully made the connection with plugin with port: 34765
Starting Xml Report plugin
Attempting to connect to grpc server at port: 45889
Successfully made the connection with plugin with port: 45889
Initialising suite data store.
# Verify Clustertasks E2E spec
  ## buildah pipelinerun: PIPELINES-16-TC01	
2024/09/02 07:36:40 output: Now using project "releasetest-n5jw9" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:36:40 Waiting for operator to be up and running....
2024/09/02 07:36:40 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:36:40 Verify SA "pipeline" is created in namespace "releasetest-n5jw9"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:36:40 output: pipeline.tekton.dev/buildah-pipeline created
2024/09/02 07:36:40 output: persistentvolumeclaim/shared-pvc created
2024/09/02 07:36:40 output: pipelinerun.tekton.dev/buildah-run created
      * Create 
      
         |S.NO|resource_dir                                     |
         |----|-------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelines/buildah.yaml   |
         |2   |testdata/pvc/pvc.yaml                            |
         |3   |testdata/v1/clustertask/pipelineruns/buildah.yaml|	 ...[PASS]
2024/09/02 07:36:40 validating pipeline run for success state...
2024/09/02 07:37:20 pipelineRun: buildah-run is successful under namespace : releasetest-n5jw9
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |buildah-run      |successful|no                     |	 ...[PASS]
2024/09/02 07:37:33 output: project.project.openshift.io "releasetest-n5jw9" deleted
  ## git-clone read private repo taskrun PIPELINES-16-TC12	
2024/09/02 07:37:33 output: Now using project "releasetest-zq4tn" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:37:33 Verify SA "pipeline" is created in namespace "releasetest-zq4tn"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:37:38 output: pipeline.tekton.dev/git-clone-read-private-pipeline created
2024/09/02 07:37:38 output: persistentvolumeclaim/shared-pvc created
2024/09/02 07:37:39 output: secret/ssh-key created
      * Create 
      
         |S.NO|resource_dir                                                 |
         |----|-------------------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelines/git-clone-read-private.yaml|
         |2   |testdata/pvc/pvc.yaml                                        |
         |3   |testdata/v1/clustertask/secrets/ssh-key.yaml                 |	 ...[PASS]
2024/09/02 07:37:39 output:
      * Link secret "ssh-key" to service account "pipeline"	 ...[PASS]
2024/09/02 07:37:39 output: pipelinerun.tekton.dev/git-clone-read-private-pipeline-run created
      * Create 
      
         |S.NO|resource_dir                                                    |
         |----|----------------------------------------------------------------|
         |1   |testdata/v1/clustertask/pipelineruns/git-clone-read-private.yaml|	 ...[PASS]
2024/09/02 07:37:39 validating pipeline run for success state...
2024/09/02 07:37:44 pipelineRun: git-clone-read-private-pipeline-run is successful under namespace : releasetest-zq4tn
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                  |status    |check_label_propagation|
         |----|-----------------------------------|----------|-----------------------|
         |1   |git-clone-read-private-pipeline-run|successful|no                     |	 ...[PASS]
2024/09/02 07:37:57 output: project.project.openshift.io "releasetest-zq4tn" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_07.37.57/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 07.37.57

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	77.855s
Runner with PID:27063 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	2 executed	2 passed	0 failed	0 skipped

Total time taken: 1m17.745s
gauge run specs/pipelines/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
6 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/pipelines/bundles-resolver.spec
specs/pipelines/cluster-resolvers.spec
specs/pipelines/fail.spec
specs/pipelines/git-resolvers.spec
specs/pipelines/hub-resolvers.spec
specs/pipelines/run.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 44059
Successfully made the connection with plugin with port: 44059
Starting Xml Report plugin
Attempting to connect to grpc server at port: 34467
Successfully made the connection with plugin with port: 34467
Initialising suite data store.
# Bundles resolver spec
  ## Test the functionality of bundles resolver with parameter: PIPELINES-25-TC02	
2024/09/02 07:38:04 output: Now using project "releasetest-rqtcn" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:38:05 Waiting for operator to be up and running....
2024/09/02 07:38:05 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:38:05 Verify SA "pipeline" is created in namespace "releasetest-rqtcn"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:38:05 output: pipelinerun.tekton.dev/bundles-resolver-pipelinerun-param created
      * Create 
      
         |S.NO|resource_dir                                                           |
         |----|-----------------------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/bundles-resolver-pipelinerun-param.yaml|	 ...[PASS]
2024/09/02 07:38:05 validating pipeline run for success state...
2024/09/02 07:38:25 pipelineRun: bundles-resolver-pipelinerun-param is successful under namespace : releasetest-rqtcn
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                 |status    |check_label_propagation|
         |----|----------------------------------|----------|-----------------------|
         |1   |bundles-resolver-pipelinerun-param|successful|no                     |	 ...[PASS]
2024/09/02 07:38:37 output: project.project.openshift.io "releasetest-rqtcn" deleted

# Cluster resolvers spec
  ## Checking the functionality of cluster resolvers#1: PIPELINES-23-TC01	
2024/09/02 07:38:37 output: Now using project "releasetest-ncr6d" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:38:37 Check if project releasetest-tasks already exists
2024/09/02 07:38:37 Creating project releasetest-tasks
2024/09/02 07:38:38 output: Now using project "releasetest-tasks" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-tasks"	 ...[PASS]
2024/09/02 07:38:38 output: task.tekton.dev/resolver-task2 created
      * Create 
      
         |S.NO|resource_dir                                |
         |----|--------------------------------------------|
         |1   |testdata/resolvers/tasks/resolver-task2.yaml|	 ...[PASS]
2024/09/02 07:38:38 Check if project releasetest-pipelines already exists
2024/09/02 07:38:38 Creating project releasetest-pipelines
2024/09/02 07:38:38 output: Now using project "releasetest-pipelines" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-pipelines"	 ...[PASS]
2024/09/02 07:38:39 output: pipeline.tekton.dev/resolver-pipeline created
      * Create 
      
         |S.NO|resource_dir                                       |
         |----|---------------------------------------------------|
         |1   |testdata/resolvers/pipelines/resolver-pipeline.yaml|	 ...[PASS]
2024/09/02 07:38:39 Check if project releasetest-pipelineruns already exists
2024/09/02 07:38:39 Creating project releasetest-pipelineruns
2024/09/02 07:38:39 output: Now using project "releasetest-pipelineruns" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "releasetest-pipelineruns"	 ...[PASS]
2024/09/02 07:38:39 Verify SA "pipeline" is created in namespace "releasetest-pipelineruns"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:38:44 output: pipelinerun.tekton.dev/resolver-pipelinerun created
      * Create 
      
         |S.NO|resource_dir                                             |
         |----|---------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/resolver-pipelinerun.yaml|	 ...[PASS]
2024/09/02 07:38:44 validating pipeline run for success state...
2024/09/02 07:38:54 pipelineRun: resolver-pipelinerun is successful under namespace : releasetest-pipelineruns
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name   |status    |check_label_propagation|
         |----|--------------------|----------|-----------------------|
         |1   |resolver-pipelinerun|successful|no                     |	 ...[PASS]
2024/09/02 07:38:54 Deleting project releasetest-tasks
2024/09/02 07:39:01 output: project.project.openshift.io "releasetest-tasks" deleted
      * Delete project "releasetest-tasks"	 ...[PASS]
2024/09/02 07:39:01 Deleting project releasetest-pipelines
2024/09/02 07:39:08 output: project.project.openshift.io "releasetest-pipelines" deleted
      * Delete project "releasetest-pipelines"	 ...[PASS]
2024/09/02 07:39:08 Deleting project releasetest-pipelineruns
2024/09/02 07:39:21 output: project.project.openshift.io "releasetest-pipelineruns" deleted
      * Delete project "releasetest-pipelineruns"	 ...[PASS]
2024/09/02 07:39:28 output: project.project.openshift.io "releasetest-ncr6d" deleted

# Verify Pipeline Failures
  ## Run Pipeline with a non-existent ServiceAccount: PIPELINES-02-TC01	
2024/09/02 07:39:29 output: Now using project "releasetest-cgwg8" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:39:29 Verify SA "foobar" is absent in namespace "releasetest-cgwg8"
      * Verify ServiceAccount "foobar" does not exist	 ...[PASS]
2024/09/02 07:39:29 output: task.tekton.dev/create-file-vb created
task.tekton.dev/check-stuff-file-exists-vb created
pipeline.tekton.dev/output-pipeline-vb created
pipelinerun.tekton.dev/output-pipeline-run-vb created
      * Create 
      
         |S.NO|resource_dir                              |
         |----|------------------------------------------|
         |1   |testdata/negative/v1beta1/pipelinerun.yaml|	 ...[PASS]
2024/09/02 07:39:29 validating pipeline run for failure state...
2024/09/02 07:39:29 Waiting for PipelineRun in namespace releasetest-cgwg8 to fail
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name     |status |check_label_propagation|
         |----|----------------------|-------|-----------------------|
         |1   |output-pipeline-run-vb|Failure|no                     |	 ...[PASS]
2024/09/02 07:39:46 output: project.project.openshift.io "releasetest-cgwg8" deleted

# Git resolvers spec
  ## Test the functionality of git resolvers: PIPELINES-24-TC01	
2024/09/02 07:39:47 output: Now using project "releasetest-7ctmg" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:39:47 Verify SA "pipeline" is created in namespace "releasetest-7ctmg"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:39:52 output: pipelinerun.tekton.dev/git-resolver-pipelinerun created
      * Create 
      
         |S.NO|resource_dir                                                 |
         |----|-------------------------------------------------------------|
         |1   |testdata/resolvers/pipelineruns/git-resolver-pipelinerun.yaml|	 ...[PASS]
2024/09/02 07:39:52 validating pipeline run for success state...
2024/09/02 07:40:02 pipelineRun: git-resolver-pipelinerun is successful under namespace : releasetest-7ctmg
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status    |check_label_propagation|
         |----|------------------------|----------|-----------------------|
         |1   |git-resolver-pipelinerun|successful|no                     |	 ...[PASS]
2024/09/02 07:40:14 output: project.project.openshift.io "releasetest-7ctmg" deleted

# HUB resolvers spec
  ## Test the functionality of hub resolvers	
2024/09/02 07:40:14 output: Now using project "releasetest-245kw" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:40:14 Verify SA "pipeline" is created in namespace "releasetest-245kw"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:40:16 output: pipeline.tekton.dev/hub-git-cli-pipeline created
2024/09/02 07:40:17 output: persistentvolumeclaim/shared-pvc created
2024/09/02 07:40:18 output: pipelinerun.tekton.dev/hub-git-cli-run created
      * Apply 
      
         |S.NO|resource_dir                                    |
         |----|------------------------------------------------|
         |1   |testdata/resolvers/pipelines/git-cli-hub.yaml   |
         |2   |testdata/pvc/pvc.yaml                           |
         |3   |testdata/resolvers/pipelineruns/git-cli-hub.yaml|	 ...[PASS]
2024/09/02 07:40:18 validating pipeline run for success state...
2024/09/02 07:40:43 pipelineRun: hub-git-cli-run is successful under namespace : releasetest-245kw
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |hub-git-cli-run  |successful|no                     |	 ...[PASS]
2024/09/02 07:40:56 output: project.project.openshift.io "releasetest-245kw" deleted

# Verify Pipeline E2E spec
  ## Pipelinerun Timeout failure Test: PIPELINES-03-TC04	
2024/09/02 07:40:57 output: Now using project "releasetest-psfkx" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:40:57 Verify SA "pipeline" is created in namespace "releasetest-psfkx"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:40:57 output: task.tekton.dev/banana created
pipeline.tekton.dev/tomatoes created
pipelinerun.tekton.dev/pear created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/pipelineruntimeout.yaml|	 ...[PASS]
2024/09/02 07:40:57 validating pipeline run timeout...
2024/09/02 07:40:57 Waiting for Pipelinerun pear in namespace releasetest-psfkx to be started
2024/09/02 07:41:02 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-psfkx to be running
2024/09/02 07:41:02 Waiting for PipelineRun pear in namespace releasetest-psfkx to be timed out
2024/09/02 07:41:07 Waiting for TaskRuns from PipelineRun pear in namespace releasetest-psfkx to be cancelled
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status |check_label_propagation|
         |----|-----------------|-------|-----------------------|
         |1   |pear             |timeout|no                     |	 ...[PASS]
2024/09/02 07:41:19 output: project.project.openshift.io "releasetest-psfkx" deleted
  ## Configure execution results at the Task level Test: PIPELINES-03-TC05	
2024/09/02 07:41:20 output: Now using project "releasetest-4vkgt" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:41:20 Verify SA "pipeline" is created in namespace "releasetest-4vkgt"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:41:25 output: pipeline.tekton.dev/sum-and-multiply-pipeline created
task.tekton.dev/sum created
task.tekton.dev/multiply created
pipelinerun.tekton.dev/task-level-results created
      * Create 
      
         |S.NO|resource_dir                                          |
         |----|------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/task_results_example.yaml|	 ...[PASS]
2024/09/02 07:41:25 validating pipeline run for success state...
2024/09/02 07:41:40 pipelineRun: task-level-results is successful under namespace : releasetest-4vkgt
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name |status    |check_label_propagation|
         |----|------------------|----------|-----------------------|
         |1   |task-level-results|successful|no                     |	 ...[PASS]
2024/09/02 07:41:52 output: project.project.openshift.io "releasetest-4vkgt" deleted
  ## Cancel pipelinerun Test: PIPELINES-03-TC06	
2024/09/02 07:41:52 output: Now using project "releasetest-n2lpv" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:41:52 Verify SA "pipeline" is created in namespace "releasetest-n2lpv"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:41:58 output: persistentvolumeclaim/shared-pvc created
2024/09/02 07:41:58 output: task.tekton.dev/create-file-v1b1 created
task.tekton.dev/check-file-exists-v1b1 created
pipeline.tekton.dev/output-pipeline-v1b1 created
pipelinerun.tekton.dev/output-pipeline-run-v1b1 created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pvc/pvc.yaml                        |
         |2   |testdata/v1beta1/pipelinerun/pipelinerun.yaml|	 ...[PASS]
2024/09/02 07:41:58 validating pipeline run timeout...
2024/09/02 07:41:58 Waiting for Pipelinerun output-pipeline-run-v1b1 in namespace releasetest-n2lpv to be started
2024/09/02 07:42:03 Canceling pipeline run: PipelineRun cancelled: output-pipeline-run-v1b1
2024/09/02 07:42:08 Waiting for TaskRuns in PipelineRun output-pipeline-run-v1b1 in namespace releasetest-n2lpv to be cancelled
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status   |check_label_propagation|
         |----|------------------------|---------|-----------------------|
         |1   |output-pipeline-run-v1b1|cancelled|no                     |	 ...[PASS]
2024/09/02 07:42:20 output: project.project.openshift.io "releasetest-n2lpv" deleted
  ## Pipelinerun with large result: PIPELINES-03-TC08	
2024/09/02 07:42:20 output: Now using project "releasetest-9jkj5" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:42:20 Verify SA "pipeline" is created in namespace "releasetest-9jkj5"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:42:25 output: task.tekton.dev/print-result created
task.tekton.dev/generate-result created
pipeline.tekton.dev/result-test created
pipelinerun.tekton.dev/result-test-run created
      * Create 
      
         |S.NO|resource_dir                                                   |
         |----|---------------------------------------------------------------|
         |1   |testdata/v1beta1/pipelinerun/pipelinerun-with-large-result.yaml|	 ...[PASS]
2024/09/02 07:42:25 validating pipeline run for success state...
2024/09/02 07:42:35 pipelineRun: result-test-run is successful under namespace : releasetest-9jkj5
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name|status    |check_label_propagation|
         |----|-----------------|----------|-----------------------|
         |1   |result-test-run  |successful|no                     |	 ...[PASS]
2024/09/02 07:42:48 output: project.project.openshift.io "releasetest-9jkj5" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_07.42.48/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 07.42.48

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	283.947s
Runner with PID:27751 has exited
Specifications:	6 executed	6 passed	0 failed	0 skipped
Scenarios:	9 executed	9 passed	0 failed	0 skipped

Total time taken: 4m43.851s
gauge run specs/triggers/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
4 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/triggers/cron.spec
specs/triggers/eventlistener.spec
specs/triggers/triggerbinding.spec
specs/triggers/tutorial.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 44903
Successfully made the connection with plugin with port: 44903
Starting Xml Report plugin
Attempting to connect to grpc server at port: 39997
Successfully made the connection with plugin with port: 39997
Initialising suite data store.
# Verify Triggers with cronjob
  ## Create Triggers using k8s cronJob: PIPELINES-04-TC01	
2024/09/02 07:42:53 output: Now using project "releasetest-bndlv" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:42:53 Waiting for operator to be up and running....
2024/09/02 07:42:53 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:42:54 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/09/02 07:42:54 output: triggerbinding.triggers.tekton.dev/cron-binding created
2024/09/02 07:42:54 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/09/02 07:42:54 output: eventlistener.triggers.tekton.dev/cron-listener created
      * Create 
      
         |S.NO|resource_dir                                |
         |----|--------------------------------------------|
         |1   |testdata/triggers/cron/example-pipeline.yaml|
         |2   |testdata/triggers/cron/triggerbinding.yaml  |
         |3   |testdata/triggers/cron/triggertemplate.yaml |
         |4   |testdata/triggers/cron/eventlistener.yaml   |	 ...[PASS]
2024/09/02 07:42:54 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:42:54 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:42:59 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:42:54 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:42:54 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:42:54 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-cron-listener-576dccc88" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:42:54 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:42:54 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0008b3d10 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/09/02 07:43:04 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:43:03 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:43:03 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:43:03 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cron-listener-576dccc88" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:43:03 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:43:03 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000a4a870 Addresses:[]} Configuration:{GeneratedResourceName:el-cron-listener}}
2024/09/02 07:43:04 sinkpod name: el-cron-listener-576dccc88-bcvz8
2024/09/02 07:43:05 Route url: 'http://el-cron-listener-releasetest-bndlv.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "cron-listener"	 ...[PASS]
2024/09/02 07:43:10 Verify that image stream "golang" exists in namespace "openshift"
      * Verify that image stream "golang" exists	 ...[PASS]
2024/09/02 07:43:10 Cronjob: hello created in namespace: releasetest-bndlv
      * Create cron job with schedule "*/1 * * * *"	 ...[PASS]
2024/09/02 07:44:01 pipeline run : simple-pipeline-run-9dk24
2024/09/02 07:45:01 pipeline run : simple-pipeline-run-6dntn
2024/09/02 07:46:01 pipeline run : simple-pipeline-run-n75gw
2024/09/02 07:47:01 pipeline run : simple-pipeline-run-668mg
2024/09/02 07:48:01 pipeline run : simple-pipeline-run-z7gkq
      * Watch for pipelinerun resources	 ...[PASS]
      * Delete cron job	 ...[PASS]
      * Assert no new pipelineruns created	 ...[PASS]
2024/09/02 07:49:10 Deleted EventListener
2024/09/02 07:49:15 EventListener's Deployment was deleted
2024/09/02 07:49:15 EventListener's Service was deleted
2024/09/02 07:49:15 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:49:30 output: project.project.openshift.io "releasetest-bndlv" deleted

# Verify eventlisteners spec
  ## Create Eventlistener embedded TriggersBindings specs: PIPELINES-05-TC08	
2024/09/02 07:49:30 output: Now using project "releasetest-xbtj2" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:49:30 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/09/02 07:49:30 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/09/02 07:49:30 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/09/02 07:49:31 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/sample-pipeline.yaml                             |
         |2   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |3   |testdata/triggers/triggertemplate/triggertemplate.yaml             |
         |4   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/09/02 07:49:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:49:31 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:49:36 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:49:32 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:49:32 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:49:32 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-5b5d57ccbc" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:49:32 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:49:32 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000932d50 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/09/02 07:49:36 sinkpod name: el-listener-embed-binding-5b5d57ccbc-zjjqp
2024/09/02 07:49:36 Route url: 'http://el-listener-embed-binding-releasetest-xbtj2.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/09/02 07:49:41 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:49:41 validating pipeline run for success state...
2024/09/02 07:49:56 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-xbtj2
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name  |status    |check_label_propagation|
         |----|-------------------|----------|-----------------------|
         |1   |simple-pipeline-run|successful|no                     |	 ...[PASS]
2024/09/02 07:49:56 Deleted EventListener
2024/09/02 07:50:01 EventListener's Deployment was deleted
2024/09/02 07:50:01 EventListener's Service was deleted
2024/09/02 07:50:01 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:50:16 output: project.project.openshift.io "releasetest-xbtj2" deleted
  ## Create embedded TriggersTemplate: PIPELINES-05-TC09	
2024/09/02 07:50:16 output: Now using project "releasetest-jw767" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:50:16 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/09/02 07:50:17 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/09/02 07:50:17 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |2   |testdata/triggers/triggertemplate/embed-triggertemplate.yaml       |
         |3   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/09/02 07:50:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:50:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:50:22 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:19 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:19 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:19 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-6f5759f5c9" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:19 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:19 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d14ab0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/09/02 07:50:22 sinkpod name: el-listener-embed-binding-6f5759f5c9-cq4xv
2024/09/02 07:50:22 Route url: 'http://el-listener-embed-binding-releasetest-jw767.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/09/02 07:50:27 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:50:27 validating pipeline run for success state...
2024/09/02 07:50:32 pipelineRun: pipelinerun-with-taskspec-to-echo-message is successful under namespace : releasetest-jw767
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name                        |status    |check_label_propagation|
         |----|-----------------------------------------|----------|-----------------------|
         |1   |pipelinerun-with-taskspec-to-echo-message|successful|no                     |	 ...[PASS]
2024/09/02 07:50:32 Deleted EventListener
2024/09/02 07:50:37 EventListener's Deployment was deleted
2024/09/02 07:50:37 EventListener's Service was deleted
2024/09/02 07:50:37 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:50:52 output: project.project.openshift.io "releasetest-jw767" deleted
  ## Verify Github push event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC12	
2024/09/02 07:50:52 output: Now using project "releasetest-xjfk2" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:50:53 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-push created
2024/09/02 07:50:53 output: eventlistener.triggers.tekton.dev/listener-ctb-github-push created
      * Create 
      
         |S.NO|resource_dir                                                      |
         |----|------------------------------------------------------------------|
         |1   |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-push.yaml|
         |2   |testdata/triggers/github-ctb/eventlistener-ctb-git-push.yaml      |	 ...[PASS]
2024/09/02 07:50:53 Verify SA "pipeline" is created in namespace "releasetest-xjfk2"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:50:53 output: secret/github-secret created
2024/09/02 07:50:53 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/09/02 07:50:53 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-555f8cbc8b" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d999b0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/09/02 07:50:53 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-ctb-github-push-555f8cbc8b" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:53 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d99e90 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/09/02 07:50:58 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:55 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:55 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:55 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-ctb-github-push-555f8cbc8b" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:55 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:50:55 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc00073a570 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-ctb-github-push}}
2024/09/02 07:50:58 sinkpod name: el-listener-ctb-github-push-555f8cbc8b-cfzqd
2024/09/02 07:50:58 Route url: 'http://el-listener-ctb-github-push-releasetest-xjfk2.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-ctb-github-push"	 ...[PASS]
2024/09/02 07:51:03 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/triggers/github-ctb/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:51:03 validating pipeline run for success state...
2024/09/02 07:51:13 pipelineRun: pipelinerun-git-push-ctb is successful under namespace : releasetest-xjfk2
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name       |status    |check_label_propagation|
         |----|------------------------|----------|-----------------------|
         |1   |pipelinerun-git-push-ctb|successful|no                     |	 ...[PASS]
2024/09/02 07:51:13 Deleted EventListener
2024/09/02 07:51:19 EventListener's Deployment was deleted
2024/09/02 07:51:19 EventListener's Service was deleted
2024/09/02 07:51:19 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:51:34 output: project.project.openshift.io "releasetest-xjfk2" deleted
  ## Verify Github pull_request event with Embbeded TriggerTemplate using Github-CTB: PIPELINES-05-TC13	
2024/09/02 07:51:34 output: Now using project "releasetest-cm4vg" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:51:34 output: triggertemplate.triggers.tekton.dev/pipeline-template-git-pr created
2024/09/02 07:51:34 output: eventlistener.triggers.tekton.dev/listener-clustertriggerbinding-github-pr created
      * Create 
      
         |S.NO|resource_dir                                                    |
         |----|----------------------------------------------------------------|
         |1   |testdata/triggers/github-ctb/Embeddedtriggertemplate-git-pr.yaml|
         |2   |testdata/triggers/github-ctb/eventlistener-ctb-git-pr.yaml      |	 ...[PASS]
2024/09/02 07:51:34 Verify SA "pipeline" is created in namespace "releasetest-cm4vg"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:51:34 output: secret/github-secret created
2024/09/02 07:51:34 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/09/02 07:51:34 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-7b5dbd887b" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000924c60 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/09/02 07:51:34 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-7b5dbd887b" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:34 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000ad0210 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/09/02 07:51:39 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:36 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:36 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:36 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-clustertriggerbinding-github-pr-7b5dbd887b" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:36 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:51:36 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d16120 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-clustertriggerbinding-github-pr}}
2024/09/02 07:51:39 sinkpod name: el-listener-clustertriggerbinding-github-pr-7b5dbd887b-jfsvm
2024/09/02 07:51:40 Route url: 'http://el-listener-clustertriggerbinding-github-pr-releasetest-cm4vg.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-clustertriggerbinding-github-pr"	 ...[PASS]
2024/09/02 07:51:45 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/github-ctb/pr.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:51:45 validating pipeline run for success state...
2024/09/02 07:51:55 pipelineRun: pipelinerun-git-pr-ctb is successful under namespace : releasetest-cm4vg
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name     |status    |check_label_propagation|
         |----|----------------------|----------|-----------------------|
         |1   |pipelinerun-git-pr-ctb|successful|no                     |	 ...[PASS]
2024/09/02 07:51:55 Deleted EventListener
2024/09/02 07:52:00 EventListener's Deployment was deleted
2024/09/02 07:52:00 EventListener's Service was deleted
2024/09/02 07:52:00 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:52:15 output: project.project.openshift.io "releasetest-cm4vg" deleted
  ## Create TriggersCRD resource with CEL interceptors (overlays): PIPELINES-05-TC15	
2024/09/02 07:52:15 output: Now using project "releasetest-vt9bg" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:52:15 output: eventlistener.triggers.tekton.dev/listener-triggerref created
2024/09/02 07:52:15 output: trigger.triggers.tekton.dev/trigger created
2024/09/02 07:52:15 output: triggerbinding.triggers.tekton.dev/github-pr-binding created
2024/09/02 07:52:15 output: triggertemplate.triggers.tekton.dev/github-template created
2024/09/02 07:52:16 output: pipeline.tekton.dev/parallel-pipeline created
task.tekton.dev/persist-param created
task.tekton.dev/to-upper created
task.tekton.dev/to-lower created
task.tekton.dev/result-reporter created
task.tekton.dev/validator created
      * Create 
      
         |S.NO|resource_dir                                               |
         |----|-----------------------------------------------------------|
         |1   |testdata/triggers/triggersCRD/eventlistener-triggerref.yaml|
         |2   |testdata/triggers/triggersCRD/trigger.yaml                 |
         |3   |testdata/triggers/triggersCRD/triggerbindings.yaml         |
         |4   |testdata/triggers/triggersCRD/triggertemplate.yaml         |
         |5   |testdata/triggers/triggersCRD/pipeline.yaml                |	 ...[PASS]
2024/09/02 07:52:16 Verify SA "pipeline" is created in namespace "releasetest-vt9bg"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:52:16 output: secret/github-secret created
2024/09/02 07:52:16 output:
      * Create & Link secret "github-secret" to service account "pipeline"	 ...[PASS]
2024/09/02 07:52:16 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-5487877b6c" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000f8a420 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/09/02 07:52:16 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason:MinimumReplicasUnavailable Message:Deployment does not have minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason:ReplicaSetUpdated Message:ReplicaSet "el-listener-triggerref-5487877b6c" is progressing.} {Type:Ready Status:False Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason: Message:Condition Available has status: False with message: Deployment does not have minimum availability.} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:15 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000f11560 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/09/02 07:52:21 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:17 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:17 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:17 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-triggerref-5487877b6c" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:17 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:52:17 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0010856e0 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-triggerref}}
2024/09/02 07:52:21 sinkpod name: el-listener-triggerref-5487877b6c-gcdzn
2024/09/02 07:52:21 Route url: 'http://el-listener-triggerref-releasetest-vt9bg.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-triggerref"	 ...[PASS]
2024/09/02 07:52:26 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "pull_request", payload "testdata/triggers/triggersCRD/pull-request.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:52:26 validating pipeline run for success state...
2024/09/02 07:52:56 pipelineRun: parallel-pipelinerun is successful under namespace : releasetest-vt9bg
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name   |status    |check_label_propagation|
         |----|--------------------|----------|-----------------------|
         |1   |parallel-pipelinerun|successful|no                     |	 ...[PASS]
2024/09/02 07:52:56 Deleted EventListener
2024/09/02 07:53:01 EventListener's Deployment was deleted
2024/09/02 07:53:01 EventListener's Service was deleted
2024/09/02 07:53:01 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:53:16 output: project.project.openshift.io "releasetest-vt9bg" deleted
  ## Create Eventlistener with github interceptor And verify Kuberenetes Events: PIPELINES-05-TC17	
2024/09/02 07:53:17 output: Now using project "releasetest-pcjwr" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:53:17 output: task.tekton.dev/say-hello created
task.tekton.dev/say-message created
task.tekton.dev/say-bye created
pipeline.tekton.dev/simple-pipeline created
2024/09/02 07:53:17 output: triggerbinding.triggers.tekton.dev/pipeline-binding created
2024/09/02 07:53:17 output: triggertemplate.triggers.tekton.dev/pipeline-template created
2024/09/02 07:53:17 output: eventlistener.triggers.tekton.dev/listener-embed-binding created
      * Create 
      
         |S.NO|resource_dir                                                       |
         |----|-------------------------------------------------------------------|
         |1   |testdata/triggers/sample-pipeline.yaml                             |
         |2   |testdata/triggers/triggerbindings/triggerbinding.yaml              |
         |3   |testdata/triggers/triggertemplate/triggertemplate.yaml             |
         |4   |testdata/triggers/eventlisteners/eventlistener-embeded-binding.yaml|	 ...[PASS]
2024/09/02 07:53:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:53:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:53:22 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:19 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:19 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:19 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-listener-embed-binding-76dc5c8d79" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:19 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:19 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000cf3350 Addresses:[]} Configuration:{GeneratedResourceName:el-listener-embed-binding}}
2024/09/02 07:53:22 sinkpod name: el-listener-embed-binding-76dc5c8d79-8jcst
2024/09/02 07:53:22 Route url: 'http://el-listener-embed-binding-releasetest-pcjwr.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "listener-embed-binding"	 ...[PASS]
2024/09/02 07:53:27 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
      * Verify kubernetes events for eventlistener	 ...[PASS]
2024/09/02 07:53:28 validating pipeline run for success state...
2024/09/02 07:53:38 pipelineRun: simple-pipeline-run is successful under namespace : releasetest-pcjwr
      * Verify pipelinerun 
      
         |S.NO|pipeline_run_name  |status    |check_label_propagation|
         |----|-------------------|----------|-----------------------|
         |1   |simple-pipeline-run|successful|no                     |	 ...[PASS]
2024/09/02 07:53:38 Deleted EventListener
2024/09/02 07:53:43 EventListener's Deployment was deleted
2024/09/02 07:53:43 EventListener's Service was deleted
2024/09/02 07:53:43 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:53:58 output: project.project.openshift.io "releasetest-pcjwr" deleted

# Verify triggerbindings spec
  ## Verify CEL marshaljson function Test: PIPELINES-10-TC01	
2024/09/02 07:53:58 output: Now using project "releasetest-lp4xj" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:53:58 output: eventlistener.triggers.tekton.dev/cel-marshaljson created
      * Create 
      
         |S.NO|resource_dir                                          |
         |----|------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/cel-marshalJson.yaml|	 ...[PASS]
2024/09/02 07:53:58 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:53:58 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:54:03 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:59 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:59 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:59 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-cel-marshaljson-cf5995cb6" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:59 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:53:59 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc0008811d0 Addresses:[]} Configuration:{GeneratedResourceName:el-cel-marshaljson}}
2024/09/02 07:54:03 sinkpod name: el-cel-marshaljson-cf5995cb6-dn2m5
2024/09/02 07:54:03 Route url: 'http://el-cel-marshaljson-releasetest-lp4xj.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "cel-marshaljson"	 ...[PASS]
2024/09/02 07:54:08 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:54:09 Waiting for TaskRun cel-trig-marshaljson in namespace releasetest-lp4xj to succeed
      * Verify taskrun 
      
         |S.NO|task_run_name       |status |
         |----|--------------------|-------|
         |1   |cel-trig-marshaljson|Success|	 ...[PASS]
2024/09/02 07:54:14 Deleted EventListener
2024/09/02 07:54:19 EventListener's Deployment was deleted
2024/09/02 07:54:19 EventListener's Service was deleted
2024/09/02 07:54:19 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:54:34 output: project.project.openshift.io "releasetest-lp4xj" deleted
  ## Verify event message body parsing with old annotation Test: PIPELINES-10-TC02	
2024/09/02 07:54:34 output: Now using project "releasetest-wsxvx" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:54:34 output: triggertemplate.triggers.tekton.dev/taskrun-with-annotation created
eventlistener.triggers.tekton.dev/parse-json-body-with-annotation created
      * Create 
      
         |S.NO|resource_dir                                                          |
         |----|----------------------------------------------------------------------|
         |1   |testdata/triggers/triggerbindings/parse-json-body-with-annotation.yaml|	 ...[PASS]
2024/09/02 07:54:34 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:54:34 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:54:39 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:54:37 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:54:37 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:54:37 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-parse-json-body-with-annotation-8685cf8949" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:54:37 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:54:37 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000d88180 Addresses:[]} Configuration:{GeneratedResourceName:el-parse-json-body-with-annotation}}
2024/09/02 07:54:39 sinkpod name: el-parse-json-body-with-annotation-8685cf8949-84xxd
2024/09/02 07:54:39 Route url: 'http://el-parse-json-body-with-annotation-releasetest-wsxvx.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "parse-json-body-with-annotation"	 ...[PASS]
2024/09/02 07:54:44 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:54:45 Waiting for TaskRun trig-parse-json-body-with-annotation in namespace releasetest-wsxvx to succeed
      * Verify taskrun 
      
         |S.NO|task_run_name                       |status |
         |----|------------------------------------|-------|
         |1   |trig-parse-json-body-with-annotation|Success|	 ...[PASS]
2024/09/02 07:54:50 Deleted EventListener
2024/09/02 07:54:55 EventListener's Deployment was deleted
2024/09/02 07:54:55 EventListener's Service was deleted
2024/09/02 07:54:55 EventListener's Route got deleted successfully...
      * Cleanup Triggers	 ...[PASS]
2024/09/02 07:55:10 output: project.project.openshift.io "releasetest-wsxvx" deleted

# Verify triggers tutorial
  ## Run pipelines tutorial using triggers: PIPELINES-06-TC02	
2024/09/02 07:55:10 output: Now using project "releasetest-th6tm" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:55:10 Verify SA "pipeline" is created in namespace "releasetest-th6tm"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 07:55:15 output: task.tekton.dev/apply-manifests created
2024/09/02 07:55:15 output: task.tekton.dev/update-deployment created
2024/09/02 07:55:16 output: persistentvolumeclaim/source-pvc created
2024/09/02 07:55:16 output: pipeline.tekton.dev/build-and-deploy created
2024/09/02 07:55:16 output: triggerbinding.triggers.tekton.dev/vote-app created
2024/09/02 07:55:16 output: triggertemplate.triggers.tekton.dev/vote-app created
2024/09/02 07:55:17 output: trigger.triggers.tekton.dev/vote-trigger created
secret/github-secret created
2024/09/02 07:55:17 output: eventlistener.triggers.tekton.dev/vote-app created
      * Create remote 
      
         |S.NO|resource_dir                                                                                                                    |
         |----|--------------------------------------------------------------------------------------------------------------------------------|
         |1   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/01_apply_manifest_task.yaml    |
         |2   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/02_update_deployment_task.yaml |
         |3   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/03_persistent_volume_claim.yaml|
         |4   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/01_pipeline/04_pipeline.yaml               |
         |5   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/01_binding.yaml                |
         |6   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/02_template.yaml               |
         |7   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/03_trigger.yaml                |
         |8   |https://raw.githubusercontent.com/openshift/pipelines-tutorial/{OSP_TUTORIAL_BRANCH}/03_triggers/04_event_listener.yaml         |	 ...[PASS]
2024/09/02 07:55:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:55:17 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[] Annotations:map[]} AddressStatus:{Address:<nil> Addresses:[]} Configuration:{GeneratedResourceName:}}
2024/09/02 07:55:22 EventListenerStatus: {Status:{ObservedGeneration:0 Conditions:[{Type:Available Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:55:20 +0000 UTC} Reason:MinimumReplicasAvailable Message:Deployment has minimum availability.} {Type:Deployment Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:55:20 +0000 UTC} Reason: Message:Deployment exists} {Type:Progressing Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:55:20 +0000 UTC} Reason:NewReplicaSetAvailable Message:ReplicaSet "el-vote-app-78cd4c67d9" has successfully progressed.} {Type:Ready Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:55:20 +0000 UTC} Reason: Message:EventListener is ready} {Type:Service Status:True Severity: LastTransitionTime:{Inner:2024-09-02 07:55:20 +0000 UTC} Reason: Message:Service exists}] Annotations:map[]} AddressStatus:{Address:0xc000a4a270 Addresses:[]} Configuration:{GeneratedResourceName:el-vote-app}}
2024/09/02 07:55:22 sinkpod name: el-vote-app-78cd4c67d9-x6gmz
2024/09/02 07:55:22 Route url: 'http://el-vote-app-releasetest-th6tm.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Expose Event listener "vote-app"	 ...[PASS]
2024/09/02 07:55:27 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push-vote-api.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:55:27 validating pipeline run for success state...
2024/09/02 07:56:37 pipelineRun: build-deploy-pipelines-vote-api-zsscj is successful under namespace : releasetest-th6tm
      * Verify the latest pipelinerun for "successful" state	 ...[PASS]
2024/09/02 07:56:37 Building headers for github interceptor..
      * Mock post event to "github" interceptor with event-type "push", payload "testdata/push-vote-ui.json", with TLS "false"	 ...[PASS]
      * Assert eventlistener response	 ...[PASS]
2024/09/02 07:56:38 validating pipeline run for success state...
2024/09/02 07:57:58 pipelineRun: build-deploy-pipelines-vote-ui-g4kxr is successful under namespace : releasetest-th6tm
      * Verify the latest pipelinerun for "successful" state	 ...[PASS]
2024/09/02 07:57:58 Route url: 'http://pipelines-vote-ui-releasetest-th6tm.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com'
      * Get route url of the route "pipelines-vote-ui"	 ...[PASS]
      * Wait for pipelines-vote-ui deployment	 ...[PASS]
      * Validate route url for pipelines tutorial	 ...[FAIL]
        
        Failed Step: Validate route url for pipelines tutorial
        Specification: specs/triggers/tutorial.spec:73
        Error Message: [assertion failed: 
        Command:  lynx http://pipelines-vote-ui-releasetest-th6tm.apps.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com --dump
        ExitCode: 0 (timeout)
        Stdout:   
        Stderr:   
        
        Failures:
        Expected command to finish, but it hit the timeout]
        Stacktrace: 
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/testing.go:46
        github.com/openshift-pipelines/release-tests/pkg/cmd.testsuitAdaptor.Log(...)
        	/tmp/release-tests/pkg/cmd/cmd.go:34
        gotest.tools/v3/internal/assert.RunComparison({0x7f447c176b70, 0x52ec000}, 0x3904568, 0xc0004b5a90, {0x0, 0x0, 0x0})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/internal/assert/result.go:60 +0x205
        gotest.tools/v3/internal/assert.Eval({0x7f447c176b70, 0x52ec000}, 0x3904568, {0x32fc960, 0xc0004b5a90}, {0x0, 0x0, 0x0})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/internal/assert/assert.go:56 +0x13d
        gotest.tools/v3/assert.Assert({0x3bb8bf8, 0x52ec000}, {0x32fc960, 0xc0004b5a90}, {0x0, 0x0, 0x0})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/assert/assert.go:145 +0xce
        gotest.tools/v3/icmd.(*Result).Assert(0xc000d064c0, {0x3bb8bf8, 0x52ec000}, {0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}})
        	/alabama/go/pkg/mod/gotest.tools/v3@v3.5.1/icmd/command.go:62 +0x145
        github.com/openshift-pipelines/release-tests/pkg/cmd.Assert({0x0, 0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000932a80, 0x3, ...})
        	/tmp/release-tests/pkg/cmd/cmd.go:50 +0x105
        github.com/openshift-pipelines/release-tests/pkg/cmd.MustSucceed(...)
        	/tmp/release-tests/pkg/cmd/cmd.go:43
        github.com/openshift-pipelines/release-tests/steps/utility.init.func4()
        	/tmp/release-tests/steps/utility/utility.go:48 +0x11a
        reflect.Value.call({0x317bd40?, 0x39040e8?, 0x1c0?}, {0x3790e91, 0x4}, {0x52ec000, 0x0, 0xc001103180?})
        	/usr/lib/golang/src/reflect/value.go:596 +0xca6
        reflect.Value.Call({0x317bd40?, 0x39040e8?, 0xc000705be0?}, {0x52ec000?, 0xc000705c48?, 0x17e724b?})
        	/usr/lib/golang/src/reflect/value.go:380 +0xb9
        github.com/getgauge-contrib/gauge-go/testsuit.executeFunc({0x317bd40?, 0x39040e8?, 0x26?}, {0x0, 0x0, 0x5d?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/funcExecutor.go:47 +0x235
        github.com/getgauge-contrib/gauge-go/testsuit.(*Step).Execute(0xc0000ebda0?, {0x0?, 0x29?, 0x5f?})
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/testsuit/step.go:17 +0x8c
        github.com/getgauge-contrib/gauge-go/messageprocessors.(*ExecuteStepProcessor).Process(0x33bb980?, 0xc000d204b0, 0xc000000007?)
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/messageprocessors/ExecuteStepProcessor.go:20 +0xa6
        github.com/getgauge-contrib/gauge-go/gauge.Run()
        	/alabama/go/pkg/mod/github.com/getgauge-contrib/gauge-go@v0.4.0/gauge/runner.go:219 +0x227
        command-line-arguments.init.0()
        	/tmp/gauge_temp1725262969362219117/gauge_test.go:34 +0xf
        
2024/09/02 07:58:23 Skipping deletion of the namespace 'releasetest-th6tm' as the test got failed

Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 07.58.23

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_07.58.23/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	930.083s
Runner with PID:28967 has exited
Specifications:	4 executed	3 passed	1 failed	0 skipped
Scenarios:	10 executed	9 passed	1 failed	0 skipped

Total time taken: 15m29.993s
gauge run specs/metrics/
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/metrics/metrics.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 38069
Successfully made the connection with plugin with port: 38069
Starting Xml Report plugin
Attempting to connect to grpc server at port: 37075
Successfully made the connection with plugin with port: 37075
Initialising suite data store.
# Verify openshift pipelines monitoring
  ## Openshift pipelines metrics acceptance tests: PIPELINES-01-TC01	
2024/09/02 07:58:27 output: Now using project "releasetest-gfpvb" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:58:27 Waiting for operator to be up and running....
2024/09/02 07:58:27 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:58:27 Target Job: [node-exporter] ready/up status, Actual: [1], Expected: [1]
2024/09/02 07:58:27 Target Job: [kube-state-metrics] ready/up status, Actual: [1], Expected: [1]
2024/09/02 07:58:28 Target Job: [prometheus-k8s] ready/up status, Actual: [1], Expected: [1]
2024/09/02 07:58:28 Target Job: [prometheus-operator] ready/up status, Actual: [1], Expected: [1]
2024/09/02 07:58:28 Target Job: [alertmanager-main] ready/up status, Actual: [1], Expected: [1]
2024/09/02 07:58:28 Target Job: [tekton-pipelines-controller] ready/up status, Actual: [1], Expected: [1]
      * Verify job health status metrics 
      
         |S.NO|Job_name                   |Expected_value|
         |----|---------------------------|--------------|
         |1   |node-exporter              |1             |
         |2   |kube-state-metrics         |1             |
         |3   |prometheus-k8s             |1             |
         |4   |prometheus-operator        |1             |
         |5   |alertmanager-main          |1             |
         |6   |tekton-pipelines-controller|1             |	 ...[PASS]
      * Verify pipelines controlPlane metrics	 ...[PASS]
2024/09/02 07:58:35 output: project.project.openshift.io "releasetest-gfpvb" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_07.58.35/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 07.58.35

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	8.275s
Runner with PID:31322 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	1 executed	1 passed	0 failed	0 skipped

Total time taken: 8.213s
gauge run specs/operator/addon.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin html-report is already installed.
Plugin xml-report is already installed.
Plugin go is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/operator/addon.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 38043
Successfully made the connection with plugin with port: 38043
Starting Xml Report plugin
Attempting to connect to grpc server at port: 45325
Successfully made the connection with plugin with port: 45325
Initialising suite data store.
# Verify Addon E2E spec
  ## Disable/Enable community clustertasks: PIPELINES-15-TC01	
2024/09/02 07:58:39 output: Now using project "releasetest-6cdn5" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 07:58:39 Waiting for operator to be up and running....
2024/09/02 07:58:39 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/09/02 07:58:39 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/09/02 07:58:44 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 07:58:44 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 07:58:44 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/09/02 07:58:49 Verifying if the clustertask jib-maven is present
2024/09/02 07:58:49 Clustertask jib-maven is present
2024/09/02 07:58:54 Verifying if the clustertask helm-upgrade-from-source is present
2024/09/02 07:58:54 Clustertask helm-upgrade-from-source is present
2024/09/02 07:58:59 Verifying if the clustertask helm-upgrade-from-repo is present
2024/09/02 07:58:59 Clustertask helm-upgrade-from-repo is present
2024/09/02 07:59:04 Verifying if the clustertask trigger-jenkins-job is present
2024/09/02 07:59:04 Clustertask trigger-jenkins-job is present
2024/09/02 07:59:10 Verifying if the clustertask git-cli is present
2024/09/02 07:59:10 Clustertask git-cli is present
2024/09/02 07:59:15 Verifying if the clustertask pull-request is present
2024/09/02 07:59:15 Clustertask pull-request is present
2024/09/02 07:59:20 Verifying if the clustertask kubeconfig-creator is present
2024/09/02 07:59:20 Clustertask kubeconfig-creator is present
2024/09/02 07:59:25 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/09/02 07:59:25 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/09/02 07:59:25 Checking if clustertasks tkn,openshift-client is/are present
2024/09/02 07:59:30 Verifying if the clustertask tkn is present
2024/09/02 07:59:30 Clustertask tkn is present
2024/09/02 07:59:35 Verifying if the clustertask openshift-client is present
2024/09/02 07:59:35 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/09/02 07:59:35 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "false" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 07:59:35 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are not present
2024/09/02 07:59:40 Verifying if the clustertask jib-maven is not present
2024/09/02 07:59:40 Clustertask jib-maven is not present
2024/09/02 07:59:45 Verifying if the clustertask helm-upgrade-from-source is not present
2024/09/02 07:59:45 Clustertask helm-upgrade-from-source is not present
2024/09/02 07:59:50 Verifying if the clustertask helm-upgrade-from-repo is not present
2024/09/02 07:59:50 Clustertask helm-upgrade-from-repo is not present
2024/09/02 07:59:55 Verifying if the clustertask trigger-jenkins-job is not present
2024/09/02 07:59:55 Clustertask trigger-jenkins-job is not present
2024/09/02 08:00:00 Verifying if the clustertask git-cli is not present
2024/09/02 08:00:00 Clustertask git-cli is not present
2024/09/02 08:00:05 Verifying if the clustertask pull-request is not present
2024/09/02 08:00:05 Clustertask pull-request is not present
2024/09/02 08:00:10 Verifying if the clustertask kubeconfig-creator is not present
2024/09/02 08:00:10 Clustertask kubeconfig-creator is not present
2024/09/02 08:00:15 Verifying if the clustertask argocd-task-sync-and-wait is not present
2024/09/02 08:00:15 Clustertask argocd-task-sync-and-wait is not present
      * "community" clustertasks are "not present"	 ...[PASS]
2024/09/02 08:00:15 Checking if clustertasks tkn,openshift-client is/are present
2024/09/02 08:00:20 Verifying if the clustertask tkn is present
2024/09/02 08:00:20 Clustertask tkn is present
2024/09/02 08:00:25 Verifying if the clustertask openshift-client is present
2024/09/02 08:00:25 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/09/02 08:00:25 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 08:00:25 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/09/02 08:00:30 Verifying if the clustertask jib-maven is present
2024/09/02 08:00:30 Clustertask jib-maven is present
2024/09/02 08:00:35 Verifying if the clustertask helm-upgrade-from-source is present
2024/09/02 08:00:35 Clustertask helm-upgrade-from-source is present
2024/09/02 08:00:40 Verifying if the clustertask helm-upgrade-from-repo is present
2024/09/02 08:00:40 Clustertask helm-upgrade-from-repo is present
2024/09/02 08:00:45 Verifying if the clustertask trigger-jenkins-job is present
2024/09/02 08:00:45 Clustertask trigger-jenkins-job is present
2024/09/02 08:00:50 Verifying if the clustertask git-cli is present
2024/09/02 08:00:50 Clustertask git-cli is present
2024/09/02 08:00:55 Verifying if the clustertask pull-request is present
2024/09/02 08:00:55 Clustertask pull-request is present
2024/09/02 08:01:00 Verifying if the clustertask kubeconfig-creator is present
2024/09/02 08:01:00 Clustertask kubeconfig-creator is present
2024/09/02 08:01:05 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/09/02 08:01:05 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/09/02 08:01:05 Checking if clustertasks tkn,openshift-client is/are present
2024/09/02 08:01:10 Verifying if the clustertask tkn is present
2024/09/02 08:01:10 Clustertask tkn is present
2024/09/02 08:01:15 Verifying if the clustertask openshift-client is present
2024/09/02 08:01:15 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/09/02 08:01:22 output: project.project.openshift.io "releasetest-6cdn5" deleted
  ## Disable/Enable clustertasks: PIPELINES-15-TC02	
2024/09/02 08:01:22 output: Now using project "releasetest-dnp99" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:01:22 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 08:01:22 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/09/02 08:01:27 Verifying if the clustertask jib-maven is present
2024/09/02 08:01:27 Clustertask jib-maven is present
2024/09/02 08:01:32 Verifying if the clustertask helm-upgrade-from-source is present
2024/09/02 08:01:32 Clustertask helm-upgrade-from-source is present
2024/09/02 08:01:37 Verifying if the clustertask helm-upgrade-from-repo is present
2024/09/02 08:01:37 Clustertask helm-upgrade-from-repo is present
2024/09/02 08:01:42 Verifying if the clustertask trigger-jenkins-job is present
2024/09/02 08:01:42 Clustertask trigger-jenkins-job is present
2024/09/02 08:01:47 Verifying if the clustertask git-cli is present
2024/09/02 08:01:47 Clustertask git-cli is present
2024/09/02 08:01:52 Verifying if the clustertask pull-request is present
2024/09/02 08:01:52 Clustertask pull-request is present
2024/09/02 08:01:57 Verifying if the clustertask kubeconfig-creator is present
2024/09/02 08:01:57 Clustertask kubeconfig-creator is present
2024/09/02 08:02:02 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/09/02 08:02:02 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/09/02 08:02:02 Checking if clustertasks tkn,openshift-client is/are present
2024/09/02 08:02:07 Verifying if the clustertask tkn is present
2024/09/02 08:02:07 Clustertask tkn is present
2024/09/02 08:02:12 Verifying if the clustertask openshift-client is present
2024/09/02 08:02:12 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/09/02 08:02:17 Verifying that 27 pipelines are present in namespace openshift
2024/09/02 08:02:17 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/09/02 08:02:17 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "false" communityClustertasks as "false" and pipelineTemplates as "false" and expect message ""	 ...[PASS]
2024/09/02 08:02:17 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are not present
2024/09/02 08:02:22 Verifying if the clustertask jib-maven is not present
2024/09/02 08:02:22 Clustertask jib-maven is not present
2024/09/02 08:02:27 Verifying if the clustertask helm-upgrade-from-source is not present
2024/09/02 08:02:27 Clustertask helm-upgrade-from-source is not present
2024/09/02 08:02:32 Verifying if the clustertask helm-upgrade-from-repo is not present
2024/09/02 08:02:32 Clustertask helm-upgrade-from-repo is not present
2024/09/02 08:02:37 Verifying if the clustertask trigger-jenkins-job is not present
2024/09/02 08:02:38 Clustertask trigger-jenkins-job is not present
2024/09/02 08:02:43 Verifying if the clustertask git-cli is not present
2024/09/02 08:02:43 Clustertask git-cli is not present
2024/09/02 08:02:48 Verifying if the clustertask pull-request is not present
2024/09/02 08:02:48 Clustertask pull-request is not present
2024/09/02 08:02:53 Verifying if the clustertask kubeconfig-creator is not present
2024/09/02 08:02:53 Clustertask kubeconfig-creator is not present
2024/09/02 08:02:58 Verifying if the clustertask argocd-task-sync-and-wait is not present
2024/09/02 08:02:58 Clustertask argocd-task-sync-and-wait is not present
      * "community" clustertasks are "not present"	 ...[PASS]
2024/09/02 08:02:58 Checking if clustertasks tkn,openshift-client is/are not present
2024/09/02 08:03:03 Verifying if the clustertask tkn is not present
2024/09/02 08:03:03 Clustertask tkn is not present
2024/09/02 08:03:08 Verifying if the clustertask openshift-client is not present
2024/09/02 08:03:08 Clustertask openshift-client is not present
      * "tkn,openshift-client" clustertasks are "not present"	 ...[PASS]
2024/09/02 08:03:13 Verifying if 0 pipelines are not present in namespace openshift
2024/09/02 08:03:13 Pipelines are present in namespace openshift
      * Assert pipelines are "not present" in "openshift" namespace	 ...[PASS]
2024/09/02 08:03:13 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 08:03:13 Checking if clustertasks jib-maven,helm-upgrade-from-source,helm-upgrade-from-repo,trigger-jenkins-job,git-cli,pull-request,kubeconfig-creator,argocd-task-sync-and-wait is/are present
2024/09/02 08:03:18 Verifying if the clustertask jib-maven is present
2024/09/02 08:03:18 Clustertask jib-maven is present
2024/09/02 08:03:23 Verifying if the clustertask helm-upgrade-from-source is present
2024/09/02 08:03:23 Clustertask helm-upgrade-from-source is present
2024/09/02 08:03:28 Verifying if the clustertask helm-upgrade-from-repo is present
2024/09/02 08:03:28 Clustertask helm-upgrade-from-repo is present
2024/09/02 08:03:33 Verifying if the clustertask trigger-jenkins-job is present
2024/09/02 08:03:33 Clustertask trigger-jenkins-job is present
2024/09/02 08:03:38 Verifying if the clustertask git-cli is present
2024/09/02 08:03:38 Clustertask git-cli is present
2024/09/02 08:03:43 Verifying if the clustertask pull-request is present
2024/09/02 08:03:43 Clustertask pull-request is present
2024/09/02 08:03:48 Verifying if the clustertask kubeconfig-creator is present
2024/09/02 08:03:48 Clustertask kubeconfig-creator is present
2024/09/02 08:03:53 Verifying if the clustertask argocd-task-sync-and-wait is present
2024/09/02 08:03:53 Clustertask argocd-task-sync-and-wait is present
      * "community" clustertasks are "present"	 ...[PASS]
2024/09/02 08:03:53 Checking if clustertasks tkn,openshift-client is/are present
2024/09/02 08:03:58 Verifying if the clustertask tkn is present
2024/09/02 08:03:58 Clustertask tkn is present
2024/09/02 08:04:03 Verifying if the clustertask openshift-client is present
2024/09/02 08:04:03 Clustertask openshift-client is present
      * "tkn,openshift-client" clustertasks are "present"	 ...[PASS]
2024/09/02 08:04:08 Verifying that 27 pipelines are present in namespace openshift
2024/09/02 08:04:08 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/09/02 08:04:15 output: project.project.openshift.io "releasetest-dnp99" deleted
  ## Disable/Enable pipeline templates: PIPELINES-15-TC03	
2024/09/02 08:04:15 output: Now using project "releasetest-g57fw" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:04:15 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 08:04:20 Verifying that 27 pipelines are present in namespace openshift
2024/09/02 08:04:20 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/09/02 08:04:20 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "false" and expect message ""	 ...[PASS]
2024/09/02 08:04:25 Verifying if 0 pipelines are not present in namespace openshift
2024/09/02 08:04:25 Pipelines are present in namespace openshift
      * Assert pipelines are "not present" in "openshift" namespace	 ...[PASS]
2024/09/02 08:04:25 output: tektonconfig.operator.tekton.dev/config patched
      * Update addon config with clusterTasks as "true" communityClustertasks as "true" and pipelineTemplates as "true" and expect message ""	 ...[PASS]
2024/09/02 08:04:30 Verifying that 27 pipelines are present in namespace openshift
2024/09/02 08:04:30 Pipelines are present in namespace openshift
      * Assert pipelines are "present" in "openshift" namespace	 ...[PASS]
2024/09/02 08:04:37 output: project.project.openshift.io "releasetest-g57fw" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_08.04.37/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 08.04.37

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	358.527s
Runner with PID:31877 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	3 executed	3 passed	0 failed	0 skipped

Total time taken: 5m58.456s
gauge run specs/operator/auto-prune.spec
log-level : [debug]
tags : [sanity & !tls]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity & !tls
The following specifications satisfy filter criteria:
specs/operator/auto-prune.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 45481
Successfully made the connection with plugin with port: 45481
Starting Xml Report plugin
Attempting to connect to grpc server at port: 44665
Successfully made the connection with plugin with port: 44665
Initialising suite data store.
# Verify auto-prune E2E
2024/09/02 08:04:41 output: Now using project "releasetest-vnhhx" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 08:04:41 Annotating the namespaces with 'operator.tekton.dev/prune.skip=true' so that the pipelineruns should not get deleted
2024/09/02 08:04:41 output: namespace/openshift annotated
2024/09/02 08:04:41 output: namespace/releasetest-th6tm annotated
2024/09/02 08:04:41 output: namespace/releasetest-vnhhx annotated
  ## Verify auto prune for taskrun: PIPELINES-12-TC01	
2024/09/02 08:04:42 output: Now using project "releasetest-x6x8k" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 08:04:42 Waiting for operator to be up and running....
2024/09/02 08:04:42 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/09/02 08:04:42 Waiting for config cr InstalledStatus Actual: [False] Expected: [True]
2024/09/02 08:04:47 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:04:47 Verify SA "pipeline" is created in namespace "releasetest-x6x8k"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 08:04:47 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:04:47 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/09/02 08:04:47 output: pipelinerun.tekton.dev/echo-pipeline-run-65qs4 created
pipelinerun.tekton.dev/echo-pipeline-run-52dhl created
pipelinerun.tekton.dev/echo-pipeline-run-h79qq created
pipelinerun.tekton.dev/echo-pipeline-run-mgzwg created
pipelinerun.tekton.dev/echo-pipeline-run-mm62x created
2024/09/02 08:04:47 output: task.tekton.dev/echo-task created
2024/09/02 08:04:47 output: taskrun.tekton.dev/echo-task-run-kbz9r created
taskrun.tekton.dev/echo-task-run-lp89b created
taskrun.tekton.dev/echo-task-run-x75mp created
taskrun.tekton.dev/echo-task-run-8n4hd created
taskrun.tekton.dev/echo-task-run-b4lp2 created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/09/02 08:04:48 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "*/1 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/09/02 08:04:48 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:04:53 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:04:53 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/09/02 08:04:53 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:06:03 Verifying if 5 number of pipelinerun are present
      * "5" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:06:08 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:06:08 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/09/02 08:06:13 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:06:13 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/09/02 08:06:26 output: project.project.openshift.io "releasetest-x6x8k" deleted
  ## Verify auto prune with keep-since: PIPELINES-12-TC04	
2024/09/02 08:06:26 output: Now using project "releasetest-9r8qg" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:06:26 Verify SA "pipeline" is created in namespace "releasetest-9r8qg"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 08:06:31 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:06:31 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/09/02 08:06:32 output: pipelinerun.tekton.dev/echo-pipeline-run-hv77v created
pipelinerun.tekton.dev/echo-pipeline-run-m9kwf created
pipelinerun.tekton.dev/echo-pipeline-run-9v827 created
pipelinerun.tekton.dev/echo-pipeline-run-86t2t created
pipelinerun.tekton.dev/echo-pipeline-run-gq94b created
2024/09/02 08:06:32 output: task.tekton.dev/echo-task created
2024/09/02 08:06:32 output: taskrun.tekton.dev/echo-task-run-46vbz created
taskrun.tekton.dev/echo-task-run-swxdg created
taskrun.tekton.dev/echo-task-run-mg644 created
taskrun.tekton.dev/echo-task-run-vl88s created
taskrun.tekton.dev/echo-task-run-phngk created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/09/02 08:06:32 Sleeping for 120 seconds
      * Sleep for "120" seconds	 ...[PASS]
2024/09/02 08:08:32 output: pipelinerun.tekton.dev/echo-pipeline-run-lmg6m created
pipelinerun.tekton.dev/echo-pipeline-run-p4d8z created
pipelinerun.tekton.dev/echo-pipeline-run-s8llr created
pipelinerun.tekton.dev/echo-pipeline-run-62p82 created
pipelinerun.tekton.dev/echo-pipeline-run-t7hjh created
2024/09/02 08:08:33 output: taskrun.tekton.dev/echo-task-run-td9sj created
taskrun.tekton.dev/echo-task-run-w5k5d created
taskrun.tekton.dev/echo-task-run-m5p2q created
taskrun.tekton.dev/echo-task-run-vttrq created
taskrun.tekton.dev/echo-task-run-9tjsm created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |2   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/09/02 08:08:33 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "without" keep "" schedule "*/1 * * * *" resources "pipelinerun,taskrun" and "with" keep-since "2"	 ...[PASS]
2024/09/02 08:08:33 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:08:38 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:08:38 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/09/02 08:08:38 Verifying if 5 number of pipelinerun are present
      * "5" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:09:03 Verifying if 10 number of taskruns are present
      * "10" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:09:08 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:09:08 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/09/02 08:09:13 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:09:13 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/09/02 08:09:28 output: project.project.openshift.io "releasetest-9r8qg" deleted
  ## Verify auto prune add resources taskrun and pipelinerun per namespace with annotation: PIPELINES-12-TC07	
2024/09/02 08:09:28 output: Now using project "releasetest-wfrrx" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:09:28 Verify SA "pipeline" is created in namespace "releasetest-wfrrx"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 08:09:33 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:09:34 output: task.tekton.dev/echo-task-pipeline created
pipeline.tekton.dev/echo-pipeline created
2024/09/02 08:09:34 output: pipelinerun.tekton.dev/echo-pipeline-run-s2zbb created
pipelinerun.tekton.dev/echo-pipeline-run-fcx9z created
pipelinerun.tekton.dev/echo-pipeline-run-ll5m2 created
pipelinerun.tekton.dev/echo-pipeline-run-wq7r8 created
pipelinerun.tekton.dev/echo-pipeline-run-r24nm created
2024/09/02 08:09:34 output: task.tekton.dev/echo-task created
2024/09/02 08:09:34 output: taskrun.tekton.dev/echo-task-run-rd8l8 created
taskrun.tekton.dev/echo-task-run-qqgn4 created
taskrun.tekton.dev/echo-task-run-t9qvw created
taskrun.tekton.dev/echo-task-run-xj2k9 created
taskrun.tekton.dev/echo-task-run-d6rkh created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipeline-for-pruner.yaml   |
         |2   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |3   |testdata/pruner/task/task-for-pruner.yaml           |
         |4   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/09/02 08:09:34 Annotating namespace releasetest-wfrrx with operator.tekton.dev/prune.resources=pipelinerun,taskrun
2024/09/02 08:09:34 output: namespace/releasetest-wfrrx annotated
      * Annotate namespace with "operator.tekton.dev/prune.resources=pipelinerun,taskrun"	 ...[PASS]
2024/09/02 08:09:34 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "*/1 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/09/02 08:09:34 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:09:39 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:09:39 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/09/02 08:09:39 Verifying if 2 number of pipelinerun are present
      * "2" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:10:04 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:10:09 Removing annotation releasetest-wfrrx from namespace operator.tekton.dev/prune.resources
2024/09/02 08:10:09 output: namespace/releasetest-wfrrx annotated
      * Remove annotation "operator.tekton.dev/prune.resources" from namespace	 ...[PASS]
2024/09/02 08:10:10 output: pipelinerun.tekton.dev/echo-pipeline-run-2dbmm created
pipelinerun.tekton.dev/echo-pipeline-run-b8klj created
pipelinerun.tekton.dev/echo-pipeline-run-47mss created
pipelinerun.tekton.dev/echo-pipeline-run-r57sv created
pipelinerun.tekton.dev/echo-pipeline-run-kxrkp created
2024/09/02 08:10:10 output: taskrun.tekton.dev/echo-task-run-68db4 created
taskrun.tekton.dev/echo-task-run-2jwmz created
taskrun.tekton.dev/echo-task-run-j79xp created
taskrun.tekton.dev/echo-task-run-d4srk created
taskrun.tekton.dev/echo-task-run-5bqbg created
      * Create 
      
         |S.NO|resource_dir                                        |
         |----|----------------------------------------------------|
         |1   |testdata/pruner/pipeline/pipelinerun-for-pruner.yaml|
         |2   |testdata/pruner/task/taskrun-for-pruner.yaml        |	 ...[PASS]
2024/09/02 08:10:10 Verifying if 7 number of pipelinerun are present
      * "7" pipelinerun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:10:15 Verifying if 2 number of taskruns are present
      * "2" taskrun(s) should be present within "120" seconds	 ...[PASS]
2024/09/02 08:11:05 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:11:05 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/09/02 08:11:10 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:11:10 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/09/02 08:11:25 output: project.project.openshift.io "releasetest-wfrrx" deleted
  ## Verify auto prune cronjob contains single container: PIPELINES-12-TC14	
2024/09/02 08:11:25 output: Now using project "releasetest-j9x2c" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:11:25 output: tektonconfig.operator.tekton.dev/config patched
      * Update pruner config "with" keep "2" schedule "20 * * * *" resources "taskrun" and "without" keep-since ""	 ...[PASS]
2024/09/02 08:11:25 Check if project test-project-1 already exists
2024/09/02 08:11:25 Creating project test-project-1
2024/09/02 08:11:26 output: Now using project "test-project-1" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "test-project-1"	 ...[PASS]
2024/09/02 08:11:26 Check if project test-project-2 already exists
2024/09/02 08:11:26 Creating project test-project-2
2024/09/02 08:11:26 output: Now using project "test-project-2" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Create project "test-project-2"	 ...[PASS]
2024/09/02 08:11:26 Sleeping for 10 seconds
      * Sleep for "10" seconds	 ...[PASS]
2024/09/02 08:11:36 Verifying if the cronjob with prefix tekton-resource-pruner in namespace openshift-pipelines contains 1 number of containers
2024/09/02 08:11:36 1 containers found in the cronjob spec
      * Assert pruner cronjob(s) in namespace "target namespace" contains "1" number of container(s)	 ...[PASS]
2024/09/02 08:11:36 Deleting project test-project-1
2024/09/02 08:11:43 output: project.project.openshift.io "test-project-1" deleted
      * Delete project "test-project-1"	 ...[PASS]
2024/09/02 08:11:43 Deleting project test-project-2
2024/09/02 08:11:49 output: project.project.openshift.io "test-project-2" deleted
      * Delete project "test-project-2"	 ...[PASS]
2024/09/02 08:11:49 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:11:56 output: project.project.openshift.io "releasetest-j9x2c" deleted
  ## Verify that the operator is up and running after deleting namespace with pruner annotation: PIPELINES-12-TC15	
2024/09/02 08:11:56 output: Now using project "releasetest-bsnp5" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:11:56 Verify SA "pipeline" is created in namespace "releasetest-bsnp5"
      * Verify ServiceAccount "pipeline" exist	 ...[PASS]
2024/09/02 08:12:02 Removing pruner configuration from config CR
      * Remove auto pruner configuration from config CR	 ...[PASS]
2024/09/02 08:12:02 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/09/02 08:12:07 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:07 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/09/02 08:12:07 output: namespace/namespace-one created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pruner/namespaces/namespace-one.yaml|	 ...[PASS]
2024/09/02 08:12:07 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:12 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:12 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/09/02 08:12:12 Deleting project namespace-one
2024/09/02 08:12:18 output: project.project.openshift.io "namespace-one" deleted
      * Delete project "namespace-one"	 ...[PASS]
2024/09/02 08:12:18 Sleeping for 5 seconds
      * Sleep for "5" seconds	 ...[PASS]
2024/09/02 08:12:23 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/09/02 08:12:28 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:28 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:12:28 output: namespace/namespace-two created
      * Create 
      
         |S.NO|resource_dir                                 |
         |----|---------------------------------------------|
         |1   |testdata/pruner/namespaces/namespace-two.yaml|	 ...[PASS]
2024/09/02 08:12:28 Verifying if the cronjob tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:33 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:33 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "present" in target namespace	 ...[PASS]
2024/09/02 08:12:33 Deleting project namespace-two
2024/09/02 08:12:39 output: project.project.openshift.io "namespace-two" deleted
      * Delete project "namespace-two"	 ...[PASS]
2024/09/02 08:12:39 Sleeping for 5 seconds
      * Sleep for "5" seconds	 ...[PASS]
2024/09/02 08:12:44 Verifying if the cronjob tekton-resource-pruner is not present in namespace openshift-pipelines
2024/09/02 08:12:49 Verifying if cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
2024/09/02 08:12:49 Cronjob with prefix tekton-resource-pruner is present in namespace openshift-pipelines
      * Assert if cronjob with prefix "tekton-resource-pruner" is "not present" in target namespace	 ...[PASS]
2024/09/02 08:12:56 output: project.project.openshift.io "releasetest-bsnp5" deleted
2024/09/02 08:12:56 output: tektonconfig.operator.tekton.dev/config patched

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_08.12.56/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 08.12.56

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	495.396s
Runner with PID:32661 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	5 executed	5 passed	0 failed	0 skipped

Total time taken: 8m15.317s
gauge run specs/operator/rbac.spec
log-level : [debug]
tags : [sanity]
verbose : [true]
env will be loaded from default directory 'env'
'gauge_environment' set to 'default'
Created gauge_screenshots_dir at /tmp/release-tests/.gauge/screenshots
Plugin go is already installed.
Plugin html-report is already installed.
Plugin xml-report is already installed.
Parsing started.
Started concepts parsing.
14 concepts parsing completed.
Started specifications parsing.
1 specifications parsing completed.
Applying tags filter: sanity
The following specifications satisfy filter criteria:
specs/operator/rbac.spec
Parsing completed.
Starting go runner
Checking updates...
Downloading https://downloads.gauge.org/plugin/go?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/html-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Downloading https://downloads.gauge.org/plugin/xml-report?l=go&p=go,html-report,xml-report&o=linux&a=amd64
Established connection to runner.
Validation started.
Validation completed.
Run started
Starting Html Report plugin
Setting MaxRecvMsgSize = 1024 MB
Attempting to connect to grpc server at port: 39855
Successfully made the connection with plugin with port: 39855
Starting Xml Report plugin
Attempting to connect to grpc server at port: 45007
Successfully made the connection with plugin with port: 45007
Initialising suite data store.
# Verify RBAC Resources
  ## Disable RBAC resource creation: PIPELINES-11-TC01	
2024/09/02 08:13:02 output: Now using project "releasetest-plsjc" on server "https://api.ci-op-14jgfssm-143fc.cspilp.interop.ccitredhat.com:6443".
You can add applications to this project with the 'new-app' command. For example, try:
oc new-app rails-postgresql-example
to build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:
kubectl create deployment hello-node --image=registry.k8s.io/e2e-test-images/agnhost:2.43 -- /agnhost serve-hostname
2024/09/02 08:13:02 Waiting for operator to be up and running....
2024/09/02 08:13:02 Operator is up
      * Validate Operator should be installed	 ...[PASS]
2024/09/02 08:13:02 enable auto creation of RBAC resources
2024/09/02 08:13:02 output: tektonconfig.operator.tekton.dev/config patched (no change)
      * Update TektonConfig CR to use param with name createRbacResource and value "true" to "enable" auto creation of RBAC resources	 ...[PASS]
2024/09/02 08:13:02 Verifying that TektonConfig status is "installed"
2024/09/02 08:13:07 Verifying that service account pipeline exists
2024/09/02 08:13:12 Verifying that cluster role pipelines-scc-clusterrole exists
2024/09/02 08:13:17 Verifying that config map config-service-cabundle exists
2024/09/02 08:13:22 Verifying that config map config-trusted-cabundle exists
2024/09/02 08:13:27 Verifying that role binding openshift-pipelines-edit exists
2024/09/02 08:13:32 Verifying that role binding pipelines-scc-rolebinding exists
2024/09/02 08:13:37 Verifying that security context constraint pipelines-scc exists
      * Verify RBAC resources are auto created successfully	 ...[PASS]
2024/09/02 08:13:37 disable auto creation of RBAC resources
2024/09/02 08:13:37 output: tektonconfig.operator.tekton.dev/config patched
      * Update TektonConfig CR to use param with name createRbacResource and value "false" to "disable" auto creation of RBAC resources	 ...[PASS]
2024/09/02 08:13:42 Verifying that service account pipeline exists
2024/09/02 08:13:47 Verifying that cluster role pipelines-scc-clusterrole doesn't exist
2024/09/02 08:13:52 Verifying that config map config-service-cabundle doesn't exist
2024/09/02 08:13:57 Verifying that config map config-trusted-cabundle doesn't exist
2024/09/02 08:14:02 Verifying that role binding edit doesn't exist
2024/09/02 08:14:07 Verifying that role binding pipelines-scc-rolebinding doesn't exist
2024/09/02 08:14:12 Verifying that security context constraint pipelines-scc doesn't exist
      * Verify RBAC resources disabled successfully	 ...[PASS]
2024/09/02 08:14:12 enable auto creation of RBAC resources
2024/09/02 08:14:12 output: tektonconfig.operator.tekton.dev/config patched
      * Update TektonConfig CR to use param with name createRbacResource and value "true" to "enable" auto creation of RBAC resources	 ...[PASS]
2024/09/02 08:14:12 Verifying that TektonConfig status is "installed"
2024/09/02 08:14:17 Verifying that service account pipeline exists
2024/09/02 08:14:22 Verifying that cluster role pipelines-scc-clusterrole exists
2024/09/02 08:14:27 Verifying that config map config-service-cabundle exists
2024/09/02 08:14:32 Verifying that config map config-trusted-cabundle exists
2024/09/02 08:14:37 Verifying that role binding openshift-pipelines-edit exists
2024/09/02 08:14:42 Verifying that role binding pipelines-scc-rolebinding exists
2024/09/02 08:14:47 Verifying that security context constraint pipelines-scc exists
      * Verify RBAC resources are auto created successfully	 ...[PASS]
2024/09/02 08:14:54 output: project.project.openshift.io "releasetest-plsjc" deleted

Transformed SuiteResult to report structure
Successfully generated html-report to => /logs/artifacts/html-report/2024-09-02_08.14.54/index.html

Done generating HTML report using theme from /tmp/plugins/html-report/4.3.1/themes/default
Successfully generated xml-report to => /logs/artifacts/xml-report/2024-09-02 08.14.54

Sending kill message to Html Report plugin.
Sending kill message to Xml Report plugin.
Sending kill message to runner.
ok  	command-line-arguments	112.353s
Runner with PID:34247 has exited
Specifications:	1 executed	1 passed	0 failed	0 skipped
Scenarios:	1 executed	1 passed	0 failed	0 skipped

Total time taken: 1m52.287s
Rename xml files to junit_test_*.xml