INFO[2025-04-14T06:06:46Z] ci-operator version v20250411-808abc999      
INFO[2025-04-14T06:06:46Z] Loading configuration from https://config.ci.openshift.org for openshift/grafana-tempo-operator@main [tempo-product-ocp-4.19-lp-interop] 
INFO[2025-04-14T06:06:46Z] Resolved SHA missing for main in https://github.com/openshift/grafana-tempo-operator (will prevent caching) 
WARN[2025-04-14T06:06:46Z] skipped directory "..2025_04_14_06_06_40.1465408137" when creating secret from directory "/secrets/ci-pull-credentials" 
INFO[2025-04-14T06:06:46Z] Requesting a release from https://amd64.ocp.releases.ci.openshift.org/api/v1/releasestream/4.19.0-0.nightly/latest 
INFO[2025-04-14T06:06:46Z] Resolved release latest to registry.ci.openshift.org/ocp/release:4.19.0-0.nightly-2025-04-10-031621 
INFO[2025-04-14T06:06:46Z] Using namespace https://console-openshift-console.apps.build06.ci.devcluster.openshift.com/k8s/cluster/projects/ci-op-q80zlqyr 
INFO[2025-04-14T06:06:46Z] Setting arch for src                          arch=amd64 reasons=tempo-tests-runner
INFO[2025-04-14T06:06:46Z] Running [input:root], [input:cli], [input:ocp-cli-jq-latest], [input:origin-centos-8], [input:ocp-4.12-upi-installer], [input:ocp-4.14-upi-installer], [input:ocp-4.16-upi-installer], [input:firewatch-firewatch-main], [release:latest], src, tempo-tests-runner, [output:stable:tempo-tests-runner], [images], tempo-interop-aws 
INFO[2025-04-14T06:06:47Z] Loading information from https://config.ci.openshift.org for cluster profile aws-cspi-qe 
INFO[2025-04-14T06:06:47Z] Tagging ocp/cli-jq:latest into pipeline:ocp-cli-jq-latest. 
INFO[2025-04-14T06:06:47Z] Tagging origin/centos:8 into pipeline:origin-centos-8. 
INFO[2025-04-14T06:06:47Z] Tagging ocp/4.12:upi-installer into pipeline:ocp-4.12-upi-installer. 
INFO[2025-04-14T06:06:47Z] Tagging ocp/4.14:upi-installer into pipeline:ocp-4.14-upi-installer. 
INFO[2025-04-14T06:06:47Z] Tagging ocp/builder:rhel-8-golang-1.23-openshift-4.19 into pipeline:root. 
INFO[2025-04-14T06:06:47Z] Tagging ocp/4.19:cli into pipeline:cli.      
INFO[2025-04-14T06:06:47Z] Tagging firewatch/firewatch:main into pipeline:firewatch-firewatch-main. 
INFO[2025-04-14T06:06:47Z] Tagging ocp/4.16:upi-installer into pipeline:ocp-4.16-upi-installer. 
INFO[2025-04-14T06:06:47Z] Importing release image latest.              
INFO[2025-04-14T06:06:47Z] Requesting a release from https://amd64.ocp.releases.ci.openshift.org/api/v1/releasestream/4.19.0-0.nightly/latest 
INFO[2025-04-14T06:06:47Z] Resolved release latest to registry.ci.openshift.org/ocp/release:4.19.0-0.nightly-2025-04-10-031621 
INFO[2025-04-14T06:06:56Z] Building src                                 
INFO[2025-04-14T06:06:56Z] Created build "src-amd64"                    
INFO[2025-04-14T06:08:28Z] Importing release 4.19.0-0.nightly-2025-04-10-031621 created at 2025-04-10 03:19:30 +0000 UTC with 189 images to tag release:latest ... 
INFO[2025-04-14T06:08:38Z] Build src-amd64 succeeded after 1m42s        
INFO[2025-04-14T06:08:38Z] Retrieving digests of member images          
INFO[2025-04-14T06:08:39Z] Image ci-op-q80zlqyr/pipeline:src created     digest=sha256:b812694c745929ece466c5273033b91cd7794e05fcfcc51f249b4df5a346a712 for-build=src
INFO[2025-04-14T06:08:39Z] Building tempo-tests-runner                  
INFO[2025-04-14T06:08:39Z] Created build "tempo-tests-runner-amd64"     
INFO[2025-04-14T06:10:40Z] Imported release 4.19.0-0.nightly-2025-04-10-031621 created at 2025-04-10 03:19:30 +0000 UTC with 189 images to tag release:latest 
INFO[2025-04-14T06:15:06Z] Build tempo-tests-runner-amd64 succeeded after 6m27s 
INFO[2025-04-14T06:15:06Z] Retrieving digests of member images          
INFO[2025-04-14T06:15:08Z] Image ci-op-q80zlqyr/pipeline:tempo-tests-runner created  digest=sha256:4edf3a919c68efa7b70e38a6062e314034c5622b6db3fc241e11e3eea570521e for-build=tempo-tests-runner
INFO[2025-04-14T06:15:08Z] Tagging tempo-tests-runner into stable       
INFO[2025-04-14T06:15:08Z] Acquiring leases for test tempo-interop-aws: [aws-cspi-qe-quota-slice] 
INFO[2025-04-14T06:15:08Z] Acquired 1 lease(s) for aws-cspi-qe-quota-slice: [us-east-1--aws-cspi-qe-quota-slice-22] 
INFO[2025-04-14T06:15:08Z] Running multi-stage test tempo-interop-aws   
INFO[2025-04-14T06:15:09Z] Running multi-stage phase pre                
INFO[2025-04-14T06:15:09Z] Running step tempo-interop-aws-install-operators-verify. 
INFO[2025-04-14T06:15:21Z] Step tempo-interop-aws-install-operators-verify succeeded after 11s. 
INFO[2025-04-14T06:15:21Z] Running step tempo-interop-aws-ipi-conf.     
INFO[2025-04-14T06:15:30Z] Step tempo-interop-aws-ipi-conf succeeded after 9s. 
INFO[2025-04-14T06:15:30Z] Running step tempo-interop-aws-ipi-conf-telemetry. 
INFO[2025-04-14T06:15:40Z] Step tempo-interop-aws-ipi-conf-telemetry succeeded after 9s. 
INFO[2025-04-14T06:15:40Z] Running step tempo-interop-aws-ipi-conf-aws. 
INFO[2025-04-14T06:15:53Z] Step tempo-interop-aws-ipi-conf-aws succeeded after 13s. 
INFO[2025-04-14T06:15:53Z] Running step tempo-interop-aws-ipi-conf-aws-byo-ipv4-pool-public. 
INFO[2025-04-14T06:16:02Z] Step tempo-interop-aws-ipi-conf-aws-byo-ipv4-pool-public succeeded after 9s. 
INFO[2025-04-14T06:16:02Z] Running step tempo-interop-aws-ipi-install-monitoringpvc. 
INFO[2025-04-14T06:16:15Z] Step tempo-interop-aws-ipi-install-monitoringpvc succeeded after 13s. 
INFO[2025-04-14T06:16:15Z] Running step tempo-interop-aws-ipi-conf-aws-user-min-permissions. 
INFO[2025-04-14T06:16:31Z] Step tempo-interop-aws-ipi-conf-aws-user-min-permissions succeeded after 15s. 
INFO[2025-04-14T06:16:31Z] Running step tempo-interop-aws-aws-provision-iam-user. 
INFO[2025-04-14T06:16:42Z] Step tempo-interop-aws-aws-provision-iam-user succeeded after 10s. 
INFO[2025-04-14T06:16:42Z] Running step tempo-interop-aws-ipi-install-rbac. 
INFO[2025-04-14T06:16:56Z] Step tempo-interop-aws-ipi-install-rbac succeeded after 14s. 
INFO[2025-04-14T06:16:56Z] Running step tempo-interop-aws-openshift-cluster-bot-rbac. 
INFO[2025-04-14T06:17:09Z] Step tempo-interop-aws-openshift-cluster-bot-rbac succeeded after 12s. 
INFO[2025-04-14T06:17:09Z] Running step tempo-interop-aws-ipi-install-hosted-loki. 
INFO[2025-04-14T06:17:21Z] Step tempo-interop-aws-ipi-install-hosted-loki succeeded after 12s. 
INFO[2025-04-14T06:17:21Z] Running step tempo-interop-aws-ipi-install-install. 
INFO[2025-04-14T06:56:58Z] Step tempo-interop-aws-ipi-install-install succeeded after 39m36s. 
INFO[2025-04-14T06:56:58Z] Running step tempo-interop-aws-ipi-install-times-collection. 
INFO[2025-04-14T06:57:13Z] Step tempo-interop-aws-ipi-install-times-collection succeeded after 15s. 
INFO[2025-04-14T06:57:13Z] Running step tempo-interop-aws-nodes-readiness. 
INFO[2025-04-14T06:57:44Z] Step tempo-interop-aws-nodes-readiness succeeded after 31s. 
INFO[2025-04-14T06:57:44Z] Running step tempo-interop-aws-multiarch-validate-nodes. 
INFO[2025-04-14T06:58:13Z] Step tempo-interop-aws-multiarch-validate-nodes succeeded after 29s. 
INFO[2025-04-14T06:58:13Z] Step phase pre succeeded after 43m3s.        
INFO[2025-04-14T06:58:13Z] Running multi-stage phase test               
INFO[2025-04-14T06:58:13Z] Running step tempo-interop-aws-install-operators. 
INFO[2025-04-14T07:05:00Z] Step tempo-interop-aws-install-operators succeeded after 6m47s. 
INFO[2025-04-14T07:05:00Z] Running step tempo-interop-aws-distributed-tracing-tests-tempo-interop. 
INFO[2025-04-14T08:21:31Z] Logs for container test in pod tempo-interop-aws-distributed-tracing-tests-tempo-interop: 
INFO[2025-04-14T08:21:31Z] No /tmp/secret/api.login present. This is not an HCP or ROSA cluster. Continue using $KUBECONFIG env path.
Cloning into '/tmp/tempo-tests'...
Switched to a new branch 'rhosdt-3-5'
branch 'rhosdt-3-5' set up to track 'origin/rhosdt-3-5'.
test -s /tmp/tempo-tests/bin/controller-gen-v0.16.5 || @[ -f /tmp/tempo-tests/bin/controller-gen-v0.16.5 ] || { set -e ; TMP_DIR=$(mktemp -d) ; cd $TMP_DIR ; go mod init tmp ; echo "Downloading sigs.k8s.io/controller-tools/cmd/controller-gen" ; go get -d sigs.k8s.io/controller-tools/cmd/controller-gen@v0.16.5 ; GOBIN=/tmp/tempo-tests/bin go install -mod=mod sigs.k8s.io/controller-tools/cmd/controller-gen ; APP=$(echo "/tmp/tempo-tests/bin/controller-gen") ; APP_NAME=$(echo "$APP-v0.16.5") ; mv "$APP" "$APP_NAME" ; rm -rf $TMP_DIR ; }
bash: line 1: @[: command not found
go: creating new go.mod: module tmp
Downloading sigs.k8s.io/controller-tools/cmd/controller-gen
go: -d flag is deprecated. -d=true is a no-op
go: downloading sigs.k8s.io/controller-tools v0.16.5
go: downloading github.com/spf13/cobra v1.8.1
go: downloading github.com/gobuffalo/flect v1.0.3
go: downloading k8s.io/apiextensions-apiserver v0.31.2
go: downloading k8s.io/apimachinery v0.31.2
go: downloading k8s.io/utils v0.0.0-20240711033017-18e509b52bc8
go: downloading k8s.io/api v0.31.2
go: downloading github.com/fatih/color v1.18.0
go: downloading golang.org/x/tools v0.26.0
go: downloading gopkg.in/yaml.v2 v2.4.0
go: downloading gopkg.in/yaml.v3 v3.0.1
go: downloading sigs.k8s.io/yaml v1.4.0
go: downloading github.com/mattn/go-colorable v0.1.13
go: downloading github.com/mattn/go-isatty v0.0.20
go: downloading golang.org/x/sys v0.26.0
go: downloading github.com/inconshreveable/mousetrap v1.1.0
go: downloading github.com/spf13/pflag v1.0.5
go: downloading github.com/gogo/protobuf v1.3.2
go: downloading github.com/google/gofuzz v1.2.0
go: downloading k8s.io/klog/v2 v2.130.1
go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.4.1
go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
go: downloading gopkg.in/inf.v0 v0.9.1
go: downloading github.com/fxamacker/cbor/v2 v2.7.0
go: downloading golang.org/x/net v0.30.0
go: downloading github.com/go-logr/logr v1.4.2
go: downloading github.com/json-iterator/go v1.1.12
go: downloading github.com/x448/float16 v0.8.4
go: downloading github.com/modern-go/reflect2 v1.0.2
go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: downloading golang.org/x/text v0.19.0
go: downloading golang.org/x/sync v0.8.0
go: downloading golang.org/x/mod v0.21.0
go: added github.com/fatih/color v1.18.0
go: added github.com/fxamacker/cbor/v2 v2.7.0
go: added github.com/go-logr/logr v1.4.2
go: added github.com/gobuffalo/flect v1.0.3
go: added github.com/gogo/protobuf v1.3.2
go: added github.com/google/gofuzz v1.2.0
go: added github.com/inconshreveable/mousetrap v1.1.0
go: added github.com/json-iterator/go v1.1.12
go: added github.com/mattn/go-colorable v0.1.13
go: added github.com/mattn/go-isatty v0.0.20
go: added github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: added github.com/modern-go/reflect2 v1.0.2
go: added github.com/spf13/cobra v1.8.1
go: added github.com/spf13/pflag v1.0.5
go: added github.com/x448/float16 v0.8.4
go: added golang.org/x/mod v0.21.0
go: added golang.org/x/net v0.30.0
go: added golang.org/x/sync v0.8.0
go: added golang.org/x/sys v0.26.0
go: added golang.org/x/text v0.19.0
go: added golang.org/x/tools v0.26.0
go: added gopkg.in/inf.v0 v0.9.1
go: added gopkg.in/yaml.v2 v2.4.0
go: added gopkg.in/yaml.v3 v3.0.1
go: added k8s.io/api v0.31.2
go: added k8s.io/apiextensions-apiserver v0.31.2
go: added k8s.io/apimachinery v0.31.2
go: added k8s.io/klog/v2 v2.130.1
go: added k8s.io/utils v0.0.0-20240711033017-18e509b52bc8
go: added sigs.k8s.io/controller-tools v0.16.5
go: added sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd
go: added sigs.k8s.io/structured-merge-diff/v4 v4.4.1
go: added sigs.k8s.io/yaml v1.4.0
/tmp/tempo-tests/bin/controller-gen-v0.16.5 object:headerFile="hack/boilerplate.go.txt" paths="./..."
go fmt ./...
CGO_ENABLED=0 go build -o bin/manager -ldflags "-X github.com/grafana/tempo-operator/internal/version.buildDate=2025-04-14T07:06:08Z -X github.com/grafana/tempo-operator/internal/version.revision=7aa3478f48784e94b90261320a54614c1bb59858 -X github.com/grafana/tempo-operator/internal/version.operatorVersion=0.15.1 -X github.com/grafana/tempo-operator/internal/version.tempoVersion=2.7.1 -X github.com/grafana/tempo-operator/internal/version.tempoQueryVersion=2.7.1" cmd/main.go
Warning: resource configmaps/cluster-monitoring-config is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.
configmap/cluster-monitoring-config configured
Version: 0.2.12
Loading config (.chainsaw-openshift.yaml)...
- Using test file: chainsaw-test
- TestDirs [tests/e2e tests/e2e-openshift tests/e2e-openshift-serverless tests/e2e-openshift-ossm tests/e2e-long-running tests/e2e-openshift-object-stores tests/operator-metrics]
- SkipDelete false
- FailFast false
- ReportFormat 'XML'
- ReportName 'junit_tempo_e2e'
- ReportPath '/logs/artifacts'
- Namespace ''
- FullName false
- IncludeTestRegex ''
- ExcludeTestRegex ''
- ApplyTimeout 10s
- AssertTimeout 5m0s
- CleanupTimeout 5m0s
- DeleteTimeout 5m0s
- ErrorTimeout 5m0s
- ExecTimeout 5m0s
- DeletionPropagationPolicy Background
- Template true
- NoCluster false
- PauseOnFailure false
Loading tests...
- tempostack-retention-global (tests/e2e-long-running/tempostack-retention-global)
- ossm-monolithic-otel (tests/e2e-openshift-ossm/ossm-monolithic-otel)
- ossm-tempostack (tests/e2e-openshift-ossm/ossm-tempostack)
- ossm-tempostack-otel (tests/e2e-openshift-ossm/ossm-tempostack-otel)
- otel-tempo-serverless (tests/e2e-openshift-serverless/otel-tempo-serverless)
- tempo-serverless (tests/e2e-openshift-serverless/tempo-serverless)
- component-replicas (tests/e2e-openshift/component-replicas)
- monitoring (tests/e2e-openshift/monitoring)
- monolithic-monitoring (tests/e2e-openshift/monitoring-monolithic)
- monolithic-multitenancy-openshift (tests/e2e-openshift/monolithic-multitenancy-openshift)
- monolithic-multitenancy-static (tests/e2e-openshift/monolithic-multitenancy-static)
- monolithic-route (tests/e2e-openshift/monolithic-route)
- monolithic-single-tenant-auth (tests/e2e-openshift/monolithic-single-tenant-auth)
- multitenancy (tests/e2e-openshift/multitenancy)
- multitenancy-rbac (tests/e2e-openshift/multitenancy-rbac)
- red-metrics (tests/e2e-openshift/red-metrics)
- route (tests/e2e-openshift/route)
- tempo-single-tenant-auth (tests/e2e-openshift/tempo-single-tenant-auth)
- tempostack-resources (tests/e2e-openshift/tempostack-resources)
- tls-singletenant-monolithic (tests/e2e-openshift/tls-monolithic-singletenant)
- tls-singletenant (tests/e2e-openshift/tls-singletenant)
- compatibility (tests/e2e/compatibility)
- custom-ca (tests/e2e/custom-ca)
- gateway (tests/e2e/gateway)
- generate (tests/e2e/generate)
- monolithic-extraconfig (tests/e2e/monolithic-extraconfig)
- monolithic-ingestion-mtls (tests/e2e/monolithic-ingestion-mtls)
- monolithic-memory (tests/e2e/monolithic-memory)
- monolithic-pv (tests/e2e/monolithic-pv)
- monolithic-receivers-tls (tests/e2e/monolithic-receivers-tls)
- monolithic-s3-tls (tests/e2e/monolithic-s3-tls)
- receivers-mtls (tests/e2e/receivers-mtls)
- receivers-tls (tests/e2e/receivers-tls)
- reconcile (tests/e2e/reconcile)
- tempostack-extraconfig (tests/e2e/tempostack-extraconfig)
- operator-metrics (tests/operator-metrics/max-loops)
Loading values...
Running tests...
=== RUN   chainsaw
=== PAUSE chainsaw
=== CONT  chainsaw
=== RUN   chainsaw/tempostack-retention-global
=== PAUSE chainsaw/tempostack-retention-global
=== RUN   chainsaw/ossm-monolithic-otel
    l.go:52: | 07:06:25 | ossm-monolithic-otel | @chainsaw                                                              | CREATE    | OK    | v1/Namespace @ chainsaw-choice-fowl
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | TRY       | BEGIN |
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | RUN   | v1/Namespace @ istio-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | CREATE    | OK    | v1/Namespace @ istio-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | DONE  | v1/Namespace @ istio-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | RUN   | v1/Namespace @ tracing-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | CREATE    | OK    | v1/Namespace @ tracing-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | DONE  | v1/Namespace @ tracing-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | RUN   | v1/Namespace @ bookinfo
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | CREATE    | OK    | v1/Namespace @ bookinfo
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | DONE  | v1/Namespace @ bookinfo
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | RUN   | v1/Namespace @ otlp-app
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | CREATE    | OK    | v1/Namespace @ otlp-app
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | DONE  | v1/Namespace @ otlp-app
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | RUN   | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | CREATE    | OK    | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | DONE  | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | RUN   | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | CREATE    | OK    | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | APPLY     | DONE  | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:06:25 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | RUN   | project.openshift.io/v1/Project @ istio-system
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | DONE  | project.openshift.io/v1/Project @ istio-system
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | RUN   | project.openshift.io/v1/Project @ tracing-system
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | DONE  | project.openshift.io/v1/Project @ tracing-system
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | RUN   | project.openshift.io/v1/Project @ bookinfo
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | DONE  | project.openshift.io/v1/Project @ bookinfo
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | RUN   | project.openshift.io/v1/Project @ otlp-app
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | DONE  | project.openshift.io/v1/Project @ otlp-app
    l.go:52: | 07:06:26 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | RUN   | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | DONE  | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | RUN   | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install OSSM                                                           | ASSERT    | DONE  | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install OSSM                                                           | TRY       | END   |
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install TempoStack                                                     | TRY       | BEGIN |
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install TempoStack                                                     | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ tracing-system/simplest
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install TempoStack                                                     | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ tracing-system/simplest
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install TempoStack                                                     | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ tracing-system/simplest
    l.go:52: | 07:07:14 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ tracing-system/simplest
    l.go:52: | 07:07:15 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ tracing-system/simplest
    l.go:52: | 07:07:15 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | RUN   | apps/v1/StatefulSet @ tracing-system/tempo-simplest
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | DONE  | apps/v1/StatefulSet @ tracing-system/tempo-simplest
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-jaegerui
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Install TempoStack                                                     | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-jaegerui
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Install TempoStack                                                     | TRY       | END   |
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Update Kiali config                                                    | TRY       | BEGIN |
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Update Kiali config                                                    | PATCH     | RUN   | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Update Kiali config                                                    | PATCH     | OK    | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Update Kiali config                                                    | PATCH     | DONE  | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:07:58 | ossm-monolithic-otel | Update Kiali config                                                    | SLEEP     | RUN   |
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Update Kiali config                                                    | SLEEP     | DONE  |
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Update Kiali config                                                    | ASSERT    | RUN   | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Update Kiali config                                                    | ASSERT    | DONE  | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Update Kiali config                                                    | ASSERT    | RUN   | v1/Pod @ istio-system/*
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Update Kiali config                                                    | ASSERT    | DONE  | v1/Pod @ istio-system/*
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Update Kiali config                                                    | TRY       | END   |
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Install OTEL collector                                                 | TRY       | BEGIN |
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Install OTEL collector                                                 | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Install OTEL collector                                                 | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Install OTEL collector                                                 | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:08:08 | ossm-monolithic-otel | Install OTEL collector                                                 | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/simplest-collector
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Install OTEL collector                                                 | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/simplest-collector
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Install OTEL collector                                                 | TRY       | END   |
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | TRY       | BEGIN |
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | APPLY     | RUN   | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | CREATE    | OK    | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | APPLY     | DONE  | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:08:16 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | SLEEP     | RUN   |
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | SLEEP     | DONE  |
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | ASSERT    | RUN   | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | ASSERT    | DONE  | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | ASSERT    | RUN   | v1/Pod @ istio-system/*
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | ASSERT    | DONE  | v1/Pod @ istio-system/*
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | TRY       | END   |
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | TRY       | BEGIN |
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/Service @ bookinfo/details
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/Service @ bookinfo/details
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/Service @ bookinfo/details
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/Service @ bookinfo/ratings
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/Service @ bookinfo/ratings
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/Service @ bookinfo/ratings
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:08:26 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/Service @ bookinfo/reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/Service @ bookinfo/reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/Service @ bookinfo/reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/Service @ bookinfo/productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/Service @ bookinfo/productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/Service @ bookinfo/productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:08:27 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:08:42 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:08:42 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:08:42 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:08:42 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:08:42 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:08:42 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:08:43 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:08:43 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:08:44 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:08:44 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:08:44 | ossm-monolithic-otel | Install Bookinfo app                                                   | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:08:44 | ossm-monolithic-otel | Install Bookinfo app                                                   | TRY       | END   |
    l.go:52: | 07:08:44 | ossm-monolithic-otel | Generate traces from the bookinfo app                                  | TRY       | BEGIN |
    l.go:52: | 07:08:44 | ossm-monolithic-otel | Generate traces from the bookinfo app                                  | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c for i in {1..20}
        do
            curl http://$(oc -n istio-system get route istio-ingressgateway -o jsonpath='{.spec.host}')/productpage
            sleep 1
        done
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Generate traces from the bookinfo app                                  | SCRIPT    | LOG   |
        === STDOUT
        <!DOCTYPE html>
        <html>
          <head>
            <title>Simple Bookstore App</title>
        <meta charset="utf-8">
        <meta http-equiv="X-UA-Compatible" content="IE=edge">
        <meta name="viewport" content="width=device-width, initial-scale=1.0">
        
        <!-- Latest compiled and minified CSS -->
        <link rel="stylesheet" href="static/bootstrap/css/bootstrap.min.css">
        
        <!-- Optional theme -->
        <link rel="stylesheet" href="static/bootstrap/css/bootstrap-theme.min.css">
        
          </head>
          <body>
            
            
        
        <nav class="navbar navbar-inverse navbar-static-top">
          <div class="container">
            <div class="navbar-header">
              <a class="navbar-brand" href="#">BookInfo Sample</a>
            </div>
            
            <button type="button" class="btn btn-default navbar-btn navbar-right" data-toggle="modal" href="#login-modal">Sign
              in</button>
            
          </div>
        </nav>
        
        <!---
        <div class="navbar navbar-inverse navbar-fixed-top">
          <div class="container">
            <div class="navbar-header pull-left">
              <a class="navbar-brand" href="#">Microservices Fabric BookInfo Demo</a>
            </div>
            <div class="navbar-header pull-right">
              <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse">
                <span class="icon-bar"></span>
                <span class="icon-bar"></span>
                <span class="icon-bar"></span>
              </button>
            </div>
            <div class="navbar-collapse collapse">
        
              <button type="button" class="btn btn-default navbar-btn pull-right" data-toggle="modal" data-target="#login-modal">Sign in</button>
        
            </div>
          </div>
        </div>
        -->
        
        <div id="login-modal" class="modal fade" role="dialog">
          <div class="modal-dialog">
            <div class="modal-content">
              <div class="modal-header">
                <button type="button" class="close" data-dismiss="modal">&times;</button>
                <h4 class="modal-title">Please sign in</h4>
              </div>
              <div class="modal-body">
                <form method="post" action='login' name="login_form">
                  <p><input type="text" class="form-control" name="username" id="username" placeholder="User Name"></p>
                  <p><input type="password" class="form-control" name="passwd" placeholder="Password"></p>
                  <p>
                    <button type="submit" class="btn btn-primary">Sign in</button>
                    <button type="button" class="btn btn-default" data-dismiss="modal">Cancel</button>
                  </p>
                </form>
              </div>
            </div>
        
          </div>
        </div>
        
        <div class="container-fluid">
          <div class="row">
            <div class="col-md-12">
              <h3 class="text-center text-primary">The Comedy of Errors</h3>
              
              <p>Summary: <a href="https://en.wikipedia.org/wiki/The_Comedy_of_Errors">Wikipedia Summary</a>: The Comedy of Errors is one of <b>William Shakespeare's</b> early plays. It is his shortest and one of his most farcical comedies, with a major part of the humour coming from slapstick and mistaken identity, in addition to puns and word play.</p>
              
            </div>
          </div>
        
          <div class="row">
            <div class="col-md-6">
              
              <h4 class="text-center text-primary">Book Details</h4>
              <dl>
                <dt>Type:</dt>paperback
                <dt>Pages:</dt>200
                <dt>Publisher:</dt>PublisherA
                <dt>Language:</dt>English
                <dt>ISBN-10:</dt>1234567890
                <dt>ISBN-13:</dt>123-1234567890
              </dl>
              
            </div>
        
            <div class="col-md-6">
              
              <h4 class="text-center text-primary">Book Reviews</h4>
              
              <blockquote>
                <p>An extremely entertaining play by Shakespeare. The slapstick humour is refreshing!</p>
                <small>Reviewer1</small>
                
              </blockquote>
              
              <blockquote>
                <p>Absolutely fun and entertaining. The play lacks thematic depth when compared to other plays by Shakespeare.</p>
                <small>Reviewer2</small>
                
              </blockquote>
              
              <dl>
                <dt>Reviews served by:</dt>
                <u>reviews-v1-7596b6b569-wmjql</u>
                
              </dl>
              
            </div>
          </div>
        </div>
        
        
            
        <!-- Latest compiled and minified JavaScript -->
        <script src="static/jquery.min.js"></script>
        
        <!-- Latest compiled and minified JavaScript -->
        <script src="static/bootstrap/js/bootstrap.min.js"></script>
        
        <script type="text/javascript">
          $('#login-modal').on('shown.bs.modal', function () {
            $('#username').focus();
          });
        </script>
        
          </body>
        </html>
        === STDERR
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  4294  100  4294    0     0   8030      0 --:--:-- --:--:-- --:--:--  8026
100  4294  100  4294    0     0   8028      0 --:--:-- --:--:-- --:--:--  8026
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Generate traces from the bookinfo app                                  | SCRIPT    | DONE  |
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Generate traces from the bookinfo app                                  | TRY       | END   |
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Check traces in Kiali                                                  | TRY       | BEGIN |
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Check traces in Kiali                                                  | APPLY     | RUN   | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Check traces in Kiali                                                  | CREATE    | OK    | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Check traces in Kiali                                                  | APPLY     | DONE  | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:08:46 | ossm-monolithic-otel | Check traces in Kiali                                                  | ASSERT    | RUN   | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Check traces in Kiali                                                  | ASSERT    | DONE  | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Check traces in Kiali                                                  | TRY       | END   |
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | TRY       | BEGIN |
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | APPLY     | RUN   | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | CREATE    | OK    | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | APPLY     | DONE  | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | APPLY     | RUN   | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | CREATE    | OK    | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | APPLY     | DONE  | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:09:20 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | ASSERT    | RUN   | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | ASSERT    | DONE  | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | ASSERT    | RUN   | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | ASSERT    | DONE  | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | TRY       | END   |
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | TRY       | BEGIN |
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | APPLY     | RUN   | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | CREATE    | OK    | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | APPLY     | DONE  | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:09:24 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | ASSERT    | RUN   | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | ASSERT    | DONE  | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | TRY       | END   |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | CLEANUP   | BEGIN |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | DELETE    | OK    | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Verify the traces sent to OTEL collector in Tempo Monolithic instance. | CLEANUP   | END   |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | CLEANUP   | BEGIN |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | DELETE    | OK    | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | DELETE    | OK    | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP   | CLEANUP   | END   |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Check traces in Kiali                                                  | CLEANUP   | BEGIN |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Check traces in Kiali                                                  | DELETE    | OK    | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Check traces in Kiali                                                  | CLEANUP   | END   |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Install Bookinfo app                                                   | CLEANUP   | BEGIN |
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:09:38 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/Service @ bookinfo/productpage
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/Service @ bookinfo/reviews
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/Service @ bookinfo/ratings
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | DELETE    | OK    | v1/Service @ bookinfo/details
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install Bookinfo app                                                   | CLEANUP   | END   |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | CLEANUP   | BEGIN |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | DELETE    | OK    | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Enable OSSM Tempo provider                                             | CLEANUP   | END   |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install OTEL collector                                                 | CLEANUP   | BEGIN |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install OTEL collector                                                 | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install OTEL collector                                                 | CLEANUP   | END   |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install TempoStack                                                     | CLEANUP   | BEGIN |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install TempoStack                                                     | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ tracing-system/simplest
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install TempoStack                                                     | CLEANUP   | END   |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install OSSM                                                           | CLEANUP   | BEGIN |
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install OSSM                                                           | DELETE    | OK    | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:09:39 | ossm-monolithic-otel | Install OSSM                                                           | DELETE    | OK    | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:09:41 | ossm-monolithic-otel | Install OSSM                                                           | DELETE    | OK    | v1/Namespace @ otlp-app
    l.go:52: | 07:09:49 | ossm-monolithic-otel | Install OSSM                                                           | DELETE    | OK    | v1/Namespace @ bookinfo
    l.go:52: | 07:09:57 | ossm-monolithic-otel | Install OSSM                                                           | DELETE    | OK    | v1/Namespace @ tracing-system
    l.go:52: | 07:10:26 | ossm-monolithic-otel | Install OSSM                                                           | DELETE    | OK    | v1/Namespace @ istio-system
    l.go:52: | 07:10:33 | ossm-monolithic-otel | Install OSSM                                                           | CLEANUP   | END   |
    l.go:52: | 07:10:33 | ossm-monolithic-otel | @chainsaw                                                              | CLEANUP   | BEGIN |
    l.go:52: | 07:10:33 | ossm-monolithic-otel | @chainsaw                                                              | DELETE    | OK    | v1/Namespace @ chainsaw-choice-fowl
    l.go:52: | 07:10:40 | ossm-monolithic-otel | @chainsaw                                                              | CLEANUP   | END   |
=== RUN   chainsaw/ossm-tempostack
    l.go:52: | 07:10:40 | ossm-tempostack | @chainsaw                             | CREATE    | OK    | v1/Namespace @ chainsaw-humorous-hornet
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | TRY       | BEGIN |
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | RUN   | v1/Namespace @ istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | CREATE    | OK    | v1/Namespace @ istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | DONE  | v1/Namespace @ istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | RUN   | v1/Namespace @ tracing-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | CREATE    | OK    | v1/Namespace @ tracing-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | DONE  | v1/Namespace @ tracing-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | RUN   | v1/Namespace @ bookinfo
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | CREATE    | OK    | v1/Namespace @ bookinfo
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | DONE  | v1/Namespace @ bookinfo
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | RUN   | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | CREATE    | OK    | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | DONE  | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | RUN   | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | CREATE    | OK    | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | APPLY     | DONE  | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | ASSERT    | RUN   | project.openshift.io/v1/Project @ istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | ASSERT    | DONE  | project.openshift.io/v1/Project @ istio-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | ASSERT    | RUN   | project.openshift.io/v1/Project @ tracing-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | ASSERT    | DONE  | project.openshift.io/v1/Project @ tracing-system
    l.go:52: | 07:10:40 | ossm-tempostack | Install OSSM                          | ASSERT    | RUN   | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:11:04 | ossm-tempostack | Install OSSM                          | ASSERT    | DONE  | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:11:04 | ossm-tempostack | Install OSSM                          | ASSERT    | RUN   | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:11:04 | ossm-tempostack | Install OSSM                          | ASSERT    | DONE  | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:11:04 | ossm-tempostack | Install OSSM                          | TRY       | END   |
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | TRY       | BEGIN |
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | RUN   | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | CREATE    | OK    | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | DONE  | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | RUN   | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | CREATE    | OK    | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | DONE  | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | RUN   | v1/Service @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | CREATE    | OK    | v1/Service @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | DONE  | v1/Service @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | RUN   | v1/Secret @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | CREATE    | OK    | v1/Secret @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | APPLY     | DONE  | v1/Secret @ tracing-system/minio
    l.go:52: | 07:11:04 | ossm-tempostack | Install Minio object store            | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:11:17 | ossm-tempostack | Install Minio object store            | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:11:17 | ossm-tempostack | Install Minio object store            | TRY       | END   |
    l.go:52: | 07:11:17 | ossm-tempostack | Install TempoStack                    | TRY       | BEGIN |
    l.go:52: | 07:11:17 | ossm-tempostack | Install TempoStack                    | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/ServiceAccount @ tracing-system/tempo-simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/ServiceAccount @ tracing-system/tempo-simplest
    l.go:52: | 07:11:18 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:11:38 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:11:38 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:11:45 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:11:45 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:11:46 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:11:46 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | apps/v1/StatefulSet @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | apps/v1/StatefulSet @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-gossip-ring
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-gossip-ring
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | RUN   | route.openshift.io/v1/Route @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | ASSERT    | DONE  | route.openshift.io/v1/Route @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:12:24 | ossm-tempostack | Install TempoStack                    | TRY       | END   |
    l.go:52: | 07:12:24 | ossm-tempostack | Update Kiali config                   | TRY       | BEGIN |
    l.go:52: | 07:12:24 | ossm-tempostack | Update Kiali config                   | PATCH     | RUN   | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:12:25 | ossm-tempostack | Update Kiali config                   | PATCH     | OK    | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:12:25 | ossm-tempostack | Update Kiali config                   | PATCH     | DONE  | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:12:25 | ossm-tempostack | Update Kiali config                   | SLEEP     | RUN   |
    l.go:52: | 07:12:35 | ossm-tempostack | Update Kiali config                   | SLEEP     | DONE  |
    l.go:52: | 07:12:35 | ossm-tempostack | Update Kiali config                   | ASSERT    | RUN   | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:12:35 | ossm-tempostack | Update Kiali config                   | ASSERT    | DONE  | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:12:35 | ossm-tempostack | Update Kiali config                   | ASSERT    | RUN   | v1/Pod @ istio-system/*
    l.go:52: | 07:12:35 | ossm-tempostack | Update Kiali config                   | ASSERT    | DONE  | v1/Pod @ istio-system/*
    l.go:52: | 07:12:35 | ossm-tempostack | Update Kiali config                   | TRY       | END   |
    l.go:52: | 07:12:35 | ossm-tempostack | Enable OSSM Tempo provider            | TRY       | BEGIN |
    l.go:52: | 07:12:35 | ossm-tempostack | Enable OSSM Tempo provider            | APPLY     | RUN   | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:12:35 | ossm-tempostack | Enable OSSM Tempo provider            | CREATE    | OK    | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:12:35 | ossm-tempostack | Enable OSSM Tempo provider            | APPLY     | DONE  | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:12:35 | ossm-tempostack | Enable OSSM Tempo provider            | SLEEP     | RUN   |
    l.go:52: | 07:12:45 | ossm-tempostack | Enable OSSM Tempo provider            | SLEEP     | DONE  |
    l.go:52: | 07:12:45 | ossm-tempostack | Enable OSSM Tempo provider            | ASSERT    | RUN   | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:12:45 | ossm-tempostack | Enable OSSM Tempo provider            | ASSERT    | DONE  | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:12:45 | ossm-tempostack | Enable OSSM Tempo provider            | ASSERT    | RUN   | v1/Pod @ istio-system/*
    l.go:52: | 07:12:45 | ossm-tempostack | Enable OSSM Tempo provider            | ASSERT    | DONE  | v1/Pod @ istio-system/*
    l.go:52: | 07:12:45 | ossm-tempostack | Enable OSSM Tempo provider            | TRY       | END   |
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | TRY       | BEGIN |
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/Service @ bookinfo/details
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/Service @ bookinfo/details
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/Service @ bookinfo/details
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/Service @ bookinfo/ratings
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/Service @ bookinfo/ratings
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/Service @ bookinfo/ratings
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/Service @ bookinfo/reviews
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/Service @ bookinfo/reviews
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/Service @ bookinfo/reviews
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:12:45 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/Service @ bookinfo/productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/Service @ bookinfo/productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/Service @ bookinfo/productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:12:46 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:12:55 | ossm-tempostack | Install Bookinfo app                  | TRY       | END   |
    l.go:52: | 07:12:55 | ossm-tempostack | Generate traces from the bookinfo app | TRY       | BEGIN |
    l.go:52: | 07:12:55 | ossm-tempostack | Generate traces from the bookinfo app | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c for i in {1..20}
        do
            curl http://$(oc -n istio-system get route istio-ingressgateway -o jsonpath='{.spec.host}')/productpage
            sleep 1
        done
    l.go:52: | 07:12:57 | ossm-tempostack | Generate traces from the bookinfo app | SCRIPT    | LOG   |
        === STDOUT
        <!DOCTYPE html>
        <html>
          <head>
            <title>Simple Bookstore App</title>
        <meta charset="utf-8">
        <meta http-equiv="X-UA-Compatible" content="IE=edge">
        <meta name="viewport" content="width=device-width, initial-scale=1.0">
        
        <!-- Latest compiled and minified CSS -->
        <link rel="stylesheet" href="static/bootstrap/css/bootstrap.min.css">
        
        <!-- Optional theme -->
        <link rel="stylesheet" href="static/bootstrap/css/bootstrap-theme.min.css">
        
          </head>
          <body>
            
            
        
        <nav class="navbar navbar-inverse navbar-static-top">
          <div class="container">
            <div class="navbar-header">
              <a class="navbar-brand" href="#">BookInfo Sample</a>
            </div>
            
            <button type="button" class="btn btn-default navbar-btn navbar-right" data-toggle="modal" href="#login-modal">Sign
              in</button>
            
          </div>
        </nav>
        
        <!---
        <div class="navbar navbar-inverse navbar-fixed-top">
          <div class="container">
            <div class="navbar-header pull-left">
              <a class="navbar-brand" href="#">Microservices Fabric BookInfo Demo</a>
            </div>
            <div class="navbar-header pull-right">
              <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse">
                <span class="icon-bar"></span>
                <span class="icon-bar"></span>
                <span class="icon-bar"></span>
              </button>
            </div>
            <div class="navbar-collapse collapse">
        
              <button type="button" class="btn btn-default navbar-btn pull-right" data-toggle="modal" data-target="#login-modal">Sign in</button>
        
            </div>
          </div>
        </div>
        -->
        
        <div id="login-modal" class="modal fade" role="dialog">
          <div class="modal-dialog">
            <div class="modal-content">
              <div class="modal-header">
                <button type="button" class="close" data-dismiss="modal">&times;</button>
                <h4 class="modal-title">Please sign in</h4>
              </div>
              <div class="modal-body">
                <form method="post" action='login' name="login_form">
                  <p><input type="text" class="form-control" name="username" id="username" placeholder="User Name"></p>
                  <p><input type="password" class="form-control" name="passwd" placeholder="Password"></p>
                  <p>
                    <button type="submit" class="btn btn-primary">Sign in</button>
                    <button type="button" class="btn btn-default" data-dismiss="modal">Cancel</button>
                  </p>
                </form>
              </div>
            </div>
        
          </div>
        </div>
        
        <div class="container-fluid">
          <div class="row">
            <div class="col-md-12">
              <h3 class="text-center text-primary">The Comedy of Errors</h3>
              
              <p>Summary: <a href="https://en.wikipedia.org/wiki/The_Comedy_of_Errors">Wikipedia Summary</a>: The Comedy of Errors is one of <b>William Shakespeare's</b> early plays. It is his shortest and one of his most farcical comedies, with a major part of the humour coming from slapstick and mistaken identity, in addition to puns and word play.</p>
              
            </div>
          </div>
        
          <div class="row">
            <div class="col-md-6">
              
              <h4 class="text-center text-primary">Book Details</h4>
              <dl>
                <dt>Type:</dt>paperback
                <dt>Pages:</dt>200
                <dt>Publisher:</dt>PublisherA
                <dt>Language:</dt>English
                <dt>ISBN-10:</dt>1234567890
                <dt>ISBN-13:</dt>123-1234567890
              </dl>
              
            </div>
        
            <div class="col-md-6">
              
              <h4 class="text-center text-primary">Book Reviews</h4>
              
              <blockquote>
                <p>An extremely entertaining play by Shakespeare. The slapstick humour is refreshing!</p>
                <small>Reviewer1</small>
                
                
                <font color="black">
                  <!-- full stars: -->
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <!-- empty stars: -->
                  
                </font>
                
                
              </blockquote>
              
              <blockquote>
                <p>Absolutely fun and entertaining. The play lacks thematic depth when compared to other plays by Shakespeare.</p>
                <small>Reviewer2</small>
                
                
                <font color="black">
                  <!-- full stars: -->
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <span class="glyphicon glyphicon-star"></span>
                  
                  <!-- empty stars: -->
                  
                  <span class="glyphicon glyphicon-star-empty"></span>
                  
                </font>
                
                
              </blockquote>
              
              <dl>
                <dt>Reviews served by:</dt>
                <u>reviews-v2-8897bb685-4fzkg</u>
                
              </dl>
              
            </div>
          </div>
        </div>
        
        
            
        <!-- Latest compiled and minified JavaScript -->
        <script src="static/jquery.min.js"></script>
        
        <!-- Latest compiled and minified JavaScript -->
        <script src="static/bootstrap/js/bootstrap.min.js"></script>
        
        <script type="text/javascript">
          $('#login-modal').on('shown.bs.modal', function () {
            $('#username').focus();
          });
        </script>
        
          </body>
        </html>
        === STDERR
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  5293  100  5293    0     0  12516      0 --:--:-- --:--:-- --:--:-- 12542
    l.go:52: | 07:12:57 | ossm-tempostack | Generate traces from the bookinfo app | SCRIPT    | DONE  |
    l.go:52: | 07:12:57 | ossm-tempostack | Generate traces from the bookinfo app | TRY       | END   |
    l.go:52: | 07:12:57 | ossm-tempostack | Check traces in Kiali                 | TRY       | BEGIN |
    l.go:52: | 07:12:57 | ossm-tempostack | Check traces in Kiali                 | APPLY     | RUN   | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:12:57 | ossm-tempostack | Check traces in Kiali                 | CREATE    | OK    | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:12:57 | ossm-tempostack | Check traces in Kiali                 | APPLY     | DONE  | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:12:57 | ossm-tempostack | Check traces in Kiali                 | ASSERT    | RUN   | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:13:30 | ossm-tempostack | Check traces in Kiali                 | ASSERT    | DONE  | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:13:30 | ossm-tempostack | Check traces in Kiali                 | TRY       | END   |
    l.go:52: | 07:13:30 | ossm-tempostack | Check traces in Kiali                 | CLEANUP   | BEGIN |
    l.go:52: | 07:13:30 | ossm-tempostack | Check traces in Kiali                 | DELETE    | OK    | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:13:30 | ossm-tempostack | Check traces in Kiali                 | CLEANUP   | END   |
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | CLEANUP   | BEGIN |
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/Service @ bookinfo/productpage
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/Service @ bookinfo/reviews
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/Service @ bookinfo/ratings
    l.go:52: | 07:13:30 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:13:31 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:13:31 | ossm-tempostack | Install Bookinfo app                  | DELETE    | OK    | v1/Service @ bookinfo/details
    l.go:52: | 07:13:31 | ossm-tempostack | Install Bookinfo app                  | CLEANUP   | END   |
    l.go:52: | 07:13:31 | ossm-tempostack | Enable OSSM Tempo provider            | CLEANUP   | BEGIN |
    l.go:52: | 07:13:31 | ossm-tempostack | Enable OSSM Tempo provider            | DELETE    | OK    | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:13:31 | ossm-tempostack | Enable OSSM Tempo provider            | CLEANUP   | END   |
    l.go:52: | 07:13:31 | ossm-tempostack | Install TempoStack                    | CLEANUP   | BEGIN |
    l.go:52: | 07:13:31 | ossm-tempostack | Install TempoStack                    | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:13:31 | ossm-tempostack | Install TempoStack                    | CLEANUP   | END   |
    l.go:52: | 07:13:31 | ossm-tempostack | Install Minio object store            | CLEANUP   | BEGIN |
    l.go:52: | 07:13:31 | ossm-tempostack | Install Minio object store            | DELETE    | OK    | v1/Secret @ tracing-system/minio
    l.go:52: | 07:13:31 | ossm-tempostack | Install Minio object store            | DELETE    | OK    | v1/Service @ tracing-system/minio
    l.go:52: | 07:13:31 | ossm-tempostack | Install Minio object store            | DELETE    | OK    | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:13:31 | ossm-tempostack | Install Minio object store            | DELETE    | OK    | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:13:33 | ossm-tempostack | Install Minio object store            | CLEANUP   | END   |
    l.go:52: | 07:13:33 | ossm-tempostack | Install OSSM                          | CLEANUP   | BEGIN |
    l.go:52: | 07:13:33 | ossm-tempostack | Install OSSM                          | DELETE    | OK    | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:13:33 | ossm-tempostack | Install OSSM                          | DELETE    | OK    | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:13:35 | ossm-tempostack | Install OSSM                          | DELETE    | OK    | v1/Namespace @ bookinfo
    l.go:52: | 07:13:41 | ossm-tempostack | Install OSSM                          | DELETE    | OK    | v1/Namespace @ tracing-system
    l.go:52: | 07:14:19 | ossm-tempostack | Install OSSM                          | DELETE    | OK    | v1/Namespace @ istio-system
    l.go:52: | 07:14:26 | ossm-tempostack | Install OSSM                          | CLEANUP   | END   |
    l.go:52: | 07:14:26 | ossm-tempostack | @chainsaw                             | CLEANUP   | BEGIN |
    l.go:52: | 07:14:26 | ossm-tempostack | @chainsaw                             | DELETE    | OK    | v1/Namespace @ chainsaw-humorous-hornet
    l.go:52: | 07:14:32 | ossm-tempostack | @chainsaw                             | CLEANUP   | END   |
=== RUN   chainsaw/ossm-tempostack-otel
    l.go:52: | 07:14:32 | ossm-tempostack-otel | @chainsaw                                                            | CREATE    | OK    | v1/Namespace @ chainsaw-settled-killdeer
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | TRY       | BEGIN |
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | RUN   | v1/Namespace @ istio-system
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | CREATE    | OK    | v1/Namespace @ istio-system
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | DONE  | v1/Namespace @ istio-system
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | RUN   | v1/Namespace @ tracing-system
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | CREATE    | OK    | v1/Namespace @ tracing-system
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | DONE  | v1/Namespace @ tracing-system
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | RUN   | v1/Namespace @ bookinfo
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | CREATE    | OK    | v1/Namespace @ bookinfo
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | DONE  | v1/Namespace @ bookinfo
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | RUN   | v1/Namespace @ otlp-app
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | CREATE    | OK    | v1/Namespace @ otlp-app
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | DONE  | v1/Namespace @ otlp-app
    l.go:52: | 07:14:32 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | RUN   | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | CREATE    | OK    | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | DONE  | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | RUN   | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | CREATE    | OK    | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | APPLY     | DONE  | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | RUN   | project.openshift.io/v1/Project @ istio-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | DONE  | project.openshift.io/v1/Project @ istio-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | RUN   | project.openshift.io/v1/Project @ tracing-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | DONE  | project.openshift.io/v1/Project @ tracing-system
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | RUN   | project.openshift.io/v1/Project @ otlp-app
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | DONE  | project.openshift.io/v1/Project @ otlp-app
    l.go:52: | 07:14:33 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | RUN   | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | DONE  | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | RUN   | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install OSSM                                                         | ASSERT    | DONE  | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install OSSM                                                         | TRY       | END   |
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | TRY       | BEGIN |
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | RUN   | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | CREATE    | OK    | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | DONE  | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | RUN   | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | CREATE    | OK    | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | DONE  | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | RUN   | v1/Service @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | CREATE    | OK    | v1/Service @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | DONE  | v1/Service @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | RUN   | v1/Secret @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | CREATE    | OK    | v1/Secret @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | APPLY     | DONE  | v1/Secret @ tracing-system/minio
    l.go:52: | 07:14:58 | ossm-tempostack-otel | Install Minio object store                                           | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install Minio object store                                           | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install Minio object store                                           | TRY       | END   |
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | TRY       | BEGIN |
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:15:07 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/ServiceAccount @ tracing-system/tempo-simplest
    l.go:52: | 07:15:08 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/ServiceAccount @ tracing-system/tempo-simplest
    l.go:52: | 07:15:08 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:15:32 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:15:32 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:15:32 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:15:32 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:15:32 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:15:32 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | apps/v1/StatefulSet @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | apps/v1/StatefulSet @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-compactor
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-distributor
    l.go:52: | 07:16:11 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-gossip-ring
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-gossip-ring
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-ingester
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-querier
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | v1/Service @ tracing-system/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | v1/Service @ tracing-system/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | RUN   | route.openshift.io/v1/Route @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | ASSERT    | DONE  | route.openshift.io/v1/Route @ tracing-system/tempo-simplest-query-frontend
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Install TempoStack                                                   | TRY       | END   |
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Update Kiali config                                                  | TRY       | BEGIN |
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Update Kiali config                                                  | PATCH     | RUN   | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Update Kiali config                                                  | PATCH     | OK    | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Update Kiali config                                                  | PATCH     | DONE  | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:16:12 | ossm-tempostack-otel | Update Kiali config                                                  | SLEEP     | RUN   |
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Update Kiali config                                                  | SLEEP     | DONE  |
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Update Kiali config                                                  | ASSERT    | RUN   | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Update Kiali config                                                  | ASSERT    | DONE  | kiali.io/v1alpha1/Kiali @ istio-system/kiali
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Update Kiali config                                                  | ASSERT    | RUN   | v1/Pod @ istio-system/*
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Update Kiali config                                                  | ASSERT    | DONE  | v1/Pod @ istio-system/*
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Update Kiali config                                                  | TRY       | END   |
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Install OTEL collector                                               | TRY       | BEGIN |
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Install OTEL collector                                               | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Install OTEL collector                                               | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Install OTEL collector                                               | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:16:22 | ossm-tempostack-otel | Install OTEL collector                                               | ASSERT    | RUN   | apps/v1/Deployment @ tracing-system/simplest-collector
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Install OTEL collector                                               | ASSERT    | DONE  | apps/v1/Deployment @ tracing-system/simplest-collector
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Install OTEL collector                                               | TRY       | END   |
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | TRY       | BEGIN |
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | APPLY     | RUN   | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | CREATE    | OK    | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | APPLY     | DONE  | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:16:24 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | SLEEP     | RUN   |
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | SLEEP     | DONE  |
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | ASSERT    | RUN   | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | ASSERT    | DONE  | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | ASSERT    | RUN   | v1/Pod @ istio-system/*
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | ASSERT    | DONE  | v1/Pod @ istio-system/*
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | TRY       | END   |
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | TRY       | BEGIN |
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/Service @ bookinfo/details
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/Service @ bookinfo/details
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/Service @ bookinfo/details
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/Service @ bookinfo/ratings
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/Service @ bookinfo/ratings
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/Service @ bookinfo/ratings
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/Service @ bookinfo/reviews
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/Service @ bookinfo/reviews
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/Service @ bookinfo/reviews
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:16:34 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/Service @ bookinfo/productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/Service @ bookinfo/productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/Service @ bookinfo/productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | RUN   | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | CREATE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | APPLY     | DONE  | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:16:35 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:16:36 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:16:36 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:16:37 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | RUN   | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:16:38 | ossm-tempostack-otel | Install Bookinfo app                                                 | ASSERT    | DONE  | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:16:38 | ossm-tempostack-otel | Install Bookinfo app                                                 | TRY       | END   |
    l.go:52: | 07:16:38 | ossm-tempostack-otel | Generate traces from the bookinfo app                                | TRY       | BEGIN |
    l.go:52: | 07:16:38 | ossm-tempostack-otel | Generate traces from the bookinfo app                                | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c for i in {1..20}
        do
            curl http://$(oc -n istio-system get route istio-ingressgateway -o jsonpath='{.spec.host}')/productpage
            sleep 1
        done
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Generate traces from the bookinfo app                                | SCRIPT    | LOG   |
        === STDOUT
        <!DOCTYPE html>
        <html>
          <head>
            <title>Simple Bookstore App</title>
        <meta charset="utf-8">
        <meta http-equiv="X-UA-Compatible" content="IE=edge">
        <meta name="viewport" content="width=device-width, initial-scale=1.0">
        
        <!-- Latest compiled and minified CSS -->
        <link rel="stylesheet" href="static/bootstrap/css/bootstrap.min.css">
        
        <!-- Optional theme -->
        <link rel="stylesheet" href="static/bootstrap/css/bootstrap-theme.min.css">
        
          </head>
          <body>
            
            
        
        <nav class="navbar navbar-inverse navbar-static-top">
          <div class="container">
            <div class="navbar-header">
              <a class="navbar-brand" href="#">BookInfo Sample</a>
            </div>
            
            <button type="button" class="btn btn-default navbar-btn navbar-right" data-toggle="modal" href="#login-modal">Sign
              in</button>
            
          </div>
        </nav>
        
        <!---
        <div class="navbar navbar-inverse navbar-fixed-top">
          <div class="container">
            <div class="navbar-header pull-left">
              <a class="navbar-brand" href="#">Microservices Fabric BookInfo Demo</a>
            </div>
            <div class="navbar-header pull-right">
              <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse">
                <span class="icon-bar"></span>
                <span class="icon-bar"></span>
                <span class="icon-bar"></span>
              </button>
            </div>
            <div class="navbar-collapse collapse">
        
              <button type="button" class="btn btn-default navbar-btn pull-right" data-toggle="modal" data-target="#login-modal">Sign in</button>
        
            </div>
          </div>
        </div>
        -->
        
        <div id="login-modal" class="modal fade" role="dialog">
          <div class="modal-dialog">
            <div class="modal-content">
              <div class="modal-header">
                <button type="button" class="close" data-dismiss="modal">&times;</button>
                <h4 class="modal-title">Please sign in</h4>
              </div>
              <div class="modal-body">
                <form method="post" action='login' name="login_form">
                  <p><input type="text" class="form-control" name="username" id="username" placeholder="User Name"></p>
                  <p><input type="password" class="form-control" name="passwd" placeholder="Password"></p>
                  <p>
                    <button type="submit" class="btn btn-primary">Sign in</button>
                    <button type="button" class="btn btn-default" data-dismiss="modal">Cancel</button>
                  </p>
                </form>
              </div>
            </div>
        
          </div>
        </div>
        
        <div class="container-fluid">
          <div class="row">
            <div class="col-md-12">
              <h3 class="text-center text-primary">The Comedy of Errors</h3>
              
              <p>Summary: <a href="https://en.wikipedia.org/wiki/The_Comedy_of_Errors">Wikipedia Summary</a>: The Comedy of Errors is one of <b>William Shakespeare's</b> early plays. It is his shortest and one of his most farcical comedies, with a major part of the humour coming from slapstick and mistaken identity, in addition to puns and word play.</p>
              
            </div>
          </div>
        
          <div class="row">
            <div class="col-md-6">
              
              <h4 class="text-center text-primary">Book Details</h4>
              <dl>
                <dt>Type:</dt>paperback
                <dt>Pages:</dt>200
                <dt>Publisher:</dt>PublisherA
                <dt>Language:</dt>English
                <dt>ISBN-10:</dt>1234567890
                <dt>ISBN-13:</dt>123-1234567890
              </dl>
              
            </div>
        
            <div class="col-md-6">
              
              <h4 class="text-center text-primary">Error fetching product reviews!</h4>
              
              <p>Sorry, product reviews are currently unavailable for this book.</p>
              
              
            </div>
          </div>
        </div>
        
        
            
        <!-- Latest compiled and minified JavaScript -->
        <script src="static/jquery.min.js"></script>
        
        <!-- Latest compiled and minified JavaScript -->
        <script src="static/bootstrap/js/bootstrap.min.js"></script>
        
        <script type="text/javascript">
          $('#login-modal').on('shown.bs.modal', function () {
            $('#username').focus();
          });
        </script>
        
          </body>
        </html>
        === STDERR
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  3889  100  3889    0     0  19712      0 --:--:-- --:--:-- --:--:-- 19741
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Generate traces from the bookinfo app                                | SCRIPT    | DONE  |
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Generate traces from the bookinfo app                                | TRY       | END   |
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Check traces in Kiali                                                | TRY       | BEGIN |
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Check traces in Kiali                                                | APPLY     | RUN   | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Check traces in Kiali                                                | CREATE    | OK    | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Check traces in Kiali                                                | APPLY     | DONE  | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:16:39 | ossm-tempostack-otel | Check traces in Kiali                                                | ASSERT    | RUN   | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Check traces in Kiali                                                | ASSERT    | DONE  | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Check traces in Kiali                                                | TRY       | END   |
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | TRY       | BEGIN |
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | APPLY     | RUN   | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | CREATE    | OK    | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | APPLY     | DONE  | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | APPLY     | RUN   | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | CREATE    | OK    | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | APPLY     | DONE  | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:17:13 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | ASSERT    | RUN   | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | ASSERT    | DONE  | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | ASSERT    | RUN   | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | ASSERT    | DONE  | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | TRY       | END   |
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | TRY       | BEGIN |
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | APPLY     | RUN   | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | CREATE    | OK    | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | APPLY     | DONE  | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:17:17 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | ASSERT    | RUN   | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | ASSERT    | DONE  | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | TRY       | END   |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | CLEANUP   | BEGIN |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | DELETE    | OK    | batch/v1/Job @ otlp-app/verify-traces-otel
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Verify the traces sent to OTEL collector in TempoStack instance.     | CLEANUP   | END   |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | CLEANUP   | BEGIN |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | DELETE    | OK    | batch/v1/Job @ otlp-app/generate-traces-grpc
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | DELETE    | OK    | batch/v1/Job @ otlp-app/generate-traces-http
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Generate traces and send it to OTEL collector via OTLP GRPC and HTTP | CLEANUP   | END   |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Check traces in Kiali                                                | CLEANUP   | BEGIN |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Check traces in Kiali                                                | DELETE    | OK    | batch/v1/Job @ istio-system/verify-traces
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Check traces in Kiali                                                | CLEANUP   | END   |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | CLEANUP   | BEGIN |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/details
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/ratings
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/reviews
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | networking.istio.io/v1alpha3/DestinationRule @ bookinfo/productpage
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | networking.istio.io/v1alpha3/VirtualService @ bookinfo/bookinfo
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | networking.istio.io/v1alpha3/Gateway @ bookinfo/bookinfo-gateway
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | apps/v1/Deployment @ bookinfo/productpage-v1
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-productpage
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/Service @ bookinfo/productpage
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v3
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v2
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | apps/v1/Deployment @ bookinfo/reviews-v1
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-reviews
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/Service @ bookinfo/reviews
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | apps/v1/Deployment @ bookinfo/ratings-v1
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-ratings
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/Service @ bookinfo/ratings
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | apps/v1/Deployment @ bookinfo/details-v1
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/ServiceAccount @ bookinfo/bookinfo-details
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | DELETE    | OK    | v1/Service @ bookinfo/details
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install Bookinfo app                                                 | CLEANUP   | END   |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | CLEANUP   | BEGIN |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | DELETE    | OK    | telemetry.istio.io/v1alpha1/Telemetry @ istio-system/mesh-default
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Enable OSSM Tempo provider                                           | CLEANUP   | END   |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install OTEL collector                                               | CLEANUP   | BEGIN |
    l.go:52: | 07:17:21 | ossm-tempostack-otel | Install OTEL collector                                               | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ tracing-system/simplest
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install OTEL collector                                               | CLEANUP   | END   |
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install TempoStack                                                   | CLEANUP   | BEGIN |
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install TempoStack                                                   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ tracing-system/simplest
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install TempoStack                                                   | CLEANUP   | END   |
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install Minio object store                                           | CLEANUP   | BEGIN |
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install Minio object store                                           | DELETE    | OK    | v1/Secret @ tracing-system/minio
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install Minio object store                                           | DELETE    | OK    | v1/Service @ tracing-system/minio
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install Minio object store                                           | DELETE    | OK    | apps/v1/Deployment @ tracing-system/minio
    l.go:52: | 07:17:22 | ossm-tempostack-otel | Install Minio object store                                           | DELETE    | OK    | v1/PersistentVolumeClaim @ tracing-system/minio
    l.go:52: | 07:17:24 | ossm-tempostack-otel | Install Minio object store                                           | CLEANUP   | END   |
    l.go:52: | 07:17:24 | ossm-tempostack-otel | Install OSSM                                                         | CLEANUP   | BEGIN |
    l.go:52: | 07:17:24 | ossm-tempostack-otel | Install OSSM                                                         | DELETE    | OK    | maistra.io/v1/ServiceMeshMemberRoll @ istio-system/default
    l.go:52: | 07:17:24 | ossm-tempostack-otel | Install OSSM                                                         | DELETE    | OK    | maistra.io/v2/ServiceMeshControlPlane @ istio-system/istio-system
    l.go:52: | 07:17:26 | ossm-tempostack-otel | Install OSSM                                                         | DELETE    | OK    | v1/Namespace @ otlp-app
    l.go:52: | 07:17:32 | ossm-tempostack-otel | Install OSSM                                                         | DELETE    | OK    | v1/Namespace @ bookinfo
    l.go:52: | 07:17:39 | ossm-tempostack-otel | Install OSSM                                                         | DELETE    | OK    | v1/Namespace @ tracing-system
    l.go:52: | 07:17:58 | ossm-tempostack-otel | Install OSSM                                                         | DELETE    | OK    | v1/Namespace @ istio-system
    l.go:52: | 07:18:06 | ossm-tempostack-otel | Install OSSM                                                         | CLEANUP   | END   |
    l.go:52: | 07:18:06 | ossm-tempostack-otel | @chainsaw                                                            | CLEANUP   | BEGIN |
    l.go:52: | 07:18:06 | ossm-tempostack-otel | @chainsaw                                                            | DELETE    | OK    | v1/Namespace @ chainsaw-settled-killdeer
    l.go:52: | 07:18:12 | ossm-tempostack-otel | @chainsaw                                                            | CLEANUP   | END   |
=== RUN   chainsaw/otel-tempo-serverless
    l.go:52: | 07:18:12 | otel-tempo-serverless | @chainsaw                                                   | CREATE    | OK    | v1/Namespace @ chainsaw-otel-tempo-serverless
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | TRY       | BEGIN |
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | CREATE    | OK    | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | CREATE    | OK    | v1/Service @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | v1/Secret @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | CREATE    | OK    | v1/Secret @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | v1/Secret @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:12 | otel-tempo-serverless | Install Minio object store                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install Minio object store                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install Minio object store                                  | TRY       | END   |
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | TRY       | BEGIN |
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:18:30 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-otel-tempo-serverless/tempo-serverless
    l.go:52: | 07:18:31 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-otel-tempo-serverless/tempo-serverless
    l.go:52: | 07:18:31 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:18:56 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:18:56 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:18:56 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:18:56 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:18:56 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:18:56 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-otel-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-otel-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-gossip-ring
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-gossip-ring
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend-discovery
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend-discovery
    l.go:52: | 07:19:34 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:19:35 | otel-tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-otel-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:19:35 | otel-tempo-serverless | Install TempoStack                                          | TRY       | END   |
    l.go:52: | 07:19:35 | otel-tempo-serverless | Create the OTEL collector instance                          | TRY       | BEGIN |
    l.go:52: | 07:19:35 | otel-tempo-serverless | Create the OTEL collector instance                          | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:19:35 | otel-tempo-serverless | Create the OTEL collector instance                          | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:19:35 | otel-tempo-serverless | Create the OTEL collector instance                          | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:19:35 | otel-tempo-serverless | Create the OTEL collector instance                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/serverless-collector
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create the OTEL collector instance                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/serverless-collector
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create the OTEL collector instance                          | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/serverless-collector-headless
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create the OTEL collector instance                          | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/serverless-collector-headless
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create the OTEL collector instance                          | TRY       | END   |
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | TRY       | BEGIN |
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | APPLY     | RUN   | project.openshift.io/v1/Project @ knative-serving
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | PATCH     | OK    | project.openshift.io/v1/Project @ knative-serving
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | APPLY     | DONE  | project.openshift.io/v1/Project @ knative-serving
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | APPLY     | RUN   | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | CREATE    | OK    | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | APPLY     | DONE  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:19:36 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/activator
    l.go:52: | 07:20:07 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/activator
    l.go:52: | 07:20:07 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/autoscaler
    l.go:52: | 07:20:07 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/autoscaler
    l.go:52: | 07:20:07 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/autoscaler-hpa
    l.go:52: | 07:20:07 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/autoscaler-hpa
    l.go:52: | 07:20:07 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/controller
    l.go:52: | 07:20:08 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/controller
    l.go:52: | 07:20:08 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/webhook
    l.go:52: | 07:20:08 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/webhook
    l.go:52: | 07:20:08 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | batch/v1/Job @ knative-serving/*
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | batch/v1/Job @ knative-serving/*
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative serving instance                             | TRY       | END   |
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | TRY       | BEGIN |
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | APPLY     | RUN   | project.openshift.io/v1/Project @ knative-eventing
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | PATCH     | OK    | project.openshift.io/v1/Project @ knative-eventing
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | APPLY     | DONE  | project.openshift.io/v1/Project @ knative-eventing
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | APPLY     | RUN   | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | CREATE    | OK    | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | APPLY     | DONE  | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:20:28 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/eventing-controller
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/eventing-controller
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/eventing-webhook
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/eventing-webhook
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/imc-controller
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/imc-controller
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/imc-dispatcher
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/imc-dispatcher
    l.go:52: | 07:21:20 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/mt-broker-controller
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/mt-broker-controller
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/mt-broker-filter
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/mt-broker-filter
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/mt-broker-ingress
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/mt-broker-ingress
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | v1/Pod @ knative-eventing/*
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | v1/Pod @ knative-eventing/*
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | batch/v1/Job @ knative-eventing/*
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | batch/v1/Job @ knative-eventing/*
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative eventing instance                            | TRY       | END   |
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative service app instance                         | TRY       | BEGIN |
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative service app instance                         | APPLY     | RUN   | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative service app instance                         | CREATE    | OK    | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative service app instance                         | APPLY     | DONE  | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:21 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/*
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/*
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/serverless-app-00001
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/serverless-app-00001
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Service @ chainsaw-otel-tempo-serverless/serverless-app-00001-private
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Service @ chainsaw-otel-tempo-serverless/serverless-app-00001-private
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Pod @ chainsaw-otel-tempo-serverless/*
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Pod @ chainsaw-otel-tempo-serverless/*
    l.go:52: | 07:21:32 | otel-tempo-serverless | Create Knative service app instance                         | TRY       | END   |
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | TRY       | BEGIN |
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | APPLY     | RUN   | batch/v1/Job @ chainsaw-otel-tempo-serverless/generate-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | CREATE    | OK    | batch/v1/Job @ chainsaw-otel-tempo-serverless/generate-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | APPLY     | DONE  | batch/v1/Job @ chainsaw-otel-tempo-serverless/generate-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | ASSERT    | RUN   | batch/v1/Job @ chainsaw-otel-tempo-serverless/generate-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | ASSERT    | DONE  | batch/v1/Job @ chainsaw-otel-tempo-serverless/generate-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | TRY       | END   |
    l.go:52: | 07:21:32 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | TRY       | BEGIN |
    l.go:52: | 07:21:32 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | APPLY     | RUN   | batch/v1/Job @ chainsaw-otel-tempo-serverless/verify-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | CREATE    | OK    | batch/v1/Job @ chainsaw-otel-tempo-serverless/verify-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | APPLY     | DONE  | batch/v1/Job @ chainsaw-otel-tempo-serverless/verify-traces
    l.go:52: | 07:21:32 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | ASSERT    | RUN   | batch/v1/Job @ chainsaw-otel-tempo-serverless/verify-traces
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | ASSERT    | DONE  | batch/v1/Job @ chainsaw-otel-tempo-serverless/verify-traces
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | TRY       | END   |
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | CLEANUP   | BEGIN |
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | batch/v1/Job @ chainsaw-otel-tempo-serverless/verify-traces
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | serving.knative.dev/v1/Route @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | serving.knative.dev/v1/Route @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | serving.knative.dev/v1/Route @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | networking.internal.knative.dev/v1alpha1/Ingress @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | networking.internal.knative.dev/v1alpha1/Ingress @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | networking.internal.knative.dev/v1alpha1/Ingress @ chainsaw-otel-tempo-serverless/serverless-app
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:21:46 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:22:07 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:22:07 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:22:07 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:22:19 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:22:19 | otel-tempo-serverless | Verify the Traces in Tempo instance                         | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | DELETE    | OK    | batch/v1/Job @ chainsaw-otel-tempo-serverless/generate-traces
    l.go:52: | 07:22:19 | otel-tempo-serverless | Generate Traces by probing the Knative service app instance | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative service app instance                         | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative service app instance                         | DELETE    | WARN  | serving.knative.dev/v1/Service @ chainsaw-otel-tempo-serverless/serverless-app
        === ERROR
        services.serving.knative.dev "serverless-app" not found
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative service app instance                         | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative eventing instance                            | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative eventing instance                            | DELETE    | WARN  | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
        === ERROR
        knativeeventings.operator.knative.dev "serverless" not found
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative eventing instance                            | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative serving instance                             | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative serving instance                             | DELETE    | WARN  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
        === ERROR
        knativeservings.operator.knative.dev "serverless" not found
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create Knative serving instance                             | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create the OTEL collector instance                          | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create the OTEL collector instance                          | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:22:19 | otel-tempo-serverless | Create the OTEL collector instance                          | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install TempoStack                                          | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install TempoStack                                          | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-otel-tempo-serverless/serverless
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install TempoStack                                          | CLEANUP   | END   |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install Minio object store                                  | CLEANUP   | BEGIN |
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install Minio object store                                  | DELETE    | OK    | v1/Secret @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install Minio object store                                  | DELETE    | OK    | v1/Service @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install Minio object store                                  | DELETE    | OK    | apps/v1/Deployment @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:22:19 | otel-tempo-serverless | Install Minio object store                                  | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-otel-tempo-serverless/minio
    l.go:52: | 07:22:20 | otel-tempo-serverless | Install Minio object store                                  | CLEANUP   | END   |
    l.go:52: | 07:22:20 | otel-tempo-serverless | @chainsaw                                                   | CLEANUP   | BEGIN |
    l.go:52: | 07:22:20 | otel-tempo-serverless | @chainsaw                                                   | DELETE    | OK    | v1/Namespace @ chainsaw-otel-tempo-serverless
    l.go:52: | 07:22:59 | otel-tempo-serverless | @chainsaw                                                   | CLEANUP   | END   |
=== RUN   chainsaw/tempo-serverless
    l.go:52: | 07:22:59 | tempo-serverless | @chainsaw                                                   | CREATE    | OK    | v1/Namespace @ chainsaw-tempo-serverless
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | TRY       | BEGIN |
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | CREATE    | OK    | apps/v1/Deployment @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | v1/Service @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | CREATE    | OK    | v1/Service @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | v1/Service @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | RUN   | v1/Secret @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | CREATE    | OK    | v1/Secret @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | APPLY     | DONE  | v1/Secret @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:22:59 | tempo-serverless | Install Minio object store                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:23:06 | tempo-serverless | Install Minio object store                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:23:06 | tempo-serverless | Install Minio object store                                  | TRY       | END   |
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | TRY       | BEGIN |
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempo-serverless/serverless
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempo-serverless/serverless
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempo-serverless/serverless
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempo-serverless/serverless
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempo-serverless/serverless
    l.go:52: | 07:23:06 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-tempo-serverless/tempo-serverless
    l.go:52: | 07:23:07 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-tempo-serverless/tempo-serverless
    l.go:52: | 07:23:07 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:23:31 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:23:31 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:23:31 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:23:31 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:23:31 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:23:31 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-compactor
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-distributor
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-gossip-ring
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-gossip-ring
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-ingester
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-querier
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-query-frontend-discovery
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/tempo-serverless-query-frontend-discovery
    l.go:52: | 07:24:10 | tempo-serverless | Install TempoStack                                          | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:24:11 | tempo-serverless | Install TempoStack                                          | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-tempo-serverless/tempo-serverless-query-frontend
    l.go:52: | 07:24:11 | tempo-serverless | Install TempoStack                                          | TRY       | END   |
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | TRY       | BEGIN |
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | APPLY     | RUN   | project.openshift.io/v1/Project @ knative-serving
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | PATCH     | OK    | project.openshift.io/v1/Project @ knative-serving
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | APPLY     | DONE  | project.openshift.io/v1/Project @ knative-serving
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | APPLY     | RUN   | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | CREATE    | OK    | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | APPLY     | DONE  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:24:11 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/activator
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/activator
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/autoscaler
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/autoscaler
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/autoscaler-hpa
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/autoscaler-hpa
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/controller
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/controller
    l.go:52: | 07:24:32 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | apps/v1/Deployment @ knative-serving/webhook
    l.go:52: | 07:24:33 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | apps/v1/Deployment @ knative-serving/webhook
    l.go:52: | 07:24:33 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative serving instance                             | ASSERT    | RUN   | batch/v1/Job @ knative-serving/*
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative serving instance                             | ASSERT    | DONE  | batch/v1/Job @ knative-serving/*
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative serving instance                             | TRY       | END   |
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | TRY       | BEGIN |
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | APPLY     | RUN   | project.openshift.io/v1/Project @ knative-eventing
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | PATCH     | OK    | project.openshift.io/v1/Project @ knative-eventing
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | APPLY     | DONE  | project.openshift.io/v1/Project @ knative-eventing
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | APPLY     | RUN   | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | CREATE    | OK    | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | APPLY     | DONE  | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:24:52 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/eventing-controller
    l.go:52: | 07:25:41 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/eventing-controller
    l.go:52: | 07:25:41 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/eventing-webhook
    l.go:52: | 07:25:41 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/eventing-webhook
    l.go:52: | 07:25:41 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/imc-controller
    l.go:52: | 07:25:41 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/imc-controller
    l.go:52: | 07:25:41 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/imc-dispatcher
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/imc-dispatcher
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/mt-broker-controller
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/mt-broker-controller
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/mt-broker-filter
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/mt-broker-filter
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | apps/v1/Deployment @ knative-eventing/mt-broker-ingress
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | apps/v1/Deployment @ knative-eventing/mt-broker-ingress
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | v1/Pod @ knative-eventing/*
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | v1/Pod @ knative-eventing/*
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | RUN   | batch/v1/Job @ knative-eventing/*
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | ASSERT    | DONE  | batch/v1/Job @ knative-eventing/*
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative eventing instance                            | TRY       | END   |
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative service app instance                         | TRY       | BEGIN |
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative service app instance                         | APPLY     | RUN   | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative service app instance                         | CREATE    | OK    | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative service app instance                         | APPLY     | DONE  | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:25:42 | tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempo-serverless/*
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempo-serverless/*
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/serverless-app-00001
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/serverless-app-00001
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Service @ chainsaw-tempo-serverless/serverless-app-00001-private
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Service @ chainsaw-tempo-serverless/serverless-app-00001-private
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | RUN   | v1/Pod @ chainsaw-tempo-serverless/*
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | ASSERT    | DONE  | v1/Pod @ chainsaw-tempo-serverless/*
    l.go:52: | 07:25:49 | tempo-serverless | Create Knative service app instance                         | TRY       | END   |
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | TRY       | BEGIN |
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | APPLY     | RUN   | batch/v1/Job @ chainsaw-tempo-serverless/generate-traces
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | CREATE    | OK    | batch/v1/Job @ chainsaw-tempo-serverless/generate-traces
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | APPLY     | DONE  | batch/v1/Job @ chainsaw-tempo-serverless/generate-traces
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tempo-serverless/generate-traces
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tempo-serverless/generate-traces
    l.go:52: | 07:25:49 | tempo-serverless | Generate Traces by probing the Knative service app instance | TRY       | END   |
    l.go:52: | 07:25:49 | tempo-serverless | Verify the Traces in Tempo instance                         | TRY       | BEGIN |
    l.go:52: | 07:25:49 | tempo-serverless | Verify the Traces in Tempo instance                         | APPLY     | RUN   | batch/v1/Job @ chainsaw-tempo-serverless/verify-traces
    l.go:52: | 07:25:49 | tempo-serverless | Verify the Traces in Tempo instance                         | CREATE    | OK    | batch/v1/Job @ chainsaw-tempo-serverless/verify-traces
    l.go:52: | 07:25:49 | tempo-serverless | Verify the Traces in Tempo instance                         | APPLY     | DONE  | batch/v1/Job @ chainsaw-tempo-serverless/verify-traces
    l.go:52: | 07:25:49 | tempo-serverless | Verify the Traces in Tempo instance                         | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tempo-serverless/verify-traces
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tempo-serverless/verify-traces
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | TRY       | END   |
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | CLEANUP   | BEGIN |
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | batch/v1/Job @ chainsaw-tempo-serverless/verify-traces
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | serving.knative.dev/v1/Route @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | serving.knative.dev/v1/Route @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | serving.knative.dev/v1/Route @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | networking.internal.knative.dev/v1alpha1/Ingress @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | networking.internal.knative.dev/v1alpha1/Ingress @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | networking.internal.knative.dev/v1alpha1/Ingress @ chainsaw-tempo-serverless/serverless-app
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:26:23 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:26:47 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
    l.go:52: | 07:26:47 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | RUN   | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:26:47 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | OK    | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:26:58 | tempo-serverless | Verify the Traces in Tempo instance                         | DELETE    | DONE  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
    l.go:52: | 07:26:58 | tempo-serverless | Verify the Traces in Tempo instance                         | CLEANUP   | END   |
    l.go:52: | 07:26:58 | tempo-serverless | Generate Traces by probing the Knative service app instance | CLEANUP   | BEGIN |
    l.go:52: | 07:26:58 | tempo-serverless | Generate Traces by probing the Knative service app instance | DELETE    | OK    | batch/v1/Job @ chainsaw-tempo-serverless/generate-traces
    l.go:52: | 07:26:58 | tempo-serverless | Generate Traces by probing the Knative service app instance | CLEANUP   | END   |
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative service app instance                         | CLEANUP   | BEGIN |
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative service app instance                         | DELETE    | WARN  | serving.knative.dev/v1/Service @ chainsaw-tempo-serverless/serverless-app
        === ERROR
        services.serving.knative.dev "serverless-app" not found
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative service app instance                         | CLEANUP   | END   |
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative eventing instance                            | CLEANUP   | BEGIN |
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative eventing instance                            | DELETE    | WARN  | operator.knative.dev/v1beta1/KnativeEventing @ knative-eventing/serverless
        === ERROR
        knativeeventings.operator.knative.dev "serverless" not found
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative eventing instance                            | CLEANUP   | END   |
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative serving instance                             | CLEANUP   | BEGIN |
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative serving instance                             | DELETE    | WARN  | operator.knative.dev/v1beta1/KnativeServing @ knative-serving/serverless
        === ERROR
        knativeservings.operator.knative.dev "serverless" not found
    l.go:52: | 07:26:58 | tempo-serverless | Create Knative serving instance                             | CLEANUP   | END   |
    l.go:52: | 07:26:58 | tempo-serverless | Install TempoStack                                          | CLEANUP   | BEGIN |
    l.go:52: | 07:26:58 | tempo-serverless | Install TempoStack                                          | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempo-serverless/serverless
    l.go:52: | 07:26:58 | tempo-serverless | Install TempoStack                                          | CLEANUP   | END   |
    l.go:52: | 07:26:58 | tempo-serverless | Install Minio object store                                  | CLEANUP   | BEGIN |
    l.go:52: | 07:26:58 | tempo-serverless | Install Minio object store                                  | DELETE    | OK    | v1/Secret @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:26:58 | tempo-serverless | Install Minio object store                                  | DELETE    | OK    | v1/Service @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:26:58 | tempo-serverless | Install Minio object store                                  | DELETE    | OK    | apps/v1/Deployment @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:26:59 | tempo-serverless | Install Minio object store                                  | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tempo-serverless/minio
    l.go:52: | 07:26:59 | tempo-serverless | Install Minio object store                                  | CLEANUP   | END   |
    l.go:52: | 07:26:59 | tempo-serverless | @chainsaw                                                   | CLEANUP   | BEGIN |
    l.go:52: | 07:26:59 | tempo-serverless | @chainsaw                                                   | DELETE    | OK    | v1/Namespace @ chainsaw-tempo-serverless
    l.go:52: | 07:27:35 | tempo-serverless | @chainsaw                                                   | CLEANUP   | END   |
=== RUN   chainsaw/component-replicas
=== PAUSE chainsaw/component-replicas
=== RUN   chainsaw/monitoring
    l.go:52: | 07:27:35 | monitoring | @chainsaw                                                            | CREATE    | OK    | v1/Namespace @ chainsaw-monitoring
    l.go:52: | 07:27:35 | monitoring | step-00                                                              | TRY       | BEGIN |
    l.go:52: | 07:27:35 | monitoring | step-00                                                              | APPLY     | RUN   | v1/Namespace @ chainsaw-monitoring
    l.go:52: | 07:27:35 | monitoring | step-00                                                              | PATCH     | WARN  | v1/Namespace @ chainsaw-monitoring
        === ERROR
        Operation cannot be fulfilled on namespaces "chainsaw-monitoring": the object has been modified; please apply your changes to the latest version and try again
    l.go:52: | 07:27:35 | monitoring | step-00                                                              | PATCH     | OK    | v1/Namespace @ chainsaw-monitoring
    l.go:52: | 07:27:35 | monitoring | step-00                                                              | APPLY     | DONE  | v1/Namespace @ chainsaw-monitoring
    l.go:52: | 07:27:35 | monitoring | step-00                                                              | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | CREATE    | OK    | apps/v1/Deployment @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | RUN   | v1/Service @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | CREATE    | OK    | v1/Service @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | DONE  | v1/Service @ chainsaw-monitoring/minio
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | RUN   | v1/Secret @ chainsaw-monitoring/minio-secret
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | CREATE    | OK    | v1/Secret @ chainsaw-monitoring/minio-secret
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | APPLY     | DONE  | v1/Secret @ chainsaw-monitoring/minio-secret
    l.go:52: | 07:27:36 | monitoring | step-00                                                              | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monitoring/minio
    l.go:52: | 07:27:44 | monitoring | step-00                                                              | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monitoring/minio
    l.go:52: | 07:27:44 | monitoring | step-00                                                              | ASSERT    | RUN   | v1/Service @ chainsaw-monitoring/minio
    l.go:52: | 07:27:44 | monitoring | step-00                                                              | ASSERT    | DONE  | v1/Service @ chainsaw-monitoring/minio
    l.go:52: | 07:27:44 | monitoring | step-00                                                              | ASSERT    | RUN   | v1/Secret @ chainsaw-monitoring/minio-secret
    l.go:52: | 07:27:44 | monitoring | step-00                                                              | ASSERT    | DONE  | v1/Secret @ chainsaw-monitoring/minio-secret
    l.go:52: | 07:27:44 | monitoring | step-00                                                              | TRY       | END   |
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | TRY       | BEGIN |
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | APPLY     | RUN   | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | PATCH     | OK    | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | APPLY     | DONE  | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | ASSERT    | RUN   | apps/v1/Deployment @ openshift-user-workload-monitoring/prometheus-operator
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | ASSERT    | DONE  | apps/v1/Deployment @ openshift-user-workload-monitoring/prometheus-operator
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | ASSERT    | RUN   | apps/v1/StatefulSet @ openshift-user-workload-monitoring/prometheus-user-workload
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | ASSERT    | DONE  | apps/v1/StatefulSet @ openshift-user-workload-monitoring/prometheus-user-workload
    l.go:52: | 07:27:44 | monitoring | step-01                                                              | ASSERT    | RUN   | apps/v1/StatefulSet @ openshift-user-workload-monitoring/thanos-ruler-user-workload
    l.go:52: | 07:27:45 | monitoring | step-01                                                              | ASSERT    | DONE  | apps/v1/StatefulSet @ openshift-user-workload-monitoring/thanos-ruler-user-workload
    l.go:52: | 07:27:45 | monitoring | step-01                                                              | TRY       | END   |
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | TRY       | BEGIN |
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/oc get pods -A -l control-plane=controller-manager -l app.kubernetes.io/name=tempo-operator -o jsonpath={.items[0].metadata.namespace}
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | CMD       | LOG   |
        === STDOUT
        openshift-tempo-operator
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | CMD       | DONE  |
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/oc label namespace openshift-tempo-operator openshift.io/cluster-monitoring=true
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | CMD       | LOG   |
        === STDOUT
        namespace/openshift-tempo-operator not labeled
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | CMD       | DONE  |
    l.go:52: | 07:27:45 | monitoring | Enable OpenShift platform monitoring on the Tempo operator namespace | TRY       | END   |
    l.go:52: | 07:27:45 | monitoring | step-02                                                              | TRY       | BEGIN |
    l.go:52: | 07:27:45 | monitoring | step-02                                                              | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-monitoring/tempostack
    l.go:52: | 07:27:45 | monitoring | step-02                                                              | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-monitoring/tempostack
    l.go:52: | 07:27:45 | monitoring | step-02                                                              | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-monitoring/tempostack
    l.go:52: | 07:27:45 | monitoring | step-02                                                              | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-compactor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-compactor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-distributor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-distributor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-querier
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-querier
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-monitoring/tempo-tempostack-ingester
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-monitoring/tempo-tempostack-ingester
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | v1/Service @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | v1/Service @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-compactor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-compactor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-distributor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-distributor
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-ingester
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-ingester
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-querier
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-querier
    l.go:52: | 07:28:49 | monitoring | step-02                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:50 | monitoring | step-02                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-monitoring/tempo-tempostack-query-frontend
    l.go:52: | 07:28:50 | monitoring | step-02                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-monitoring/tempostack-prometheus-rule
    l.go:52: | 07:28:50 | monitoring | step-02                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-monitoring/tempostack-prometheus-rule
    l.go:52: | 07:28:50 | monitoring | step-02                                                              | TRY       | END   |
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | TRY       | BEGIN |
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | APPLY     | RUN   | batch/v1/Job @ chainsaw-monitoring/generate-traces
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | CREATE    | OK    | batch/v1/Job @ chainsaw-monitoring/generate-traces
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | APPLY     | DONE  | batch/v1/Job @ chainsaw-monitoring/generate-traces
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monitoring/generate-traces
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monitoring/generate-traces
    l.go:52: | 07:28:50 | monitoring | step-03                                                              | TRY       | END   |
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | TRY       | BEGIN |
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | APPLY     | RUN   | batch/v1/Job @ chainsaw-monitoring/verify-traces
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | CREATE    | OK    | batch/v1/Job @ chainsaw-monitoring/verify-traces
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | APPLY     | DONE  | batch/v1/Job @ chainsaw-monitoring/verify-traces
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:28:50 | monitoring | step-04                                                              | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monitoring/verify-traces
    l.go:52: | 07:29:05 | monitoring | step-04                                                              | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monitoring/verify-traces
    l.go:52: | 07:29:05 | monitoring | step-04                                                              | TRY       | END   |
    l.go:52: | 07:29:05 | monitoring | step-05                                                              | TRY       | BEGIN |
    l.go:52: | 07:29:05 | monitoring | step-05                                                              | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/oc get pods -A -l control-plane=controller-manager -l app.kubernetes.io/name=tempo-operator -o jsonpath={.items[0].metadata.namespace}
    l.go:52: | 07:29:05 | monitoring | step-05                                                              | CMD       | LOG   |
        === STDOUT
        openshift-tempo-operator
    l.go:52: | 07:29:05 | monitoring | step-05                                                              | CMD       | DONE  |
    l.go:52: | 07:29:05 | monitoring | step-05                                                              | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c ./check_metrics.sh
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | SCRIPT    | LOG   |
        === STDOUT
        serviceaccount/e2e-test-metrics-reader created
        clusterrole.rbac.authorization.k8s.io/cluster-monitoring-view added: "system:serviceaccount:chainsaw-monitoring:e2e-test-metrics-reader"
        Metric 'tempo_request_duration_seconds_count' with value is present.
        Metric 'tempo_request_duration_seconds_sum' with value is present.
        Metric 'tempo_request_duration_seconds_bucket' with value is present.
        Metric 'tempo_build_info' with value is present.
        No metric 'tempo_ingester_bytes_received_total' with value present. Retrying...
        No metric 'tempo_ingester_bytes_received_total' with value present. Retrying...
        Metric 'tempo_ingester_bytes_received_total' with value is present.
        Metric 'tempo_ingester_flush_failed_retries_total' with value is present.
        Metric 'tempo_ingester_failed_flushes_total' with value is present.
        Metric 'tempo_ring_members' with value is present.
        Metric 'tempo_operator_tempostack_managed' with value is present.
        Metric 'tempo_operator_tempostack_storage_backend' with value is present.
        Metric 'tempo_operator_tempostack_multi_tenancy' with value is present.
        === STDERR
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2941    0  2941    0     0  92113      0 --:--:-- --:--:-- --:--:-- 94870
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  3009    0  3009    0     0    98k      0 --:--:-- --:--:-- --:--:--  101k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 44209    0 44209    0     0  2026k      0 --:--:-- --:--:-- --:--:-- 2055k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2947    0  2947    0     0   132k      0 --:--:-- --:--:-- --:--:--  137k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100    77  100    77    0     0   4185      0 --:--:-- --:--:-- --:--:--  4277
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100    77  100    77    0     0   4350      0 --:--:-- --:--:-- --:--:--  4529
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   520  100   520    0     0  28347      0 --:--:-- --:--:-- --:--:-- 28888
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2147    0  2147    0     0  98459      0 --:--:-- --:--:-- --:--:--   99k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2117    0  2117    0     0   113k      0 --:--:-- --:--:-- --:--:--  114k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 10866    0 10866    0     0   683k      0 --:--:-- --:--:-- --:--:--  707k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   547  100   547    0     0  39231      0 --:--:-- --:--:-- --:--:-- 42076
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   549  100   549    0     0  36388      0 --:--:-- --:--:-- --:--:-- 36600
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   553  100   553    0     0  39423      0 --:--:-- --:--:-- --:--:-- 42538
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | SCRIPT    | DONE  |
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | ASSERT    | RUN   | v1/Service @ openshift-tempo-operator/tempo-operator-controller-manager-metrics-service
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | ASSERT    | DONE  | v1/Service @ openshift-tempo-operator/tempo-operator-controller-manager-metrics-service
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ openshift-tempo-operator/tempo-operator-controller-manager-metrics-monitor
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ openshift-tempo-operator/tempo-operator-controller-manager-metrics-monitor
    l.go:52: | 07:29:16 | monitoring | step-05                                                              | TRY       | END   |
    l.go:52: | 07:29:16 | monitoring | step-04                                                              | CLEANUP   | BEGIN |
    l.go:52: | 07:29:16 | monitoring | step-04                                                              | DELETE    | OK    | batch/v1/Job @ chainsaw-monitoring/verify-traces
    l.go:52: | 07:29:16 | monitoring | step-04                                                              | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:29:16 | monitoring | step-04                                                              | CLEANUP   | END   |
    l.go:52: | 07:29:16 | monitoring | step-03                                                              | CLEANUP   | BEGIN |
    l.go:52: | 07:29:16 | monitoring | step-03                                                              | DELETE    | OK    | batch/v1/Job @ chainsaw-monitoring/generate-traces
    l.go:52: | 07:29:16 | monitoring | step-03                                                              | CLEANUP   | END   |
    l.go:52: | 07:29:16 | monitoring | step-02                                                              | CLEANUP   | BEGIN |
    l.go:52: | 07:29:16 | monitoring | step-02                                                              | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-monitoring/tempostack
    l.go:52: | 07:29:16 | monitoring | step-02                                                              | CLEANUP   | END   |
    l.go:52: | 07:29:16 | monitoring | step-00                                                              | CLEANUP   | BEGIN |
    l.go:52: | 07:29:16 | monitoring | step-00                                                              | DELETE    | OK    | v1/Secret @ chainsaw-monitoring/minio-secret
    l.go:52: | 07:29:16 | monitoring | step-00                                                              | DELETE    | OK    | v1/Service @ chainsaw-monitoring/minio
    l.go:52: | 07:29:16 | monitoring | step-00                                                              | DELETE    | OK    | apps/v1/Deployment @ chainsaw-monitoring/minio
    l.go:52: | 07:29:16 | monitoring | step-00                                                              | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-monitoring/minio
    l.go:52: | 07:29:18 | monitoring | step-00                                                              | CLEANUP   | END   |
    l.go:52: | 07:29:18 | monitoring | @chainsaw                                                            | CLEANUP   | BEGIN |
    l.go:52: | 07:29:18 | monitoring | @chainsaw                                                            | DELETE    | OK    | v1/Namespace @ chainsaw-monitoring
    l.go:52: | 07:29:54 | monitoring | @chainsaw                                                            | CLEANUP   | END   |
=== RUN   chainsaw/monolithic-monitoring
    l.go:52: | 07:29:54 | monolithic-monitoring | @chainsaw                                                         | CREATE    | OK    | v1/Namespace @ chainsaw-proven-pony
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | TRY       | BEGIN |
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | APPLY     | RUN   | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | PATCH     | OK    | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | APPLY     | DONE  | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | ASSERT    | RUN   | apps/v1/Deployment @ openshift-user-workload-monitoring/prometheus-operator
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | ASSERT    | DONE  | apps/v1/Deployment @ openshift-user-workload-monitoring/prometheus-operator
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | ASSERT    | RUN   | apps/v1/StatefulSet @ openshift-user-workload-monitoring/prometheus-user-workload
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | ASSERT    | DONE  | apps/v1/StatefulSet @ openshift-user-workload-monitoring/prometheus-user-workload
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | ASSERT    | RUN   | apps/v1/StatefulSet @ openshift-user-workload-monitoring/thanos-ruler-user-workload
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | ASSERT    | DONE  | apps/v1/StatefulSet @ openshift-user-workload-monitoring/thanos-ruler-user-workload
    l.go:52: | 07:29:54 | monolithic-monitoring | Enable user workload monitoring                                   | TRY       | END   |
    l.go:52: | 07:29:54 | monolithic-monitoring | Create Tempo Monolithc instance                                   | TRY       | BEGIN |
    l.go:52: | 07:29:54 | monolithic-monitoring | Create Tempo Monolithc instance                                   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-proven-pony/monitor
    l.go:52: | 07:29:54 | monolithic-monitoring | Create Tempo Monolithc instance                                   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-proven-pony/monitor
    l.go:52: | 07:29:54 | monolithic-monitoring | Create Tempo Monolithc instance                                   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-proven-pony/monitor
    l.go:52: | 07:29:54 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-proven-pony/tempo-monitor
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-proven-pony/tempo-monitor
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | RUN   | v1/Pod @ chainsaw-proven-pony/tempo-monitor-0
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | DONE  | v1/Pod @ chainsaw-proven-pony/tempo-monitor-0
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | RUN   | v1/Service @ chainsaw-proven-pony/tempo-monitor
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | DONE  | v1/Service @ chainsaw-proven-pony/tempo-monitor
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | RUN   | v1/Service @ chainsaw-proven-pony/tempo-monitor-jaegerui
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | DONE  | v1/Service @ chainsaw-proven-pony/tempo-monitor-jaegerui
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-proven-pony/tempo-monitor-jaegerui
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-proven-pony/tempo-monitor-jaegerui
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | RUN   | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-proven-pony/tempo-monitor
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | ASSERT    | DONE  | monitoring.coreos.com/v1/ServiceMonitor @ chainsaw-proven-pony/tempo-monitor
    l.go:52: | 07:30:37 | monolithic-monitoring | Create Tempo Monolithc instance                                   | TRY       | END   |
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | TRY       | BEGIN |
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | APPLY     | RUN   | batch/v1/Job @ chainsaw-proven-pony/generate-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | CREATE    | OK    | batch/v1/Job @ chainsaw-proven-pony/generate-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | APPLY     | DONE  | batch/v1/Job @ chainsaw-proven-pony/generate-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | ASSERT    | RUN   | batch/v1/Job @ chainsaw-proven-pony/generate-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | ASSERT    | DONE  | batch/v1/Job @ chainsaw-proven-pony/generate-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | TRY       | END   |
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | TRY       | BEGIN |
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | APPLY     | RUN   | batch/v1/Job @ chainsaw-proven-pony/verify-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | CREATE    | OK    | batch/v1/Job @ chainsaw-proven-pony/verify-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | APPLY     | DONE  | batch/v1/Job @ chainsaw-proven-pony/verify-traces
    l.go:52: | 07:30:37 | monolithic-monitoring | Verify traces in Monolithic instance                              | ASSERT    | RUN   | batch/v1/Job @ chainsaw-proven-pony/verify-traces
    l.go:52: | 07:30:56 | monolithic-monitoring | Verify traces in Monolithic instance                              | ASSERT    | DONE  | batch/v1/Job @ chainsaw-proven-pony/verify-traces
    l.go:52: | 07:30:56 | monolithic-monitoring | Verify traces in Monolithic instance                              | TRY       | END   |
    l.go:52: | 07:30:56 | monolithic-monitoring | Check Tempo Monolithc metrics scraped by user workload monitoring | TRY       | BEGIN |
    l.go:52: | 07:30:56 | monolithic-monitoring | Check Tempo Monolithc metrics scraped by user workload monitoring | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c ./check_metrics.sh
    l.go:52: | 07:30:56 | monolithic-monitoring | Check Tempo Monolithc metrics scraped by user workload monitoring | SCRIPT    | LOG   |
        === STDOUT
        serviceaccount/e2e-test-metrics-reader created
        clusterrole.rbac.authorization.k8s.io/cluster-monitoring-view added: "system:serviceaccount:chainsaw-proven-pony:e2e-test-metrics-reader"
        Metric 'tempo_distributor_bytes_received_total' with value is present.
        Metric 'tempo_distributor_spans_received_total' with value is present.
        Metric 'tempo_ingester_bytes_received_total' with value is present.
        Metric 'tempo_distributor_traces_per_batch_count' with value is present.
        Metric 'tempo_build_info' with value is present.
        === STDERR
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   925  100   925    0     0  31858      0 --:--:-- --:--:-- --:--:-- 33035
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   921  100   921    0     0  50796      0 --:--:-- --:--:-- --:--:-- 51166
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   935  100   935    0     0  45260      0 --:--:-- --:--:-- --:--:-- 46750
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2086    0  2086    0     0   120k      0 --:--:-- --:--:-- --:--:--  127k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2886    0  2886    0     0   166k      0 --:--:-- --:--:-- --:--:--  176k
    l.go:52: | 07:30:56 | monolithic-monitoring | Check Tempo Monolithc metrics scraped by user workload monitoring | SCRIPT    | DONE  |
    l.go:52: | 07:30:56 | monolithic-monitoring | Check Tempo Monolithc metrics scraped by user workload monitoring | TRY       | END   |
    l.go:52: | 07:30:56 | monolithic-monitoring | Verify traces in Monolithic instance                              | CLEANUP   | BEGIN |
    l.go:52: | 07:30:56 | monolithic-monitoring | Verify traces in Monolithic instance                              | DELETE    | OK    | batch/v1/Job @ chainsaw-proven-pony/verify-traces
    l.go:52: | 07:30:56 | monolithic-monitoring | Verify traces in Monolithic instance                              | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ chainsaw-tempo-monitoring-view
    l.go:52: | 07:30:56 | monolithic-monitoring | Verify traces in Monolithic instance                              | CLEANUP   | END   |
    l.go:52: | 07:30:56 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | CLEANUP   | BEGIN |
    l.go:52: | 07:30:56 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | DELETE    | OK    | batch/v1/Job @ chainsaw-proven-pony/generate-traces
    l.go:52: | 07:30:56 | monolithic-monitoring | Generate traces and export to the Monolithc instance              | CLEANUP   | END   |
    l.go:52: | 07:30:56 | monolithic-monitoring | Create Tempo Monolithc instance                                   | CLEANUP   | BEGIN |
    l.go:52: | 07:30:56 | monolithic-monitoring | Create Tempo Monolithc instance                                   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-proven-pony/monitor
    l.go:52: | 07:30:56 | monolithic-monitoring | Create Tempo Monolithc instance                                   | CLEANUP   | END   |
    l.go:52: | 07:30:56 | monolithic-monitoring | @chainsaw                                                         | CLEANUP   | BEGIN |
    l.go:52: | 07:30:56 | monolithic-monitoring | @chainsaw                                                         | DELETE    | OK    | v1/Namespace @ chainsaw-proven-pony
    l.go:52: | 07:31:03 | monolithic-monitoring | @chainsaw                                                         | CLEANUP   | END   |
=== RUN   chainsaw/monolithic-multitenancy-openshift
=== PAUSE chainsaw/monolithic-multitenancy-openshift
=== RUN   chainsaw/monolithic-multitenancy-static
=== PAUSE chainsaw/monolithic-multitenancy-static
=== RUN   chainsaw/monolithic-route
=== PAUSE chainsaw/monolithic-route
=== RUN   chainsaw/monolithic-single-tenant-auth
=== PAUSE chainsaw/monolithic-single-tenant-auth
=== RUN   chainsaw/multitenancy
=== PAUSE chainsaw/multitenancy
=== RUN   chainsaw/multitenancy-rbac
=== PAUSE chainsaw/multitenancy-rbac
=== RUN   chainsaw/red-metrics
    l.go:52: | 07:31:03 | red-metrics | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-redmetrics
    l.go:52: | 07:31:03 | red-metrics | step-00   | TRY       | BEGIN |
    l.go:52: | 07:31:03 | red-metrics | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | CREATE    | OK    | v1/Service @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:03 | red-metrics | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:17 | red-metrics | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:17 | red-metrics | step-00   | ASSERT    | RUN   | v1/Service @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:17 | red-metrics | step-00   | ASSERT    | DONE  | v1/Service @ chainsaw-redmetrics/minio
    l.go:52: | 07:31:17 | red-metrics | step-00   | TRY       | END   |
    l.go:52: | 07:31:17 | red-metrics | step-01   | TRY       | BEGIN |
    l.go:52: | 07:31:17 | red-metrics | step-01   | APPLY     | RUN   | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:31:17 | red-metrics | step-01   | PATCH     | OK    | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:31:17 | red-metrics | step-01   | APPLY     | DONE  | v1/ConfigMap @ openshift-monitoring/cluster-monitoring-config
    l.go:52: | 07:31:17 | red-metrics | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ openshift-user-workload-monitoring/prometheus-operator
    l.go:52: | 07:31:17 | red-metrics | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ openshift-user-workload-monitoring/prometheus-operator
    l.go:52: | 07:31:17 | red-metrics | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ openshift-user-workload-monitoring/prometheus-user-workload
    l.go:52: | 07:31:17 | red-metrics | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ openshift-user-workload-monitoring/prometheus-user-workload
    l.go:52: | 07:31:17 | red-metrics | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ openshift-user-workload-monitoring/thanos-ruler-user-workload
    l.go:52: | 07:31:17 | red-metrics | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ openshift-user-workload-monitoring/thanos-ruler-user-workload
    l.go:52: | 07:31:17 | red-metrics | step-01   | TRY       | END   |
    l.go:52: | 07:31:17 | red-metrics | step-02   | TRY       | BEGIN |
    l.go:52: | 07:31:17 | red-metrics | step-02   | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-redmetrics/otel
    l.go:52: | 07:31:17 | red-metrics | step-02   | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-redmetrics/otel
    l.go:52: | 07:31:17 | red-metrics | step-02   | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-redmetrics/otel
    l.go:52: | 07:31:17 | red-metrics | step-02   | APPLY     | RUN   | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-redmetrics/span-red
    l.go:52: | 07:31:17 | red-metrics | step-02   | CREATE    | OK    | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-redmetrics/span-red
    l.go:52: | 07:31:17 | red-metrics | step-02   | APPLY     | DONE  | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-redmetrics/span-red
    l.go:52: | 07:31:17 | red-metrics | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/otel-collector
    l.go:52: | 07:31:19 | red-metrics | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/otel-collector
    l.go:52: | 07:31:19 | red-metrics | step-02   | ASSERT    | RUN   | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-redmetrics/span-red
    l.go:52: | 07:31:19 | red-metrics | step-02   | ASSERT    | DONE  | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-redmetrics/span-red
    l.go:52: | 07:31:19 | red-metrics | step-02   | TRY       | END   |
    l.go:52: | 07:31:19 | red-metrics | step-03   | TRY       | BEGIN |
    l.go:52: | 07:31:19 | red-metrics | step-03   | APPLY     | RUN   | v1/Secret @ chainsaw-redmetrics/minio-test
    l.go:52: | 07:31:19 | red-metrics | step-03   | CREATE    | OK    | v1/Secret @ chainsaw-redmetrics/minio-test
    l.go:52: | 07:31:19 | red-metrics | step-03   | APPLY     | DONE  | v1/Secret @ chainsaw-redmetrics/minio-test
    l.go:52: | 07:31:19 | red-metrics | step-03   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-redmetrics/redmetrics
    l.go:52: | 07:31:19 | red-metrics | step-03   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-redmetrics/redmetrics
    l.go:52: | 07:31:19 | red-metrics | step-03   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-redmetrics/redmetrics
    l.go:52: | 07:31:19 | red-metrics | step-03   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-redmetrics/tempo-redmetrics-ingester
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-redmetrics/tempo-redmetrics-ingester
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-distributor
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-distributor
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-querier
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-querier
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-query-frontend
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-query-frontend
    l.go:52: | 07:32:10 | red-metrics | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-compactor
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/tempo-redmetrics-compactor
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/Role @ chainsaw-redmetrics/tempo-redmetrics-metrics-reader
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/Role @ chainsaw-redmetrics/tempo-redmetrics-metrics-reader
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-redmetrics/tempo-redmetrics-metrics-reader
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-redmetrics/tempo-redmetrics-metrics-reader
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-redmetrics/tempo-redmetrics-query-frontend
    l.go:52: | 07:32:23 | red-metrics | step-03   | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-redmetrics/tempo-redmetrics-query-frontend
    l.go:52: | 07:32:23 | red-metrics | step-03   | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c /bin/sh -c "kubectl get --namespace $NAMESPACE tempo redmetrics -o jsonpath='{.status.conditions[?(@.type==\"Ready\")].status}' | grep True"
    l.go:52: | 07:32:23 | red-metrics | step-03   | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:32:23 | red-metrics | step-03   | SCRIPT    | DONE  |
    l.go:52: | 07:32:23 | red-metrics | step-03   | TRY       | END   |
    l.go:52: | 07:32:23 | red-metrics | step-04   | TRY       | BEGIN |
    l.go:52: | 07:32:23 | red-metrics | step-04   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:23 | red-metrics | step-04   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:23 | red-metrics | step-04   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:23 | red-metrics | step-04   | APPLY     | RUN   | v1/Service @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:23 | red-metrics | step-04   | CREATE    | OK    | v1/Service @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:23 | red-metrics | step-04   | APPLY     | DONE  | v1/Service @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:23 | red-metrics | step-04   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:26 | red-metrics | step-04   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:32:26 | red-metrics | step-04   | TRY       | END   |
    l.go:52: | 07:32:26 | red-metrics | step-05   | TRY       | BEGIN |
    l.go:52: | 07:32:26 | red-metrics | step-05   | APPLY     | RUN   | batch/v1/Job @ chainsaw-redmetrics/hotrod-curl
    l.go:52: | 07:32:26 | red-metrics | step-05   | CREATE    | OK    | batch/v1/Job @ chainsaw-redmetrics/hotrod-curl
    l.go:52: | 07:32:26 | red-metrics | step-05   | APPLY     | DONE  | batch/v1/Job @ chainsaw-redmetrics/hotrod-curl
    l.go:52: | 07:32:26 | red-metrics | step-05   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-redmetrics/hotrod-curl
    l.go:52: | 07:32:26 | red-metrics | step-05   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-redmetrics/hotrod-curl
    l.go:52: | 07:32:26 | red-metrics | step-05   | TRY       | END   |
    l.go:52: | 07:32:26 | red-metrics | step-06   | TRY       | BEGIN |
    l.go:52: | 07:32:26 | red-metrics | step-06   | APPLY     | RUN   | batch/v1/Job @ chainsaw-redmetrics/verify-metrics
    l.go:52: | 07:32:26 | red-metrics | step-06   | CREATE    | OK    | batch/v1/Job @ chainsaw-redmetrics/verify-metrics
    l.go:52: | 07:32:26 | red-metrics | step-06   | APPLY     | DONE  | batch/v1/Job @ chainsaw-redmetrics/verify-metrics
    l.go:52: | 07:32:26 | red-metrics | step-06   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-redmetrics/verify-metrics
    l.go:52: | 07:33:40 | red-metrics | step-06   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-redmetrics/verify-metrics
    l.go:52: | 07:33:40 | red-metrics | step-06   | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c ./check_alert.sh
    l.go:52: | 07:33:40 | red-metrics | step-06   | SCRIPT    | LOG   |
        === STDOUT
        Alert SpanREDFrontendAPIRequestLatency is firing
    l.go:52: | 07:33:40 | red-metrics | step-06   | SCRIPT    | DONE  |
    l.go:52: | 07:33:40 | red-metrics | step-06   | TRY       | END   |
    l.go:52: | 07:33:40 | red-metrics | step-07   | TRY       | BEGIN |
    l.go:52: | 07:33:40 | red-metrics | step-07   | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c ./check_metrics.sh
    l.go:52: | 07:33:41 | red-metrics | step-07   | SCRIPT    | LOG   |
        === STDOUT
        serviceaccount/e2e-test-metrics-reader created
        clusterrole.rbac.authorization.k8s.io/cluster-monitoring-view added: "system:serviceaccount:chainsaw-redmetrics:e2e-test-metrics-reader"
        Metric 'traces_span_metrics_duration_bucket' with value is present.
        Metric 'traces_span_metrics_duration_count' with value is present.
        Metric 'traces_span_metrics_duration_sum' with value is present.
        Metric 'traces_span_metrics_calls' with value is present.
        === STDERR
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  117k    0  117k    0     0  3271k      0 --:--:-- --:--:-- --:--:-- 3358k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  7024    0  7024    0     0   238k      0 --:--:-- --:--:-- --:--:--  244k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  7147    0  7147    0     0   357k      0 --:--:-- --:--:-- --:--:--  367k
          % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                         Dload  Upload   Total   Spent    Left  Speed
        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  6934    0  6934    0     0   404k      0 --:--:-- --:--:-- --:--:--  423k
    l.go:52: | 07:33:41 | red-metrics | step-07   | SCRIPT    | DONE  |
    l.go:52: | 07:33:41 | red-metrics | step-07   | TRY       | END   |
    l.go:52: | 07:33:41 | red-metrics | step-06   | CLEANUP   | BEGIN |
    l.go:52: | 07:33:41 | red-metrics | step-06   | DELETE    | OK    | batch/v1/Job @ chainsaw-redmetrics/verify-metrics
    l.go:52: | 07:33:41 | red-metrics | step-06   | CLEANUP   | END   |
    l.go:52: | 07:33:41 | red-metrics | step-05   | CLEANUP   | BEGIN |
    l.go:52: | 07:33:41 | red-metrics | step-05   | DELETE    | OK    | batch/v1/Job @ chainsaw-redmetrics/hotrod-curl
    l.go:52: | 07:33:41 | red-metrics | step-05   | CLEANUP   | END   |
    l.go:52: | 07:33:41 | red-metrics | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:33:41 | red-metrics | step-04   | DELETE    | OK    | v1/Service @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:33:41 | red-metrics | step-04   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-redmetrics/hotrod
    l.go:52: | 07:33:41 | red-metrics | step-04   | CLEANUP   | END   |
    l.go:52: | 07:33:41 | red-metrics | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:33:41 | red-metrics | step-03   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-redmetrics/redmetrics
    l.go:52: | 07:33:41 | red-metrics | step-03   | DELETE    | OK    | v1/Secret @ chainsaw-redmetrics/minio-test
    l.go:52: | 07:33:41 | red-metrics | step-03   | CLEANUP   | END   |
    l.go:52: | 07:33:41 | red-metrics | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:33:41 | red-metrics | step-02   | DELETE    | OK    | monitoring.coreos.com/v1/PrometheusRule @ chainsaw-redmetrics/span-red
    l.go:52: | 07:33:41 | red-metrics | step-02   | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-redmetrics/otel
    l.go:52: | 07:33:41 | red-metrics | step-02   | CLEANUP   | END   |
    l.go:52: | 07:33:41 | red-metrics | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:33:41 | red-metrics | step-00   | DELETE    | OK    | v1/Service @ chainsaw-redmetrics/minio
    l.go:52: | 07:33:41 | red-metrics | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-redmetrics/minio
    l.go:52: | 07:33:41 | red-metrics | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-redmetrics/minio
    l.go:52: | 07:33:42 | red-metrics | step-00   | CLEANUP   | END   |
    l.go:52: | 07:33:42 | red-metrics | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:33:42 | red-metrics | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-redmetrics
    l.go:52: | 07:34:13 | red-metrics | @chainsaw | CLEANUP   | END   |
=== RUN   chainsaw/route
=== PAUSE chainsaw/route
=== RUN   chainsaw/tempo-single-tenant-auth
=== PAUSE chainsaw/tempo-single-tenant-auth
=== RUN   chainsaw/tempostack-resources
=== PAUSE chainsaw/tempostack-resources
=== RUN   chainsaw/tls-singletenant-monolithic
=== PAUSE chainsaw/tls-singletenant-monolithic
=== RUN   chainsaw/tls-singletenant
=== PAUSE chainsaw/tls-singletenant
=== RUN   chainsaw/compatibility
=== PAUSE chainsaw/compatibility
=== RUN   chainsaw/custom-ca
=== PAUSE chainsaw/custom-ca
=== RUN   chainsaw/gateway
=== PAUSE chainsaw/gateway
=== RUN   chainsaw/generate
=== PAUSE chainsaw/generate
=== RUN   chainsaw/monolithic-extraconfig
=== PAUSE chainsaw/monolithic-extraconfig
=== RUN   chainsaw/monolithic-ingestion-mtls
=== PAUSE chainsaw/monolithic-ingestion-mtls
=== RUN   chainsaw/monolithic-memory
=== PAUSE chainsaw/monolithic-memory
=== RUN   chainsaw/monolithic-pv
=== PAUSE chainsaw/monolithic-pv
=== RUN   chainsaw/monolithic-receivers-tls
=== PAUSE chainsaw/monolithic-receivers-tls
=== RUN   chainsaw/monolithic-s3-tls
=== PAUSE chainsaw/monolithic-s3-tls
=== RUN   chainsaw/receivers-mtls
=== PAUSE chainsaw/receivers-mtls
=== RUN   chainsaw/receivers-tls
=== PAUSE chainsaw/receivers-tls
=== RUN   chainsaw/reconcile
=== PAUSE chainsaw/reconcile
=== RUN   chainsaw/tempostack-extraconfig
=== PAUSE chainsaw/tempostack-extraconfig
=== RUN   chainsaw/operator-metrics
=== PAUSE chainsaw/operator-metrics
=== CONT  chainsaw/tempostack-retention-global
=== CONT  chainsaw/monolithic-memory
=== CONT  chainsaw/receivers-tls
=== CONT  chainsaw/monolithic-s3-tls
=== CONT  chainsaw/tempostack-resources
=== CONT  chainsaw/tempostack-extraconfig
=== CONT  chainsaw/tempo-single-tenant-auth
=== CONT  chainsaw/operator-metrics
=== CONT  chainsaw/monolithic-single-tenant-auth
=== CONT  chainsaw/receivers-mtls
=== CONT  chainsaw/gateway
=== CONT  chainsaw/monolithic-pv
=== CONT  chainsaw/reconcile
=== CONT  chainsaw/monolithic-receivers-tls
=== CONT  chainsaw/monolithic-route
=== CONT  chainsaw/monolithic-multitenancy-static
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:13 | monolithic-receivers-tls | @chainsaw                           | CREATE    | OK    | v1/Namespace @ chainsaw-brave-gator
    l.go:52: | 07:34:13 | monolithic-receivers-tls | step-01                             | TRY       | BEGIN |
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | @chainsaw                        | CREATE    | OK    | v1/Namespace @ chainsaw-mst
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | TRY       | BEGIN |
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mst/monolithic-st
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:13 | monolithic-memory | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-stunning-fly
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | TRY       | BEGIN |
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:13 | monolithic-s3-tls | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-capital-anteater
    l.go:52: | 07:34:13 | monolithic-s3-tls | step-00   | TRY       | BEGIN |
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:13 | monolithic-receivers-tls | step-01                             | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-brave-gator/simplest
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-stunning-fly/simplest
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:13 | monolithic-s3-tls | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-capital-anteater/minio-cert
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:13 | gateway | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-cunning-bobcat
    l.go:52: | 07:34:13 | gateway | step-00   | TRY       | BEGIN |
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:13 | operator-metrics | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-together-tapir
    l.go:52: | 07:34:13 | operator-metrics | step-00   | TRY       | BEGIN |
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:13 | tempo-single-tenant-auth | @chainsaw                      | CREATE    | OK    | v1/Namespace @ chainsaw-tst
    l.go:52: | 07:34:13 | tempo-single-tenant-auth | Install Minio for object store | TRY       | BEGIN |
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:13 | operator-metrics | step-00   | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/oc get pods -A -l control-plane=controller-manager -l app.kubernetes.io/name=tempo-operator -o jsonpath={.items[0].metadata.namespace}
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:13 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-tst/minio
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:13 | monolithic-multitenancy-static | @chainsaw       | CREATE    | OK    | v1/Namespace @ chainsaw-monolithic-multitenancy-static
    l.go:52: | 07:34:13 | monolithic-multitenancy-static | install-hydra   | TRY       | BEGIN |
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:13 | gateway | step-00   | APPLY     | RUN   | v1/ConfigMap @ chainsaw-cunning-bobcat/dex-config
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:13 | receivers-tls | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-closing-wasp
    l.go:52: | 07:34:13 | receivers-tls | step-00   | TRY       | BEGIN |
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:13 | receivers-mtls | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-together-falcon
    l.go:52: | 07:34:13 | receivers-mtls | step-00   | TRY       | BEGIN |
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:13 | reconcile | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-delicate-bengal
    l.go:52: | 07:34:13 | reconcile | step-00   | TRY       | BEGIN |
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:13 | monolithic-multitenancy-static | install-hydra   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/hydra
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:13 | tempostack-resources | @chainsaw                                                | CREATE    | OK    | v1/Namespace @ chainsaw-quiet-moray
    l.go:52: | 07:34:13 | tempostack-resources | Install Minio                                            | TRY       | BEGIN |
=== NAME  chainsaw/monolithic-route
    l.go:52: | 07:34:13 | monolithic-route | @chainsaw                        | CREATE    | OK    | v1/Namespace @ chainsaw-mono-route
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | TRY       | BEGIN |
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mono-route/mono-route
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:13 | tempostack-retention-global | @chainsaw                                                | CREATE    | OK    | v1/Namespace @ chainsaw-smashing-grouper
    l.go:52: | 07:34:13 | tempostack-retention-global | step-00                                                  | TRY       | BEGIN |
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:13 | reconcile | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/minio
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:13 | receivers-tls | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:13 | tempostack-extraconfig | @chainsaw               | CREATE    | OK    | v1/Namespace @ chainsaw-tempoextcfg
    l.go:52: | 07:34:13 | tempostack-extraconfig | Install Minio storage   | TRY       | BEGIN |
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:13 | receivers-mtls | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-together-falcon/minio
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:34:13 | monolithic-pv | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-crisp-alpaca
    l.go:52: | 07:34:13 | monolithic-pv | step-01   | TRY       | BEGIN |
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:13 | tempostack-resources | Install Minio                                            | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:34:13 | monolithic-pv | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-crisp-alpaca/simplest
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:13 | tempostack-retention-global | step-00                                                  | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:13 | tempostack-extraconfig | Install Minio storage   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:13 | monolithic-s3-tls | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-capital-anteater/minio-cert
    l.go:52: | 07:34:13 | monolithic-s3-tls | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-capital-anteater/minio-cert
    l.go:52: | 07:34:13 | monolithic-s3-tls | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-capital-anteater/minio
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mst/monolithic-st
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mst/monolithic-st
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:13 | monolithic-receivers-tls | step-01                             | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-brave-gator/simplest
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-stunning-fly/simplest
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:13 | monolithic-receivers-tls | step-01                             | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-brave-gator/simplest
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-stunning-fly/simplest
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mst/monolithic-st
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:13 | monolithic-receivers-tls | step-01                             | APPLY     | RUN   | v1/ConfigMap @ chainsaw-brave-gator/custom-ca
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-stunning-fly/simplest
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:13 | gateway | step-00   | CREATE    | OK    | v1/ConfigMap @ chainsaw-cunning-bobcat/dex-config
    l.go:52: | 07:34:13 | gateway | step-00   | APPLY     | DONE  | v1/ConfigMap @ chainsaw-cunning-bobcat/dex-config
    l.go:52: | 07:34:13 | gateway | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-cunning-bobcat/dex
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:13 | receivers-tls | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:13 | receivers-tls | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-route
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mono-route/mono-route
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mono-route/mono-route
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mono-route/mono-route
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:13 | receivers-tls | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:34:13 | monolithic-pv | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-crisp-alpaca/simplest
    l.go:52: | 07:34:13 | monolithic-pv | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-crisp-alpaca/simplest
    l.go:52: | 07:34:13 | monolithic-pv | step-01   | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-crisp-alpaca/simplest
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:13 | operator-metrics | step-00   | CMD       | LOG   |
        === STDOUT
        openshift-tempo-operator
    l.go:52: | 07:34:13 | operator-metrics | step-00   | CMD       | DONE  |
    l.go:52: | 07:34:13 | operator-metrics | step-00   | APPLY     | RUN   | v1/ServiceAccount @ openshift-tempo-operator/sa-assert-metrics
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-stunning-fly/simplest
    l.go:52: | 07:34:13 | monolithic-memory | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-stunning-fly/tempo-simplest
=== NAME  chainsaw/monolithic-route
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mono-route/mono-route
    l.go:52: | 07:34:13 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-mono-route/tempo-mono-route
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mst/monolithic-st
    l.go:52: | 07:34:13 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-mst/tempo-monolithic-st
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-capital-anteater/minio
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-capital-anteater/minio
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:34:14 | monolithic-pv | step-01   | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-crisp-alpaca/simplest
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-capital-anteater/minio
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:34:14 | monolithic-pv | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-crisp-alpaca/tempo-simplest
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | CREATE    | OK    | v1/ConfigMap @ chainsaw-brave-gator/custom-ca
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | APPLY     | DONE  | v1/ConfigMap @ chainsaw-brave-gator/custom-ca
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | APPLY     | RUN   | v1/Secret @ chainsaw-brave-gator/custom-cert
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:14 | tempostack-resources | Install Minio                                            | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:14 | tempostack-resources | Install Minio                                            | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:14 | receivers-mtls | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-together-falcon/minio
    l.go:52: | 07:34:14 | receivers-mtls | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:14 | tempo-single-tenant-auth | Install Minio for object store | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tst/minio
    l.go:52: | 07:34:14 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-tst/minio
    l.go:52: | 07:34:14 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-tst/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:14 | tempostack-retention-global | step-00                                                  | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:14 | tempostack-retention-global | step-00                                                  | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:14 | tempostack-extraconfig | Install Minio storage   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:34:14 | tempostack-extraconfig | Install Minio storage   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:14 | receivers-mtls | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:14 | tempostack-resources | Install Minio                                            | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:14 | tempostack-extraconfig | Install Minio storage   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:14 | tempostack-retention-global | step-00                                                  | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-00   | CREATE    | OK    | v1/ServiceAccount @ openshift-tempo-operator/sa-assert-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-00   | APPLY     | DONE  | v1/ServiceAccount @ openshift-tempo-operator/sa-assert-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-00   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ sa-assert-metrics-role-binding
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | CREATE    | OK    | v1/Secret @ chainsaw-brave-gator/custom-cert
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | APPLY     | DONE  | v1/Secret @ chainsaw-brave-gator/custom-cert
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-brave-gator/simplest
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | CREATE    | OK    | v1/Service @ chainsaw-capital-anteater/minio
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-capital-anteater/minio
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-capital-anteater/minio
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-00   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ sa-assert-metrics-role-binding
    l.go:52: | 07:34:14 | operator-metrics | step-00   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ sa-assert-metrics-role-binding
    l.go:52: | 07:34:14 | operator-metrics | step-00   | ASSERT    | RUN   | v1/ServiceAccount @ openshift-tempo-operator/sa-assert-metrics
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-brave-gator/simplest
    l.go:52: | 07:34:14 | monolithic-receivers-tls | step-01                             | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-brave-gator/tempo-simplest
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-capital-anteater/minio
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-capital-anteater/minio
    l.go:52: | 07:34:14 | monolithic-s3-tls | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-capital-anteater/minio
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-00   | ASSERT    | DONE  | v1/ServiceAccount @ openshift-tempo-operator/sa-assert-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-00   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ sa-assert-metrics-role-binding
    l.go:52: | 07:34:14 | operator-metrics | step-00   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ sa-assert-metrics-role-binding
    l.go:52: | 07:34:14 | operator-metrics | step-00   | TRY       | END   |
    l.go:52: | 07:34:14 | operator-metrics | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:14 | operator-metrics | step-01   | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/oc get pods -A -l control-plane=controller-manager -l app.kubernetes.io/name=tempo-operator -o jsonpath={.items[0].metadata.namespace}
    l.go:52: | 07:34:14 | operator-metrics | step-01   | CMD       | LOG   |
        === STDOUT
        openshift-tempo-operator
    l.go:52: | 07:34:14 | operator-metrics | step-01   | CMD       | DONE  |
    l.go:52: | 07:34:14 | operator-metrics | step-01   | APPLY     | RUN   | batch/v1/Job @ openshift-tempo-operator/verify-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-01   | CREATE    | OK    | batch/v1/Job @ openshift-tempo-operator/verify-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-01   | APPLY     | DONE  | batch/v1/Job @ openshift-tempo-operator/verify-metrics
    l.go:52: | 07:34:14 | operator-metrics | step-01   | ASSERT    | RUN   | batch/v1/Job @ openshift-tempo-operator/verify-metrics
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:14 | monolithic-multitenancy-static | install-hydra   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/hydra
    l.go:52: | 07:34:14 | monolithic-multitenancy-static | install-hydra   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/hydra
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:14 | reconcile | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-delicate-bengal/minio
    l.go:52: | 07:34:14 | reconcile | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/minio
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:14 | monolithic-multitenancy-static | install-hydra   | APPLY     | RUN   | v1/Service @ chainsaw-monolithic-multitenancy-static/hydra
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:14 | reconcile | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-delicate-bengal/minio
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:14 | gateway | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-cunning-bobcat/dex
    l.go:52: | 07:34:14 | gateway | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-cunning-bobcat/dex
    l.go:52: | 07:34:14 | gateway | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-cunning-bobcat/dex
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:15 | receivers-tls | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:15 | receivers-tls | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:15 | receivers-tls | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:15 | monolithic-multitenancy-static | install-hydra   | CREATE    | OK    | v1/Service @ chainsaw-monolithic-multitenancy-static/hydra
    l.go:52: | 07:34:15 | monolithic-multitenancy-static | install-hydra   | APPLY     | DONE  | v1/Service @ chainsaw-monolithic-multitenancy-static/hydra
    l.go:52: | 07:34:15 | monolithic-multitenancy-static | install-hydra   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/hydra
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:15 | reconcile | step-00   | CREATE    | OK    | v1/Service @ chainsaw-delicate-bengal/minio
    l.go:52: | 07:34:15 | reconcile | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-delicate-bengal/minio
    l.go:52: | 07:34:15 | reconcile | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-delicate-bengal/minio-test
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | CREATE    | OK    | apps/v1/Deployment @ chainsaw-tst/minio
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-tst/minio
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | RUN   | v1/Service @ chainsaw-tst/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-together-falcon/minio
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | CREATE    | OK    | apps/v1/Deployment @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:15 | gateway | step-00   | CREATE    | OK    | v1/Service @ chainsaw-cunning-bobcat/dex
    l.go:52: | 07:34:15 | gateway | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-cunning-bobcat/dex
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | CREATE    | OK    | apps/v1/Deployment @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | APPLY     | RUN   | v1/Service @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-together-falcon/minio
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:15 | gateway | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-cunning-bobcat/dex
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | APPLY     | RUN   | v1/Service @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | APPLY     | RUN   | v1/Service @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:15 | receivers-tls | step-00   | CREATE    | OK    | v1/Service @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:15 | receivers-tls | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:15 | reconcile | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-delicate-bengal/minio-test
    l.go:52: | 07:34:15 | reconcile | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-delicate-bengal/minio-test
    l.go:52: | 07:34:15 | reconcile | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/minio
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:15 | receivers-tls | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | CREATE    | OK    | v1/Service @ chainsaw-tst/minio
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | DONE  | v1/Service @ chainsaw-tst/minio
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | RUN   | v1/Secret @ chainsaw-tst/minio
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:15 | receivers-tls | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:15 | receivers-tls | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:15 | receivers-tls | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | CREATE    | OK    | v1/Service @ chainsaw-together-falcon/minio
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-together-falcon/minio
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | CREATE    | OK    | v1/Service @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | APPLY     | DONE  | v1/Service @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | APPLY     | RUN   | v1/Secret @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | CREATE    | OK    | v1/Secret @ chainsaw-tst/minio
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | APPLY     | DONE  | v1/Secret @ chainsaw-tst/minio
    l.go:52: | 07:34:15 | tempo-single-tenant-auth | Install Minio for object store | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tst/minio
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | CREATE    | OK    | v1/Service @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | APPLY     | DONE  | v1/Service @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | APPLY     | RUN   | v1/Secret @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | CREATE    | OK    | v1/Service @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | APPLY     | DONE  | v1/Service @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | APPLY     | RUN   | v1/Secret @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-together-falcon/minio
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | CREATE    | OK    | v1/Secret @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | APPLY     | DONE  | v1/Secret @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:15 | receivers-mtls | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:15 | tempostack-extraconfig | Install Minio storage   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | CREATE    | OK    | v1/Secret @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | APPLY     | DONE  | v1/Secret @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:15 | tempostack-resources | Install Minio                                            | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | CREATE    | OK    | v1/Secret @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | APPLY     | DONE  | v1/Secret @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:15 | tempostack-retention-global | step-00                                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-smashing-grouper/minio
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | install-hydra   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/hydra
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | install-hydra   | TRY       | END   |
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | setup-hydra     | TRY       | BEGIN |
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | setup-hydra     | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/setup-hydra
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | setup-hydra     | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/setup-hydra
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | setup-hydra     | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/setup-hydra
    l.go:52: | 07:34:17 | monolithic-multitenancy-static | setup-hydra     | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/setup-hydra
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-capital-anteater/minio
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-00   | TRY       | END   |
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-01   | APPLY     | RUN   | v1/ConfigMap @ chainsaw-capital-anteater/storage-ca
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:17 | reconcile | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/minio
    l.go:52: | 07:34:17 | reconcile | step-00   | TRY       | END   |
    l.go:52: | 07:34:17 | reconcile | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:17 | reconcile | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-01   | CREATE    | OK    | v1/ConfigMap @ chainsaw-capital-anteater/storage-ca
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-01   | APPLY     | DONE  | v1/ConfigMap @ chainsaw-capital-anteater/storage-ca
    l.go:52: | 07:34:17 | monolithic-s3-tls | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-capital-anteater/simplest
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:17 | reconcile | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
    l.go:52: | 07:34:17 | reconcile | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
    l.go:52: | 07:34:17 | reconcile | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-delicate-bengal/tempo-simplest-querier
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:34:18 | monolithic-s3-tls | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-capital-anteater/simplest
    l.go:52: | 07:34:18 | monolithic-s3-tls | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-capital-anteater/simplest
    l.go:52: | 07:34:18 | monolithic-s3-tls | step-01   | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-capital-anteater/simplest
    l.go:52: | 07:34:18 | monolithic-s3-tls | step-01   | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-capital-anteater/simplest
    l.go:52: | 07:34:18 | monolithic-s3-tls | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-capital-anteater/tempo-simplest
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:18 | operator-metrics | step-01   | ASSERT    | DONE  | batch/v1/Job @ openshift-tempo-operator/verify-metrics
    l.go:52: | 07:34:18 | operator-metrics | step-01   | TRY       | END   |
    l.go:52: | 07:34:18 | operator-metrics | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:34:18 | operator-metrics | step-01   | DELETE    | OK    | batch/v1/Job @ openshift-tempo-operator/verify-metrics
    l.go:52: | 07:34:18 | operator-metrics | step-01   | CLEANUP   | END   |
    l.go:52: | 07:34:18 | operator-metrics | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:34:18 | operator-metrics | step-00   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ sa-assert-metrics-role-binding
    l.go:52: | 07:34:18 | operator-metrics | step-00   | DELETE    | OK    | v1/ServiceAccount @ openshift-tempo-operator/sa-assert-metrics
    l.go:52: | 07:34:18 | operator-metrics | step-00   | CLEANUP   | END   |
    l.go:52: | 07:34:18 | operator-metrics | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:34:18 | operator-metrics | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-together-tapir
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:19 | reconcile | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-delicate-bengal/tempo-simplest-querier
    l.go:52: | 07:34:19 | reconcile | step-01   | TRY       | END   |
    l.go:52: | 07:34:19 | reconcile | step-02   | TRY       | BEGIN |
    l.go:52: | 07:34:19 | reconcile | step-02   | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/kubectl delete service -n chainsaw-delicate-bengal tempo-simplest-querier
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:19 | gateway | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-cunning-bobcat/dex
    l.go:52: | 07:34:19 | gateway | step-00   | TRY       | END   |
    l.go:52: | 07:34:19 | gateway | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:19 | gateway | step-01   | APPLY     | RUN   | v1/Secret @ chainsaw-cunning-bobcat/minio-test
    l.go:52: | 07:34:19 | gateway | step-01   | CREATE    | OK    | v1/Secret @ chainsaw-cunning-bobcat/minio-test
    l.go:52: | 07:34:19 | gateway | step-01   | APPLY     | DONE  | v1/Secret @ chainsaw-cunning-bobcat/minio-test
    l.go:52: | 07:34:19 | gateway | step-01   | APPLY     | RUN   | v1/Secret @ chainsaw-cunning-bobcat/oidc-test
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:19 | reconcile | step-02   | CMD       | LOG   |
        === STDOUT
        service "tempo-simplest-querier" deleted
    l.go:52: | 07:34:19 | reconcile | step-02   | CMD       | DONE  |
    l.go:52: | 07:34:19 | reconcile | step-02   | ASSERT    | RUN   | v1/Service @ chainsaw-delicate-bengal/tempo-simplest-querier
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:19 | gateway | step-01   | CREATE    | OK    | v1/Secret @ chainsaw-cunning-bobcat/oidc-test
    l.go:52: | 07:34:19 | gateway | step-01   | APPLY     | DONE  | v1/Secret @ chainsaw-cunning-bobcat/oidc-test
    l.go:52: | 07:34:19 | gateway | step-01   | ASSERT    | RUN   | v1/Secret @ chainsaw-cunning-bobcat/minio-test
    l.go:52: | 07:34:19 | gateway | step-01   | ASSERT    | DONE  | v1/Secret @ chainsaw-cunning-bobcat/minio-test
    l.go:52: | 07:34:19 | gateway | step-01   | ASSERT    | RUN   | v1/Secret @ chainsaw-cunning-bobcat/oidc-test
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:19 | reconcile | step-02   | ASSERT    | DONE  | v1/Service @ chainsaw-delicate-bengal/tempo-simplest-querier
    l.go:52: | 07:34:19 | reconcile | step-02   | TRY       | END   |
    l.go:52: | 07:34:19 | reconcile | step-03   | TRY       | BEGIN |
    l.go:52: | 07:34:19 | reconcile | step-03   | APPLY     | RUN   | v1/Secret @ chainsaw-delicate-bengal/minio-test
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:19 | gateway | step-01   | ASSERT    | DONE  | v1/Secret @ chainsaw-cunning-bobcat/oidc-test
    l.go:52: | 07:34:19 | gateway | step-01   | TRY       | END   |
    l.go:52: | 07:34:19 | gateway | step-02   | TRY       | BEGIN |
    l.go:52: | 07:34:19 | gateway | step-02   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
=== NAME  chainsaw/reconcile
    l.go:52: | 07:34:20 | reconcile | step-03   | PATCH     | OK    | v1/Secret @ chainsaw-delicate-bengal/minio-test
    l.go:52: | 07:34:20 | reconcile | step-03   | APPLY     | DONE  | v1/Secret @ chainsaw-delicate-bengal/minio-test
    l.go:52: | 07:34:20 | reconcile | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-compactor
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:20 | gateway | step-02   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
    l.go:52: | 07:34:20 | gateway | step-02   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
    l.go:52: | 07:34:20 | gateway | step-02   | ASSERT    | RUN   | v1/Secret @ chainsaw-cunning-bobcat/tempo-foo-gateway
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | setup-hydra     | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/setup-hydra
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | setup-hydra     | TRY       | END   |
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | TRY       | BEGIN |
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | APPLY     | RUN   | v1/Secret @ chainsaw-monolithic-multitenancy-static/tenant1-oidc-secret
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | CREATE    | OK    | v1/Secret @ chainsaw-monolithic-multitenancy-static/tenant1-oidc-secret
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | APPLY     | DONE  | v1/Secret @ chainsaw-monolithic-multitenancy-static/tenant1-oidc-secret
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy-static/sample
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy-static/sample
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy-static/sample
    l.go:52: | 07:34:21 | monolithic-multitenancy-static | install-tempo   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-monolithic-multitenancy-static/tempo-sample
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:21 | gateway | step-02   | ASSERT    | DONE  | v1/Secret @ chainsaw-cunning-bobcat/tempo-foo-gateway
    l.go:52: | 07:34:21 | gateway | step-02   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-cunning-bobcat/tempo-foo-gateway
    l.go:52: | 07:34:21 | gateway | step-02   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-cunning-bobcat/tempo-foo-gateway
    l.go:52: | 07:34:21 | gateway | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-cunning-bobcat/tempo-foo-gateway
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:34:23 | receivers-tls | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/minio
    l.go:52: | 07:34:23 | receivers-tls | step-00   | TRY       | END   |
    l.go:52: | 07:34:23 | receivers-tls | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:23 | receivers-tls | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-closing-wasp/simplest
    l.go:52: | 07:34:24 | receivers-tls | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-closing-wasp/simplest
    l.go:52: | 07:34:24 | receivers-tls | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-closing-wasp/simplest
    l.go:52: | 07:34:24 | receivers-tls | step-01   | APPLY     | RUN   | v1/ConfigMap @ chainsaw-closing-wasp/custom-ca
    l.go:52: | 07:34:24 | receivers-tls | step-01   | CREATE    | OK    | v1/ConfigMap @ chainsaw-closing-wasp/custom-ca
    l.go:52: | 07:34:24 | receivers-tls | step-01   | APPLY     | DONE  | v1/ConfigMap @ chainsaw-closing-wasp/custom-ca
    l.go:52: | 07:34:24 | receivers-tls | step-01   | APPLY     | RUN   | v1/Secret @ chainsaw-closing-wasp/custom-cert
    l.go:52: | 07:34:24 | receivers-tls | step-01   | CREATE    | OK    | v1/Secret @ chainsaw-closing-wasp/custom-cert
    l.go:52: | 07:34:24 | receivers-tls | step-01   | APPLY     | DONE  | v1/Secret @ chainsaw-closing-wasp/custom-cert
    l.go:52: | 07:34:24 | receivers-tls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-compactor
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:34:26 | receivers-mtls | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/minio
    l.go:52: | 07:34:26 | receivers-mtls | step-00   | TRY       | END   |
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-together-falcon/simplest
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-together-falcon/simplest
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-together-falcon/simplest
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | APPLY     | RUN   | v1/ConfigMap @ chainsaw-together-falcon/custom-ca
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | CREATE    | OK    | v1/ConfigMap @ chainsaw-together-falcon/custom-ca
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | APPLY     | DONE  | v1/ConfigMap @ chainsaw-together-falcon/custom-ca
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | APPLY     | RUN   | v1/Secret @ chainsaw-together-falcon/custom-cert
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | CREATE    | OK    | v1/Secret @ chainsaw-together-falcon/custom-cert
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | APPLY     | DONE  | v1/Secret @ chainsaw-together-falcon/custom-cert
    l.go:52: | 07:34:26 | receivers-mtls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-compactor
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:27 | gateway | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-cunning-bobcat/tempo-foo-gateway
    l.go:52: | 07:34:27 | gateway | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-cunning-bobcat/tempo-foo-query-frontend
    l.go:52: | 07:34:27 | gateway | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-cunning-bobcat/tempo-foo-query-frontend
    l.go:52: | 07:34:27 | gateway | step-02   | TRY       | END   |
    l.go:52: | 07:34:27 | gateway | step-03   | TRY       | BEGIN |
    l.go:52: | 07:34:27 | gateway | step-03   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
    l.go:52: | 07:34:27 | gateway | step-03   | PATCH     | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
    l.go:52: | 07:34:27 | gateway | step-03   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
    l.go:52: | 07:34:27 | gateway | step-03   | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c while true
        do
          if kubectl get deployment/tempo-foo-query-frontend -n $NAMESPACE -o=jsonpath='{.spec.template.spec.containers[*].name}' | grep -q tempo-query; then
            echo tempo-query container still exists. Retrying...
          else
            echo tempo-query container no longer exists. Test passed.
            exit 0
          fi
          sleep 5
        done
    l.go:52: | 07:34:27 | gateway | step-03   | SCRIPT    | LOG   |
        === STDOUT
        tempo-query container no longer exists. Test passed.
    l.go:52: | 07:34:27 | gateway | step-03   | SCRIPT    | DONE  |
    l.go:52: | 07:34:27 | gateway | step-03   | TRY       | END   |
    l.go:52: | 07:34:27 | gateway | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:34:27 | gateway | step-02   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-cunning-bobcat/foo
    l.go:52: | 07:34:27 | gateway | step-02   | CLEANUP   | END   |
    l.go:52: | 07:34:27 | gateway | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:34:27 | gateway | step-01   | DELETE    | OK    | v1/Secret @ chainsaw-cunning-bobcat/oidc-test
    l.go:52: | 07:34:27 | gateway | step-01   | DELETE    | OK    | v1/Secret @ chainsaw-cunning-bobcat/minio-test
    l.go:52: | 07:34:27 | gateway | step-01   | CLEANUP   | END   |
    l.go:52: | 07:34:27 | gateway | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:34:27 | gateway | step-00   | DELETE    | OK    | v1/Service @ chainsaw-cunning-bobcat/dex
    l.go:52: | 07:34:28 | gateway | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-cunning-bobcat/dex
    l.go:52: | 07:34:28 | gateway | step-00   | DELETE    | OK    | v1/ConfigMap @ chainsaw-cunning-bobcat/dex-config
    l.go:52: | 07:34:28 | gateway | step-00   | CLEANUP   | END   |
    l.go:52: | 07:34:28 | gateway | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:34:28 | gateway | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-cunning-bobcat
=== NAME  chainsaw/operator-metrics
    l.go:52: | 07:34:28 | operator-metrics | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:34:28 | monolithic-multitenancy-openshift | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-monolithic-multitenancy
    l.go:52: | 07:34:28 | monolithic-multitenancy-openshift | step-01   | TRY       | BEGIN |
    l.go:52: | 07:34:28 | monolithic-multitenancy-openshift | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy/monolithic-multitenancy-openshift
    l.go:52: | 07:34:28 | monolithic-multitenancy-openshift | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy/monolithic-multitenancy-openshift
    l.go:52: | 07:34:28 | monolithic-multitenancy-openshift | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy/monolithic-multitenancy-openshift
    l.go:52: | 07:34:28 | monolithic-multitenancy-openshift | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ allow-write-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ allow-write-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ allow-write-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-write-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-write-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-write-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ allow-read-traces-dev-tenant
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install Minio storage   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install Minio storage   | TRY       | END   |
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | TRY       | BEGIN |
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempoextcfg/simplest
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ allow-read-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ allow-read-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-read-traces-dev-tenant
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempoextcfg/simplest
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempoextcfg/simplest
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempoextcfg/simplest
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-read-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-read-traces-dev-tenant
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-monolithic-multitenancy/view
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempoextcfg/simplest
    l.go:52: | 07:34:29 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-tempoextcfg/tempo-simplest
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-monolithic-multitenancy/view
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-monolithic-multitenancy/view
    l.go:52: | 07:34:29 | monolithic-multitenancy-openshift | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-monolithic-multitenancy/tempo-monolithic-multitenancy-openshift
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:30 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-tempoextcfg/tempo-simplest
    l.go:52: | 07:34:30 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-query-frontend
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:34:32 | tempostack-resources | Install Minio                                            | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/minio
    l.go:52: | 07:34:32 | tempostack-resources | Install Minio                                            | TRY       | END   |
    l.go:52: | 07:34:32 | tempostack-resources | Create TempoStack with resources assigned globally       | TRY       | BEGIN |
    l.go:52: | 07:34:32 | tempostack-resources | Create TempoStack with resources assigned globally       | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:34:32 | tempostack-resources | Create TempoStack with resources assigned globally       | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:34:32 | tempostack-resources | Create TempoStack with resources assigned globally       | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:34:32 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-quiet-moray/tempo-tmrs-ingester
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:34:32 | tempostack-retention-global | step-00                                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-smashing-grouper/minio
    l.go:52: | 07:34:32 | tempostack-retention-global | step-00                                                  | TRY       | END   |
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | TRY       | BEGIN |
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-smashing-grouper/global
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-smashing-grouper/global
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-smashing-grouper/global
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-smashing-grouper/global
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-smashing-grouper/global
    l.go:52: | 07:34:32 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-smashing-grouper/tempo-global
    l.go:52: | 07:34:34 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-smashing-grouper/tempo-global
    l.go:52: | 07:34:34 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-query-frontend
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Install Minio for object store | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tst/minio
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Install Minio for object store | TRY       | END   |
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | TRY       | BEGIN |
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tst/tempo-st
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tst/tempo-st
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tst/tempo-st
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tst/tempo-st
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tst/tempo-st
    l.go:52: | 07:34:35 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-tst/tempo-tempo-st
    l.go:52: | 07:34:37 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-tst/tempo-tempo-st
    l.go:52: | 07:34:37 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-query-frontend
=== NAME  chainsaw/gateway
    l.go:52: | 07:34:47 | gateway | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/component-replicas
    l.go:52: | 07:34:47 | component-replicas | @chainsaw                                         | CREATE    | OK    | v1/Namespace @ chainsaw-replicas
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | TRY       | BEGIN |
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | CREATE    | OK    | apps/v1/Deployment @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | RUN   | v1/Service @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | CREATE    | OK    | v1/Service @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | DONE  | v1/Service @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | RUN   | v1/Secret @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | CREATE    | OK    | v1/Secret @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | APPLY     | DONE  | v1/Secret @ chainsaw-replicas/minio
    l.go:52: | 07:34:47 | component-replicas | Create Minio storage instance                     | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/minio
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:34:54 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-query-frontend
    l.go:52: | 07:34:54 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-distributor
    l.go:52: | 07:34:54 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-distributor
    l.go:52: | 07:34:54 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-querier
    l.go:52: | 07:34:54 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-querier
    l.go:52: | 07:34:54 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-compactor
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-brave-gator/tempo-simplest
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-stunning-fly/tempo-simplest
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | RUN   | v1/Pod @ chainsaw-stunning-fly/tempo-simplest-0
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | RUN   | v1/Pod @ chainsaw-brave-gator/tempo-simplest-0
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | DONE  | v1/Pod @ chainsaw-stunning-fly/tempo-simplest-0
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-stunning-fly/tempo-simplest
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | DONE  | v1/Pod @ chainsaw-brave-gator/tempo-simplest-0
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | RUN   | v1/Service @ chainsaw-brave-gator/tempo-simplest
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-stunning-fly/tempo-simplest
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | DONE  | v1/Service @ chainsaw-brave-gator/tempo-simplest
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | RUN   | v1/Service @ chainsaw-brave-gator/tempo-simplest-jaegerui
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-stunning-fly/tempo-simplest-jaegerui
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | ASSERT    | DONE  | v1/Service @ chainsaw-brave-gator/tempo-simplest-jaegerui
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-01                             | TRY       | END   |
    l.go:52: | 07:34:54 | monolithic-receivers-tls | Check the status of Tempo Monolithc | TRY       | BEGIN |
    l.go:52: | 07:34:54 | monolithic-receivers-tls | Check the status of Tempo Monolithc | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempomonolithics simplest -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}'
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-stunning-fly/tempo-simplest-jaegerui
    l.go:52: | 07:34:54 | monolithic-memory | step-01   | TRY       | END   |
    l.go:52: | 07:34:54 | monolithic-memory | step-03   | TRY       | BEGIN |
    l.go:52: | 07:34:54 | monolithic-memory | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-stunning-fly/generate-traces
    l.go:52: | 07:34:54 | monolithic-memory | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-stunning-fly/generate-traces
    l.go:52: | 07:34:54 | monolithic-memory | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-stunning-fly/generate-traces
    l.go:52: | 07:34:54 | monolithic-memory | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-stunning-fly/generate-traces
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:34:54 | monolithic-receivers-tls | Check the status of Tempo Monolithc | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:34:54 | monolithic-receivers-tls | Check the status of Tempo Monolithc | SCRIPT    | DONE  |
    l.go:52: | 07:34:54 | monolithic-receivers-tls | Check the status of Tempo Monolithc | TRY       | END   |
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-02                             | TRY       | BEGIN |
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-02                             | APPLY     | RUN   | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-brave-gator/opentelemetry
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-02                             | CREATE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-brave-gator/opentelemetry
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-02                             | APPLY     | DONE  | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-brave-gator/opentelemetry
    l.go:52: | 07:34:54 | monolithic-receivers-tls | step-02                             | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-brave-gator/opentelemetry-collector
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:34:58 | monolithic-memory | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-stunning-fly/generate-traces
    l.go:52: | 07:34:58 | monolithic-memory | step-03   | TRY       | END   |
    l.go:52: | 07:34:58 | monolithic-memory | step-04   | TRY       | BEGIN |
    l.go:52: | 07:34:58 | monolithic-memory | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-jaeger
    l.go:52: | 07:34:58 | monolithic-memory | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-jaeger
    l.go:52: | 07:34:58 | monolithic-memory | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-jaeger
    l.go:52: | 07:34:58 | monolithic-memory | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-jaeger
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-mst/tempo-monolithic-st
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/Pod @ chainsaw-mst/*
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-tempo   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-monolithic-multitenancy-static/tempo-sample
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-tempo   | TRY       | END   |
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-otel    | TRY       | BEGIN |
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-otel    | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy-static/opentelemetry
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/Pod @ chainsaw-mst/*
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/Service @ chainsaw-mst/tempo-monolithic-st
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/Service @ chainsaw-mst/tempo-monolithic-st
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/Service @ chainsaw-mst/tempo-monolithic-st-jaegerui
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-otel    | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy-static/opentelemetry
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-otel    | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy-static/opentelemetry
    l.go:52: | 07:34:58 | monolithic-multitenancy-static | install-otel    | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/opentelemetry-collector
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/Service @ chainsaw-mst/tempo-monolithic-st-jaegerui
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | TRY       | END   |
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Generate traces                  | TRY       | BEGIN |
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Generate traces                  | APPLY     | RUN   | batch/v1/Job @ chainsaw-mst/generate-traces
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Generate traces                  | CREATE    | OK    | batch/v1/Job @ chainsaw-mst/generate-traces
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Generate traces                  | APPLY     | DONE  | batch/v1/Job @ chainsaw-mst/generate-traces
    l.go:52: | 07:34:58 | monolithic-single-tenant-auth | Generate traces                  | ASSERT    | RUN   | batch/v1/Job @ chainsaw-mst/generate-traces
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:00 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-query-frontend
    l.go:52: | 07:35:00 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-distributor
    l.go:52: | 07:35:00 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-distributor
    l.go:52: | 07:35:00 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-querier
    l.go:52: | 07:35:00 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-querier
    l.go:52: | 07:35:00 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-compactor
=== NAME  chainsaw/monolithic-route
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-mono-route/tempo-mono-route
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/Pod @ chainsaw-mono-route/*
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/Pod @ chainsaw-mono-route/*
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/Service @ chainsaw-mono-route/tempo-mono-route
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/Service @ chainsaw-mono-route/tempo-mono-route
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/Service @ chainsaw-mono-route/tempo-mono-route-jaegerui
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/Service @ chainsaw-mono-route/tempo-mono-route-jaegerui
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-mono-route/tempo-mono-route-config
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-mono-route/tempo-mono-route-config
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-mono-route/tempo-mono-route-jaegerui
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-mono-route/tempo-mono-route-jaegerui
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | TRY       | END   |
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | CLEANUP   | BEGIN |
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mono-route/mono-route
    l.go:52: | 07:35:00 | monolithic-route | Create Tempo Monolithic instance | CLEANUP   | END   |
    l.go:52: | 07:35:00 | monolithic-route | @chainsaw                        | CLEANUP   | BEGIN |
    l.go:52: | 07:35:00 | monolithic-route | @chainsaw                        | DELETE    | OK    | v1/Namespace @ chainsaw-mono-route
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | install-otel    | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/opentelemetry-collector
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | install-otel    | ASSERT    | RUN   | v1/Service @ chainsaw-monolithic-multitenancy-static/opentelemetry-collector
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:01 | monolithic-receivers-tls | step-02                             | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-brave-gator/opentelemetry-collector
    l.go:52: | 07:35:01 | monolithic-receivers-tls | step-02                             | ASSERT    | RUN   | v1/Service @ chainsaw-brave-gator/opentelemetry-collector
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | install-otel    | ASSERT    | DONE  | v1/Service @ chainsaw-monolithic-multitenancy-static/opentelemetry-collector
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | install-otel    | TRY       | END   |
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | generate-traces | TRY       | BEGIN |
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | generate-traces | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/generate-traces
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:01 | monolithic-receivers-tls | step-02                             | ASSERT    | DONE  | v1/Service @ chainsaw-brave-gator/opentelemetry-collector
    l.go:52: | 07:35:01 | monolithic-receivers-tls | step-02                             | TRY       | END   |
    l.go:52: | 07:35:01 | monolithic-receivers-tls | Wait before generating traces       | TRY       | BEGIN |
    l.go:52: | 07:35:01 | monolithic-receivers-tls | Wait before generating traces       | SLEEP     | RUN   |
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | generate-traces | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/generate-traces
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | generate-traces | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/generate-traces
    l.go:52: | 07:35:01 | monolithic-multitenancy-static | generate-traces | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/generate-traces
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:02 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-query-frontend
    l.go:52: | 07:35:02 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-distributor
    l.go:52: | 07:35:02 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-distributor
    l.go:52: | 07:35:02 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-querier
    l.go:52: | 07:35:02 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-querier
    l.go:52: | 07:35:02 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-compactor
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:35:03 | monolithic-memory | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-jaeger
    l.go:52: | 07:35:03 | monolithic-memory | step-04   | TRY       | END   |
    l.go:52: | 07:35:03 | monolithic-memory | step-05   | TRY       | BEGIN |
    l.go:52: | 07:35:03 | monolithic-memory | step-05   | APPLY     | RUN   | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-grafana
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Generate traces                  | ASSERT    | DONE  | batch/v1/Job @ chainsaw-mst/generate-traces
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Generate traces                  | TRY       | END   |
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | TRY       | BEGIN |
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | APPLY     | RUN   | batch/v1/Job @ chainsaw-mst/verify-traces-jaeger
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:35:03 | monolithic-memory | step-05   | CREATE    | OK    | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-grafana
    l.go:52: | 07:35:03 | monolithic-memory | step-05   | APPLY     | DONE  | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-grafana
    l.go:52: | 07:35:03 | monolithic-memory | step-05   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-grafana
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | CREATE    | OK    | batch/v1/Job @ chainsaw-mst/verify-traces-jaeger
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | APPLY     | DONE  | batch/v1/Job @ chainsaw-mst/verify-traces-jaeger
    l.go:52: | 07:35:03 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | ASSERT    | RUN   | batch/v1/Job @ chainsaw-mst/verify-traces-jaeger
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | generate-traces | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/generate-traces
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | generate-traces | TRY       | END   |
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | verify-traces   | TRY       | BEGIN |
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | verify-traces   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/verify-traces-traceql
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | verify-traces   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/verify-traces-traceql
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | verify-traces   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/verify-traces-traceql
    l.go:52: | 07:35:05 | monolithic-multitenancy-static | verify-traces   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/verify-traces-traceql
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:35:07 | monolithic-memory | step-05   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-grafana
    l.go:52: | 07:35:07 | monolithic-memory | step-05   | TRY       | END   |
    l.go:52: | 07:35:07 | monolithic-memory | step-05   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:07 | monolithic-memory | step-05   | DELETE    | OK    | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-grafana
    l.go:52: | 07:35:07 | monolithic-memory | step-05   | CLEANUP   | END   |
    l.go:52: | 07:35:07 | monolithic-memory | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:07 | monolithic-memory | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-stunning-fly/verify-traces-jaeger
    l.go:52: | 07:35:07 | monolithic-memory | step-04   | CLEANUP   | END   |
    l.go:52: | 07:35:07 | monolithic-memory | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:07 | monolithic-memory | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-stunning-fly/generate-traces
    l.go:52: | 07:35:07 | monolithic-memory | step-03   | CLEANUP   | END   |
    l.go:52: | 07:35:07 | monolithic-memory | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:07 | monolithic-memory | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-stunning-fly/simplest
    l.go:52: | 07:35:07 | monolithic-memory | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:07 | monolithic-memory | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:07 | monolithic-memory | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-stunning-fly
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:35:07 | component-replicas | Create Minio storage instance                     | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/minio
    l.go:52: | 07:35:07 | component-replicas | Create Minio storage instance                     | TRY       | END   |
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | TRY       | BEGIN |
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ replicas-traces-reader
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ replicas-traces-reader
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ replicas-traces-reader
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ replicas-traces-reader
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ replicas-traces-reader
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ replicas-traces-reader
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | RUN   | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-replicas/view
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | CREATE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-replicas/view
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | APPLY     | DONE  | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-replicas/view
    l.go:52: | 07:35:07 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | v1/Secret @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | v1/Secret @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway-cabundle
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway-cabundle
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:08 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-cmpreps-gateway
    l.go:52: | 07:35:09 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-cmpreps-gateway
    l.go:52: | 07:35:09 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-cmpreps-gateway
    l.go:52: | 07:35:09 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-cmpreps-gateway
    l.go:52: | 07:35:09 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:10 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:10 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:10 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:10 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | v1/Service @ chainsaw-replicas/tempo-cmpreps-gateway
=== NAME  chainsaw/monolithic-route
    l.go:52: | 07:35:10 | monolithic-route | @chainsaw                        | CLEANUP   | END   |
=== CONT  chainsaw/compatibility
    l.go:52: | 07:35:10 | compatibility | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-shining-owl
    l.go:52: | 07:35:10 | compatibility | step-00   | TRY       | BEGIN |
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-shining-owl/minio
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:35:10 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | v1/Service @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:35:10 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-compactor
=== NAME  chainsaw/compatibility
    l.go:52: | 07:35:10 | compatibility | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | CREATE    | OK    | v1/Service @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:10 | compatibility | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-shining-owl/minio
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:35:11 | monolithic-pv | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-crisp-alpaca/tempo-simplest
    l.go:52: | 07:35:11 | monolithic-pv | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-crisp-alpaca/tempo-simplest
    l.go:52: | 07:35:11 | monolithic-pv | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-crisp-alpaca/tempo-simplest
    l.go:52: | 07:35:11 | monolithic-pv | step-01   | TRY       | END   |
    l.go:52: | 07:35:11 | monolithic-pv | step-03   | TRY       | BEGIN |
    l.go:52: | 07:35:11 | monolithic-pv | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-crisp-alpaca/generate-traces
    l.go:52: | 07:35:11 | monolithic-pv | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-crisp-alpaca/generate-traces
    l.go:52: | 07:35:11 | monolithic-pv | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-crisp-alpaca/generate-traces
    l.go:52: | 07:35:11 | monolithic-pv | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-crisp-alpaca/generate-traces
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-capital-anteater/tempo-simplest
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-capital-anteater/tempo-simplest
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-capital-anteater/tempo-simplest
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-01   | TRY       | END   |
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-03   | TRY       | BEGIN |
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-capital-anteater/generate-traces
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-capital-anteater/generate-traces
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-capital-anteater/generate-traces
    l.go:52: | 07:35:13 | monolithic-s3-tls | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-capital-anteater/generate-traces
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:35:15 | monolithic-pv | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-crisp-alpaca/generate-traces
    l.go:52: | 07:35:15 | monolithic-pv | step-03   | TRY       | END   |
    l.go:52: | 07:35:15 | monolithic-pv | step-04   | TRY       | BEGIN |
    l.go:52: | 07:35:15 | monolithic-pv | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-crisp-alpaca/verify-traces
    l.go:52: | 07:35:15 | monolithic-pv | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-crisp-alpaca/verify-traces
    l.go:52: | 07:35:15 | monolithic-pv | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-crisp-alpaca/verify-traces
    l.go:52: | 07:35:15 | monolithic-pv | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-crisp-alpaca/verify-traces
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-capital-anteater/generate-traces
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-03   | TRY       | END   |
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-04   | TRY       | BEGIN |
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-capital-anteater/verify-traces
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | ASSERT    | DONE  | batch/v1/Job @ chainsaw-mst/verify-traces-jaeger
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | TRY       | END   |
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces from TraceQL       | TRY       | BEGIN |
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-capital-anteater/verify-traces
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-capital-anteater/verify-traces
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces from TraceQL       | APPLY     | RUN   | batch/v1/Job @ chainsaw-mst/verify-traces-traceql
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:35:17 | monolithic-s3-tls | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-capital-anteater/verify-traces
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces from TraceQL       | CREATE    | OK    | batch/v1/Job @ chainsaw-mst/verify-traces-traceql
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces from TraceQL       | APPLY     | DONE  | batch/v1/Job @ chainsaw-mst/verify-traces-traceql
    l.go:52: | 07:35:17 | monolithic-single-tenant-auth | Verify traces from TraceQL       | ASSERT    | RUN   | batch/v1/Job @ chainsaw-mst/verify-traces-traceql
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | verify-traces   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/verify-traces-traceql
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | verify-traces   | TRY       | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | verify-traces   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | verify-traces   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/verify-traces-traceql
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | verify-traces   | CLEANUP   | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | generate-traces | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | generate-traces | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/generate-traces
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | generate-traces | CLEANUP   | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-otel    | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-otel    | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy-static/opentelemetry
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-otel    | CLEANUP   | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-tempo   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-tempo   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy-static/sample
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-tempo   | DELETE    | OK    | v1/Secret @ chainsaw-monolithic-multitenancy-static/tenant1-oidc-secret
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-tempo   | CLEANUP   | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | setup-hydra     | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | setup-hydra     | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy-static/setup-hydra
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | setup-hydra     | CLEANUP   | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-hydra   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-hydra   | DELETE    | OK    | v1/Service @ chainsaw-monolithic-multitenancy-static/hydra
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-hydra   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-monolithic-multitenancy-static/hydra
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | install-hydra   | CLEANUP   | END   |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | @chainsaw       | CLEANUP   | BEGIN |
    l.go:52: | 07:35:19 | monolithic-multitenancy-static | @chainsaw       | DELETE    | OK    | v1/Namespace @ chainsaw-monolithic-multitenancy-static
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:21 | monolithic-receivers-tls | Wait before generating traces       | SLEEP     | DONE  |
    l.go:52: | 07:35:21 | monolithic-receivers-tls | Wait before generating traces       | TRY       | END   |
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | TRY       | BEGIN |
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | APPLY     | RUN   | batch/v1/Job @ chainsaw-brave-gator/generate-traces-grpc
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | CREATE    | OK    | batch/v1/Job @ chainsaw-brave-gator/generate-traces-grpc
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | APPLY     | DONE  | batch/v1/Job @ chainsaw-brave-gator/generate-traces-grpc
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | APPLY     | RUN   | batch/v1/Job @ chainsaw-brave-gator/generate-traces-http
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | CREATE    | OK    | batch/v1/Job @ chainsaw-brave-gator/generate-traces-http
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | APPLY     | DONE  | batch/v1/Job @ chainsaw-brave-gator/generate-traces-http
    l.go:52: | 07:35:21 | monolithic-receivers-tls | step-03                             | ASSERT    | RUN   | batch/v1/Job @ chainsaw-brave-gator/generate-traces-http
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces from TraceQL       | ASSERT    | DONE  | batch/v1/Job @ chainsaw-mst/verify-traces-traceql
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces from TraceQL       | TRY       | END   |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces from TraceQL       | CLEANUP   | BEGIN |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces from TraceQL       | DELETE    | OK    | batch/v1/Job @ chainsaw-mst/verify-traces-traceql
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces from TraceQL       | CLEANUP   | END   |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | CLEANUP   | BEGIN |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | DELETE    | OK    | batch/v1/Job @ chainsaw-mst/verify-traces-jaeger
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Verify traces using Jaeger UI    | CLEANUP   | END   |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Generate traces                  | CLEANUP   | BEGIN |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Generate traces                  | DELETE    | OK    | batch/v1/Job @ chainsaw-mst/generate-traces
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Generate traces                  | CLEANUP   | END   |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | CLEANUP   | BEGIN |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-mst/monolithic-st
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | Create Tempo Monolithic instance | CLEANUP   | END   |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | @chainsaw                        | CLEANUP   | BEGIN |
    l.go:52: | 07:35:21 | monolithic-single-tenant-auth | @chainsaw                        | DELETE    | OK    | v1/Namespace @ chainsaw-mst
=== NAME  chainsaw/compatibility
    l.go:52: | 07:35:21 | compatibility | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-shining-owl/minio
    l.go:52: | 07:35:21 | compatibility | step-00   | TRY       | END   |
    l.go:52: | 07:35:21 | compatibility | step-01   | TRY       | BEGIN |
    l.go:52: | 07:35:21 | compatibility | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-shining-owl/simplest
    l.go:52: | 07:35:21 | compatibility | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-shining-owl/simplest
    l.go:52: | 07:35:21 | compatibility | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-shining-owl/simplest
    l.go:52: | 07:35:21 | compatibility | step-01   | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-shining-owl/simplest
    l.go:52: | 07:35:21 | compatibility | step-01   | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-shining-owl/simplest
    l.go:52: | 07:35:22 | compatibility | step-01   | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-shining-owl/tempo-simplest
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-monolithic-multitenancy/tempo-monolithic-multitenancy-openshift
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-01   | ASSERT    | RUN   | v1/Pod @ chainsaw-monolithic-multitenancy/tempo-monolithic-multitenancy-openshift-0
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-01   | ASSERT    | DONE  | v1/Pod @ chainsaw-monolithic-multitenancy/tempo-monolithic-multitenancy-openshift-0
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-monolithic-multitenancy/tempo-monolithic-multitenancy-openshift-gateway
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-monolithic-multitenancy/tempo-monolithic-multitenancy-openshift-gateway
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-01   | TRY       | END   |
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-02   | TRY       | BEGIN |
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-02   | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy/dev
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-02   | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy/dev
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-02   | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy/dev
    l.go:52: | 07:35:22 | monolithic-multitenancy-openshift | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-monolithic-multitenancy/dev-collector
=== NAME  chainsaw/compatibility
    l.go:52: | 07:35:23 | compatibility | step-01   | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-shining-owl/tempo-simplest
    l.go:52: | 07:35:23 | compatibility | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-query-frontend
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:35:23 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-quiet-moray/tempo-tmrs-ingester
    l.go:52: | 07:35:23 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-compactor
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-monolithic-multitenancy/dev-collector
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-02   | ASSERT    | RUN   | v1/Service @ chainsaw-monolithic-multitenancy/dev-collector
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-02   | ASSERT    | DONE  | v1/Service @ chainsaw-monolithic-multitenancy/dev-collector
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-02   | TRY       | END   |
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | TRY       | BEGIN |
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-grpc
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-grpc
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-grpc
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-http
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-http
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-http
    l.go:52: | 07:35:24 | monolithic-multitenancy-openshift | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-grpc
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-03                             | ASSERT    | DONE  | batch/v1/Job @ chainsaw-brave-gator/generate-traces-http
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-03                             | ASSERT    | RUN   | batch/v1/Job @ chainsaw-brave-gator/generate-traces-grpc
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-03                             | ASSERT    | DONE  | batch/v1/Job @ chainsaw-brave-gator/generate-traces-grpc
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-03                             | TRY       | END   |
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | TRY       | BEGIN |
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | APPLY     | RUN   | batch/v1/Job @ chainsaw-brave-gator/verify-traces-http
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | CREATE    | OK    | batch/v1/Job @ chainsaw-brave-gator/verify-traces-http
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | APPLY     | DONE  | batch/v1/Job @ chainsaw-brave-gator/verify-traces-http
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | APPLY     | RUN   | batch/v1/Job @ chainsaw-brave-gator/verify-traces-grpc
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | CREATE    | OK    | batch/v1/Job @ chainsaw-brave-gator/verify-traces-grpc
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | APPLY     | DONE  | batch/v1/Job @ chainsaw-brave-gator/verify-traces-grpc
    l.go:52: | 07:35:25 | monolithic-receivers-tls | step-04                             | ASSERT    | RUN   | batch/v1/Job @ chainsaw-brave-gator/verify-traces-http
=== NAME  chainsaw/reconcile
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-compactor
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-distributor
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-distributor
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-delicate-bengal/tempo-simplest-ingester
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-delicate-bengal/tempo-simplest-ingester
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-querier
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-querier
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-query-frontend
    l.go:52: | 07:35:26 | reconcile | step-03   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-query-frontend
    l.go:52: | 07:35:26 | reconcile | step-03   | TRY       | END   |
    l.go:52: | 07:35:26 | reconcile | step-04   | TRY       | BEGIN |
    l.go:52: | 07:35:26 | reconcile | step-04   | CMD       | RUN   |
        === COMMAND
        /bin/sh -c kubectl get --namespace chainsaw-delicate-bengal configmap tempo-simplest -o jsonpath="{.data.tempo\\.yaml}" | grep "bucket: tempo2"
    l.go:52: | 07:35:26 | reconcile | step-04   | CMD       | LOG   |
        === STDOUT
        bucket: tempo2
    l.go:52: | 07:35:26 | reconcile | step-04   | CMD       | DONE  |
    l.go:52: | 07:35:26 | reconcile | step-04   | TRY       | END   |
    l.go:52: | 07:35:26 | reconcile | step-05   | TRY       | BEGIN |
    l.go:52: | 07:35:26 | reconcile | step-05   | APPLY     | RUN   | v1/ServiceAccount @ chainsaw-delicate-bengal/fake-sa
    l.go:52: | 07:35:27 | reconcile | step-05   | CREATE    | OK    | v1/ServiceAccount @ chainsaw-delicate-bengal/fake-sa
    l.go:52: | 07:35:27 | reconcile | step-05   | APPLY     | DONE  | v1/ServiceAccount @ chainsaw-delicate-bengal/fake-sa
    l.go:52: | 07:35:27 | reconcile | step-05   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
    l.go:52: | 07:35:27 | reconcile | step-05   | PATCH     | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
    l.go:52: | 07:35:27 | reconcile | step-05   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
    l.go:52: | 07:35:27 | reconcile | step-05   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-distributor
    l.go:52: | 07:35:27 | reconcile | step-05   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-delicate-bengal/tempo-simplest-distributor
    l.go:52: | 07:35:27 | reconcile | step-05   | TRY       | END   |
    l.go:52: | 07:35:27 | reconcile | step-06   | TRY       | BEGIN |
    l.go:52: | 07:35:27 | reconcile | step-06   | CMD       | RUN   |
        === COMMAND
        /bin/sh -c ! kubectl get --namespace chainsaw-delicate-bengal configmap tempo-simplest -o jsonpath='{.data.tempo\.yaml}' | grep '[[:blank:]]$'
    l.go:52: | 07:35:27 | reconcile | step-06   | CMD       | DONE  |
    l.go:52: | 07:35:27 | reconcile | step-06   | TRY       | END   |
    l.go:52: | 07:35:27 | reconcile | step-05   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:27 | reconcile | step-05   | DELETE    | OK    | v1/ServiceAccount @ chainsaw-delicate-bengal/fake-sa
    l.go:52: | 07:35:27 | reconcile | step-05   | CLEANUP   | END   |
    l.go:52: | 07:35:27 | reconcile | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:27 | reconcile | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-delicate-bengal/simplest
    l.go:52: | 07:35:27 | reconcile | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:27 | reconcile | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:27 | reconcile | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-delicate-bengal/minio-test
    l.go:52: | 07:35:27 | reconcile | step-00   | DELETE    | OK    | v1/Service @ chainsaw-delicate-bengal/minio
    l.go:52: | 07:35:27 | reconcile | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-delicate-bengal/minio
    l.go:52: | 07:35:27 | reconcile | step-00   | CLEANUP   | END   |
    l.go:52: | 07:35:27 | reconcile | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:27 | reconcile | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-delicate-bengal
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:27 | monolithic-multitenancy-openshift | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-grpc
    l.go:52: | 07:35:27 | monolithic-multitenancy-openshift | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-http
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-compactor
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-distributor
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-distributor
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-querier
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-querier
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-query-frontend
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/tempo-simplest-query-frontend
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-closing-wasp/tempo-simplest-ingester
    l.go:52: | 07:35:28 | receivers-tls | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-closing-wasp/tempo-simplest-ingester
    l.go:52: | 07:35:28 | receivers-tls | step-01   | TRY       | END   |
    l.go:52: | 07:35:28 | receivers-tls | step-02   | TRY       | BEGIN |
    l.go:52: | 07:35:28 | receivers-tls | step-02   | APPLY     | RUN   | v1/Secret @ chainsaw-closing-wasp/opentelemetry-collector-cert
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-http
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-03   | TRY       | END   |
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-04   | TRY       | BEGIN |
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-grpc
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:28 | receivers-tls | step-02   | CREATE    | OK    | v1/Secret @ chainsaw-closing-wasp/opentelemetry-collector-cert
    l.go:52: | 07:35:28 | receivers-tls | step-02   | APPLY     | DONE  | v1/Secret @ chainsaw-closing-wasp/opentelemetry-collector-cert
    l.go:52: | 07:35:28 | receivers-tls | step-02   | APPLY     | RUN   | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-closing-wasp/opentelemetry
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-grpc
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-grpc
    l.go:52: | 07:35:28 | monolithic-multitenancy-openshift | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-grpc
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:29 | receivers-tls | step-02   | CREATE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-closing-wasp/opentelemetry
    l.go:52: | 07:35:29 | receivers-tls | step-02   | APPLY     | DONE  | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-closing-wasp/opentelemetry
    l.go:52: | 07:35:29 | receivers-tls | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-closing-wasp/opentelemetry-collector
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-http
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-http
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-http
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:35:29 | monolithic-multitenancy-openshift | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-grpc
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-compactor
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-distributor
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-distributor
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-querier
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-querier
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-query-frontend
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/tempo-simplest-query-frontend
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-together-falcon/tempo-simplest-ingester
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-together-falcon/tempo-simplest-ingester
    l.go:52: | 07:35:29 | receivers-mtls | step-01   | TRY       | END   |
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | TRY       | BEGIN |
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | APPLY     | RUN   | v1/Secret @ chainsaw-together-falcon/opentelemetry-collector-cert
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | CREATE    | OK    | v1/Secret @ chainsaw-together-falcon/opentelemetry-collector-cert
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | APPLY     | DONE  | v1/Secret @ chainsaw-together-falcon/opentelemetry-collector-cert
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | APPLY     | RUN   | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-together-falcon/opentelemetry
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | CREATE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-together-falcon/opentelemetry
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | APPLY     | DONE  | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-together-falcon/opentelemetry
    l.go:52: | 07:35:29 | receivers-mtls | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-together-falcon/opentelemetry-collector
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:35:29 | monolithic-pv | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-crisp-alpaca/verify-traces
    l.go:52: | 07:35:29 | monolithic-pv | step-04   | TRY       | END   |
    l.go:52: | 07:35:29 | monolithic-pv | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:30 | monolithic-pv | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-crisp-alpaca/verify-traces
    l.go:52: | 07:35:30 | monolithic-pv | step-04   | CLEANUP   | END   |
    l.go:52: | 07:35:30 | monolithic-pv | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:30 | monolithic-pv | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-crisp-alpaca/generate-traces
    l.go:52: | 07:35:30 | monolithic-pv | step-03   | CLEANUP   | END   |
    l.go:52: | 07:35:30 | monolithic-pv | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:30 | monolithic-pv | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-crisp-alpaca/simplest
    l.go:52: | 07:35:30 | monolithic-pv | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:30 | monolithic-pv | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:30 | monolithic-pv | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-crisp-alpaca
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:30 | receivers-tls | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-closing-wasp/opentelemetry-collector
    l.go:52: | 07:35:30 | receivers-tls | step-02   | ASSERT    | RUN   | v1/Service @ chainsaw-closing-wasp/opentelemetry-collector
    l.go:52: | 07:35:30 | receivers-tls | step-02   | ASSERT    | DONE  | v1/Service @ chainsaw-closing-wasp/opentelemetry-collector
    l.go:52: | 07:35:30 | receivers-tls | step-02   | TRY       | END   |
    l.go:52: | 07:35:30 | receivers-tls | step-03   | TRY       | BEGIN |
    l.go:52: | 07:35:30 | receivers-tls | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-closing-wasp/generate-traces
    l.go:52: | 07:35:30 | receivers-tls | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-closing-wasp/generate-traces
    l.go:52: | 07:35:30 | receivers-tls | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-closing-wasp/generate-traces
    l.go:52: | 07:35:30 | receivers-tls | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-closing-wasp/generate-traces
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-capital-anteater/verify-traces
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-04   | TRY       | END   |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-capital-anteater/verify-traces
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-04   | CLEANUP   | END   |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-capital-anteater/generate-traces
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-03   | CLEANUP   | END   |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-capital-anteater/simplest
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-01   | DELETE    | OK    | v1/ConfigMap @ chainsaw-capital-anteater/storage-ca
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-capital-anteater/minio
    l.go:52: | 07:35:31 | monolithic-s3-tls | step-00   | DELETE    | OK    | v1/Service @ chainsaw-capital-anteater/minio
    l.go:52: | 07:35:32 | monolithic-s3-tls | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-capital-anteater/minio
    l.go:52: | 07:35:32 | monolithic-s3-tls | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-capital-anteater/minio-cert
    l.go:52: | 07:35:32 | monolithic-s3-tls | step-00   | CLEANUP   | END   |
    l.go:52: | 07:35:32 | monolithic-s3-tls | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:32 | monolithic-s3-tls | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-capital-anteater
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:32 | receivers-mtls | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-together-falcon/opentelemetry-collector
    l.go:52: | 07:35:32 | receivers-mtls | step-02   | ASSERT    | RUN   | v1/Service @ chainsaw-together-falcon/opentelemetry-collector
    l.go:52: | 07:35:32 | receivers-mtls | step-02   | ASSERT    | DONE  | v1/Service @ chainsaw-together-falcon/opentelemetry-collector
    l.go:52: | 07:35:32 | receivers-mtls | step-02   | TRY       | END   |
    l.go:52: | 07:35:32 | receivers-mtls | step-03   | TRY       | BEGIN |
    l.go:52: | 07:35:32 | receivers-mtls | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-together-falcon/generate-traces
    l.go:52: | 07:35:32 | receivers-mtls | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-together-falcon/generate-traces
    l.go:52: | 07:35:32 | receivers-mtls | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-together-falcon/generate-traces
    l.go:52: | 07:35:32 | receivers-mtls | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-together-falcon/generate-traces
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-grpc
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | TRY       | END   |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/verify-traces-jaegerui-grpc
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-04   | CLEANUP   | END   |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-http
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-monolithic-multitenancy/generate-traces-grpc
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-03   | CLEANUP   | END   |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-02   | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-monolithic-multitenancy/dev
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-02   | CLEANUP   | END   |
    l.go:52: | 07:35:33 | monolithic-multitenancy-openshift | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-monolithic-multitenancy/view
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-read-traces-dev-tenant
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ allow-read-traces-dev-tenant
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ allow-write-traces-dev-tenant
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ allow-write-traces-dev-tenant
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monolithic-multitenancy/monolithic-multitenancy-openshift
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:34 | monolithic-multitenancy-openshift | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-monolithic-multitenancy
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:34 | receivers-tls | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-closing-wasp/generate-traces
    l.go:52: | 07:35:34 | receivers-tls | step-03   | TRY       | END   |
    l.go:52: | 07:35:34 | receivers-tls | step-04   | TRY       | BEGIN |
    l.go:52: | 07:35:34 | receivers-tls | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-closing-wasp/verify-traces
    l.go:52: | 07:35:34 | receivers-tls | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-closing-wasp/verify-traces
    l.go:52: | 07:35:34 | receivers-tls | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-closing-wasp/verify-traces
    l.go:52: | 07:35:34 | receivers-tls | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-closing-wasp/verify-traces
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tempoextcfg/tempo-simplest-compactor
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-tempoextcfg/tempo-simplest-ingester
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-tempoextcfg/tempo-simplest-ingester
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-compactor
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-compactor
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-distributor
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-distributor
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-gossip-ring
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-gossip-ring
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-ingester
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-ingester
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-querier
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-querier
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-query-frontend
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-query-frontend
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/Service @ chainsaw-tempoextcfg/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | networking.k8s.io/v1/Ingress @ chainsaw-tempoextcfg/tempo-simplest-query-frontend
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | networking.k8s.io/v1/Ingress @ chainsaw-tempoextcfg/tempo-simplest-query-frontend
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-tempoextcfg/tempo-simplest
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-tempoextcfg/tempo-simplest
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | TRY       | END   |
    l.go:52: | 07:35:35 | tempostack-extraconfig | Check TempoStack status | TRY       | BEGIN |
    l.go:52: | 07:35:35 | tempostack-extraconfig | Check TempoStack status | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempo simplest -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' | grep True
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:35 | receivers-mtls | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-together-falcon/generate-traces
    l.go:52: | 07:35:35 | receivers-mtls | step-03   | TRY       | END   |
    l.go:52: | 07:35:35 | receivers-mtls | step-04   | TRY       | BEGIN |
    l.go:52: | 07:35:35 | receivers-mtls | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-together-falcon/verify-traces
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:35:35 | tempostack-extraconfig | Check TempoStack status | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:35:35 | tempostack-extraconfig | Check TempoStack status | SCRIPT    | DONE  |
    l.go:52: | 07:35:35 | tempostack-extraconfig | Check TempoStack status | TRY       | END   |
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | CLEANUP   | BEGIN |
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tempoextcfg/simplest
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:35 | receivers-mtls | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-together-falcon/verify-traces
    l.go:52: | 07:35:35 | receivers-mtls | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-together-falcon/verify-traces
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install TempoStack      | CLEANUP   | END   |
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install Minio storage   | CLEANUP   | BEGIN |
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:35 | receivers-mtls | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-together-falcon/verify-traces
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install Minio storage   | DELETE    | OK    | v1/Secret @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install Minio storage   | DELETE    | OK    | v1/Service @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install Minio storage   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-tempoextcfg/minio
    l.go:52: | 07:35:35 | tempostack-extraconfig | Install Minio storage   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tempoextcfg/minio
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-compactor
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-distributor
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-distributor
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-gateway
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-gateway
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-querier
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-querier
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-query-frontend
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-query-frontend
    l.go:52: | 07:35:36 | tempostack-resources | Create TempoStack with resources assigned globally       | TRY       | END   |
    l.go:52: | 07:35:36 | tempostack-resources | Check the status of TempoStack                           | TRY       | BEGIN |
    l.go:52: | 07:35:36 | tempostack-resources | Check the status of TempoStack                           | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempo tmrs -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}'
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | SCRIPT    | DONE  |
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | TRY       | END   |
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | TRY       | BEGIN |
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | PATCH     | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-quiet-moray/tempo-tmrs-ingester
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-quiet-moray/tempo-tmrs-ingester
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-compactor
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-compactor
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-distributor
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-distributor
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-gateway
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-gateway
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-querier
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-querier
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-query-frontend
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-quiet-moray/tempo-tmrs-query-frontend
    l.go:52: | 07:35:37 | tempostack-resources | Update TempoStack with per-component resource allocation | TRY       | END   |
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | TRY       | BEGIN |
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempo tmrs -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}'
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | SCRIPT    | LOG   |
        === STDOUT
        False
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | SCRIPT    | DONE  |
    l.go:52: | 07:35:37 | tempostack-resources | Check the status of TempoStack                           | TRY       | END   |
    l.go:52: | 07:35:37 | tempostack-resources | Create TempoStack with resources assigned globally       | CLEANUP   | BEGIN |
    l.go:52: | 07:35:37 | tempostack-resources | Create TempoStack with resources assigned globally       | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-quiet-moray/tmrs
    l.go:52: | 07:35:37 | tempostack-resources | Create TempoStack with resources assigned globally       | CLEANUP   | END   |
    l.go:52: | 07:35:37 | tempostack-resources | Install Minio                                            | CLEANUP   | BEGIN |
    l.go:52: | 07:35:37 | tempostack-resources | Install Minio                                            | DELETE    | OK    | v1/Secret @ chainsaw-quiet-moray/minio
    l.go:52: | 07:35:37 | tempostack-resources | Install Minio                                            | DELETE    | OK    | v1/Service @ chainsaw-quiet-moray/minio
    l.go:52: | 07:35:37 | tempostack-resources | Install Minio                                            | DELETE    | OK    | apps/v1/Deployment @ chainsaw-quiet-moray/minio
    l.go:52: | 07:35:37 | tempostack-resources | Install Minio                                            | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-quiet-moray/minio
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-smashing-grouper/tempo-global-compactor
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-smashing-grouper/tempo-global-ingester
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-smashing-grouper/tempo-global-ingester
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-compactor
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-compactor
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-distributor
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:35:38 | tempostack-extraconfig | Install Minio storage   | CLEANUP   | END   |
    l.go:52: | 07:35:38 | tempostack-extraconfig | @chainsaw               | CLEANUP   | BEGIN |
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-distributor
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-gossip-ring
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:35:38 | tempostack-extraconfig | @chainsaw               | DELETE    | OK    | v1/Namespace @ chainsaw-tempoextcfg
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-gossip-ring
    l.go:52: | 07:35:38 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-ingester
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-ingester
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-querier
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-querier
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-query-frontend
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-query-frontend
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | v1/Service @ chainsaw-smashing-grouper/tempo-global-query-frontend-discovery
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | v1/Service @ chainsaw-smashing-grouper/tempo-global-query-frontend-discovery
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | RUN   | networking.k8s.io/v1/Ingress @ chainsaw-smashing-grouper/tempo-global-query-frontend
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | ASSERT    | DONE  | networking.k8s.io/v1/Ingress @ chainsaw-smashing-grouper/tempo-global-query-frontend
    l.go:52: | 07:35:39 | tempostack-retention-global | step-01                                                  | TRY       | END   |
    l.go:52: | 07:35:39 | tempostack-retention-global | step-02                                                  | TRY       | BEGIN |
    l.go:52: | 07:35:39 | tempostack-retention-global | step-02                                                  | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempo global -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' | grep True
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:39 | monolithic-receivers-tls | step-04                             | ASSERT    | DONE  | batch/v1/Job @ chainsaw-brave-gator/verify-traces-http
    l.go:52: | 07:35:39 | monolithic-receivers-tls | step-04                             | ASSERT    | RUN   | batch/v1/Job @ chainsaw-brave-gator/verify-traces-grpc
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:39 | tempostack-retention-global | step-02                                                  | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:35:39 | tempostack-retention-global | step-02                                                  | SCRIPT    | DONE  |
    l.go:52: | 07:35:39 | tempostack-retention-global | step-02                                                  | TRY       | END   |
    l.go:52: | 07:35:39 | tempostack-retention-global | step-03                                                  | TRY       | BEGIN |
    l.go:52: | 07:35:39 | tempostack-retention-global | step-03                                                  | APPLY     | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/generate-traces
    l.go:52: | 07:35:39 | tempostack-retention-global | step-03                                                  | CREATE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/generate-traces
    l.go:52: | 07:35:39 | tempostack-retention-global | step-03                                                  | APPLY     | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/generate-traces
    l.go:52: | 07:35:39 | tempostack-retention-global | step-03                                                  | ASSERT    | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/generate-traces
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:39 | receivers-tls | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-closing-wasp/verify-traces
    l.go:52: | 07:35:39 | receivers-tls | step-04   | TRY       | END   |
    l.go:52: | 07:35:39 | receivers-tls | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:39 | receivers-tls | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-closing-wasp/verify-traces
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:35:39 | tempostack-resources | Install Minio                                            | CLEANUP   | END   |
    l.go:52: | 07:35:39 | tempostack-resources | @chainsaw                                                | CLEANUP   | BEGIN |
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:39 | receivers-tls | step-04   | CLEANUP   | END   |
    l.go:52: | 07:35:39 | receivers-tls | step-03   | CLEANUP   | BEGIN |
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:35:39 | tempostack-resources | @chainsaw                                                | DELETE    | OK    | v1/Namespace @ chainsaw-quiet-moray
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:39 | receivers-tls | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-closing-wasp/generate-traces
    l.go:52: | 07:35:39 | receivers-tls | step-03   | CLEANUP   | END   |
    l.go:52: | 07:35:39 | receivers-tls | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:39 | receivers-tls | step-02   | DELETE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-closing-wasp/opentelemetry
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-04                             | ASSERT    | DONE  | batch/v1/Job @ chainsaw-brave-gator/verify-traces-grpc
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-04                             | TRY       | END   |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-04                             | CLEANUP   | BEGIN |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-04                             | DELETE    | OK    | batch/v1/Job @ chainsaw-brave-gator/verify-traces-grpc
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-02   | DELETE    | OK    | v1/Secret @ chainsaw-closing-wasp/opentelemetry-collector-cert
    l.go:52: | 07:35:40 | receivers-tls | step-02   | CLEANUP   | END   |
    l.go:52: | 07:35:40 | receivers-tls | step-01   | CLEANUP   | BEGIN |
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-04                             | DELETE    | OK    | batch/v1/Job @ chainsaw-brave-gator/verify-traces-http
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-01   | DELETE    | OK    | v1/Secret @ chainsaw-closing-wasp/custom-cert
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-04                             | CLEANUP   | END   |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-03                             | CLEANUP   | BEGIN |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-03                             | DELETE    | OK    | batch/v1/Job @ chainsaw-brave-gator/generate-traces-http
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-01   | DELETE    | OK    | v1/ConfigMap @ chainsaw-closing-wasp/custom-ca
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-03                             | DELETE    | OK    | batch/v1/Job @ chainsaw-brave-gator/generate-traces-grpc
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-closing-wasp/simplest
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-03                             | CLEANUP   | END   |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-02                             | CLEANUP   | BEGIN |
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:40 | receivers-tls | step-00   | CLEANUP   | BEGIN |
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-02                             | DELETE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-brave-gator/opentelemetry
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-02                             | CLEANUP   | END   |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-01                             | CLEANUP   | BEGIN |
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-00   | DELETE    | OK    | v1/Service @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-01                             | DELETE    | OK    | v1/Secret @ chainsaw-brave-gator/custom-cert
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-01                             | DELETE    | OK    | v1/ConfigMap @ chainsaw-brave-gator/custom-ca
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:40 | receivers-tls | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-closing-wasp/minio
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-01                             | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-brave-gator/simplest
    l.go:52: | 07:35:40 | monolithic-receivers-tls | step-01                             | CLEANUP   | END   |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | @chainsaw                           | CLEANUP   | BEGIN |
    l.go:52: | 07:35:40 | monolithic-receivers-tls | @chainsaw                           | DELETE    | OK    | v1/Namespace @ chainsaw-brave-gator
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:35:41 | receivers-tls | step-00   | CLEANUP   | END   |
    l.go:52: | 07:35:41 | receivers-tls | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:41 | receivers-tls | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-closing-wasp
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:43 | tempostack-retention-global | step-03                                                  | ASSERT    | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/generate-traces
    l.go:52: | 07:35:43 | tempostack-retention-global | step-03                                                  | TRY       | END   |
    l.go:52: | 07:35:43 | tempostack-retention-global | step-04                                                  | TRY       | BEGIN |
    l.go:52: | 07:35:43 | tempostack-retention-global | step-04                                                  | APPLY     | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger
    l.go:52: | 07:35:43 | tempostack-retention-global | step-04                                                  | CREATE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger
    l.go:52: | 07:35:43 | tempostack-retention-global | step-04                                                  | APPLY     | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger
    l.go:52: | 07:35:43 | tempostack-retention-global | step-04                                                  | ASSERT    | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger
=== NAME  chainsaw/reconcile
    l.go:52: | 07:35:44 | reconcile | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/custom-ca
    l.go:52: | 07:35:44 | custom-ca | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-viable-doberman
    l.go:52: | 07:35:44 | custom-ca | step-00   | TRY       | BEGIN |
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-viable-doberman/minio-cert
    l.go:52: | 07:35:44 | custom-ca | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-viable-doberman/minio-cert
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-viable-doberman/minio-cert
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | CREATE    | OK    | v1/Service @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:44 | custom-ca | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:45 | custom-ca | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-viable-doberman/minio
    l.go:52: | 07:35:45 | custom-ca | step-00   | TRY       | END   |
    l.go:52: | 07:35:45 | custom-ca | step-01   | TRY       | BEGIN |
    l.go:52: | 07:35:45 | custom-ca | step-01   | APPLY     | RUN   | v1/ConfigMap @ chainsaw-viable-doberman/custom-ca
    l.go:52: | 07:35:45 | custom-ca | step-01   | CREATE    | OK    | v1/ConfigMap @ chainsaw-viable-doberman/custom-ca
    l.go:52: | 07:35:45 | custom-ca | step-01   | APPLY     | DONE  | v1/ConfigMap @ chainsaw-viable-doberman/custom-ca
    l.go:52: | 07:35:45 | custom-ca | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-viable-doberman/simplest
    l.go:52: | 07:35:45 | custom-ca | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-viable-doberman/simplest
    l.go:52: | 07:35:45 | custom-ca | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-viable-doberman/simplest
    l.go:52: | 07:35:45 | custom-ca | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-compactor
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:47 | tempostack-retention-global | step-04                                                  | ASSERT    | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger
    l.go:52: | 07:35:47 | tempostack-retention-global | step-04                                                  | TRY       | END   |
    l.go:52: | 07:35:47 | tempostack-retention-global | step-05                                                  | TRY       | BEGIN |
    l.go:52: | 07:35:47 | tempostack-retention-global | step-05                                                  | APPLY     | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana
    l.go:52: | 07:35:47 | tempostack-retention-global | step-05                                                  | CREATE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana
    l.go:52: | 07:35:47 | tempostack-retention-global | step-05                                                  | APPLY     | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana
    l.go:52: | 07:35:47 | tempostack-retention-global | step-05                                                  | ASSERT    | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana
=== NAME  chainsaw/monolithic-pv
    l.go:52: | 07:35:48 | monolithic-pv | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/multitenancy-rbac
    l.go:52: | 07:35:48 | multitenancy-rbac | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-rbac
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | TRY       | BEGIN |
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | RUN   | v1/Namespace @ chainsaw-rbac
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | PATCH     | OK    | v1/Namespace @ chainsaw-rbac
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | DONE  | v1/Namespace @ chainsaw-rbac
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | CREATE    | OK    | v1/Service @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-rbac/minio
    l.go:52: | 07:35:48 | multitenancy-rbac | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/minio
=== NAME  chainsaw/compatibility
    l.go:52: | 07:35:49 | compatibility | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-query-frontend
    l.go:52: | 07:35:49 | compatibility | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-distributor
    l.go:52: | 07:35:49 | compatibility | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-distributor
    l.go:52: | 07:35:49 | compatibility | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-querier
    l.go:52: | 07:35:49 | compatibility | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-querier
    l.go:52: | 07:35:49 | compatibility | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-compactor
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tst/tempo-tempo-st-compactor
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-tst/tempo-tempo-st-ingester
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-tst/tempo-tempo-st-ingester
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-compactor
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-compactor
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-distributor
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 07:35:50 | tempostack-retention-global | step-05                                                  | ASSERT    | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana
    l.go:52: | 07:35:50 | tempostack-retention-global | step-05                                                  | TRY       | END   |
    l.go:52: | 07:35:50 | tempostack-retention-global | Wait for the TempoStack global retention time period     | TRY       | BEGIN |
    l.go:52: | 07:35:50 | tempostack-retention-global | Wait for the TempoStack global retention time period     | SLEEP     | RUN   |
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-distributor
    l.go:52: | 07:35:50 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-gossip-ring
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-gossip-ring
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-ingester
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-together-falcon/verify-traces
    l.go:52: | 07:35:51 | receivers-mtls | step-04   | TRY       | END   |
    l.go:52: | 07:35:51 | receivers-mtls | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:51 | receivers-mtls | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-together-falcon/verify-traces
    l.go:52: | 07:35:51 | receivers-mtls | step-04   | CLEANUP   | END   |
    l.go:52: | 07:35:51 | receivers-mtls | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:51 | receivers-mtls | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-together-falcon/generate-traces
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-ingester
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-querier
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-03   | CLEANUP   | END   |
    l.go:52: | 07:35:51 | receivers-mtls | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:51 | receivers-mtls | step-02   | DELETE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-together-falcon/opentelemetry
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-querier
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-query-frontend
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-02   | DELETE    | OK    | v1/Secret @ chainsaw-together-falcon/opentelemetry-collector-cert
    l.go:52: | 07:35:51 | receivers-mtls | step-02   | CLEANUP   | END   |
    l.go:52: | 07:35:51 | receivers-mtls | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:35:51 | receivers-mtls | step-01   | DELETE    | OK    | v1/Secret @ chainsaw-together-falcon/custom-cert
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-query-frontend
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | v1/Service @ chainsaw-tst/tempo-tempo-st-query-frontend-discovery
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-01   | DELETE    | OK    | v1/ConfigMap @ chainsaw-together-falcon/custom-ca
    l.go:52: | 07:35:51 | receivers-mtls | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-together-falcon/simplest
    l.go:52: | 07:35:51 | receivers-mtls | step-01   | CLEANUP   | END   |
    l.go:52: | 07:35:51 | receivers-mtls | step-00   | CLEANUP   | BEGIN |
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | v1/Service @ chainsaw-tst/tempo-tempo-st-query-frontend-discovery
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-tst/tempo-tempo-st-query-frontend
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-tst/tempo-tempo-st-query-frontend
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Create TempoStack instance     | TRY       | END   |
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Generate traces                | TRY       | BEGIN |
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Generate traces                | APPLY     | RUN   | batch/v1/Job @ chainsaw-tst/generate-traces
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-00   | DELETE    | OK    | v1/Service @ chainsaw-together-falcon/minio
    l.go:52: | 07:35:51 | receivers-mtls | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-together-falcon/minio
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Generate traces                | CREATE    | OK    | batch/v1/Job @ chainsaw-tst/generate-traces
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Generate traces                | APPLY     | DONE  | batch/v1/Job @ chainsaw-tst/generate-traces
    l.go:52: | 07:35:51 | tempo-single-tenant-auth | Generate traces                | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tst/generate-traces
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:35:51 | receivers-mtls | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-together-falcon/minio
    l.go:52: | 07:35:52 | receivers-mtls | step-00   | CLEANUP   | END   |
    l.go:52: | 07:35:52 | receivers-mtls | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:35:52 | receivers-mtls | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-together-falcon
=== NAME  chainsaw/monolithic-memory
    l.go:52: | 07:35:53 | monolithic-memory | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/route
    l.go:52: | 07:35:53 | route | @chainsaw                                  | CREATE    | OK    | v1/Namespace @ chainsaw-route
    l.go:52: | 07:35:53 | route | Install Minio storage                      | TRY       | BEGIN |
    l.go:52: | 07:35:53 | route | Install Minio storage                      | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-route/minio
    l.go:52: | 07:35:53 | route | Install Minio storage                      | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-route/minio
    l.go:52: | 07:35:53 | route | Install Minio storage                      | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-route/minio
    l.go:52: | 07:35:53 | route | Install Minio storage                      | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-route/minio
    l.go:52: | 07:35:53 | route | Install Minio storage                      | CREATE    | OK    | apps/v1/Deployment @ chainsaw-route/minio
    l.go:52: | 07:35:53 | route | Install Minio storage                      | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-route/minio
    l.go:52: | 07:35:53 | route | Install Minio storage                      | APPLY     | RUN   | v1/Service @ chainsaw-route/minio
    l.go:52: | 07:35:54 | route | Install Minio storage                      | CREATE    | OK    | v1/Service @ chainsaw-route/minio
    l.go:52: | 07:35:54 | route | Install Minio storage                      | APPLY     | DONE  | v1/Service @ chainsaw-route/minio
    l.go:52: | 07:35:54 | route | Install Minio storage                      | APPLY     | RUN   | v1/Secret @ chainsaw-route/minio
    l.go:52: | 07:35:54 | route | Install Minio storage                      | CREATE    | OK    | v1/Secret @ chainsaw-route/minio
    l.go:52: | 07:35:54 | route | Install Minio storage                      | APPLY     | DONE  | v1/Secret @ chainsaw-route/minio
    l.go:52: | 07:35:54 | route | Install Minio storage                      | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-route/minio
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Generate traces                | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tst/generate-traces
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Generate traces                | TRY       | END   |
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | TRY       | BEGIN |
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | APPLY     | RUN   | batch/v1/Job @ chainsaw-tst/verify-traces-jaeger
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | CREATE    | OK    | batch/v1/Job @ chainsaw-tst/verify-traces-jaeger
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | APPLY     | DONE  | batch/v1/Job @ chainsaw-tst/verify-traces-jaeger
    l.go:52: | 07:35:55 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tst/verify-traces-jaeger
=== NAME  chainsaw/monolithic-single-tenant-auth
    l.go:52: | 07:35:58 | monolithic-single-tenant-auth | @chainsaw                        | CLEANUP   | END   |
=== CONT  chainsaw/multitenancy
    l.go:52: | 07:35:58 | multitenancy | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-multitenancy
    l.go:52: | 07:35:58 | multitenancy | step-00   | TRY       | BEGIN |
    l.go:52: | 07:35:58 | multitenancy | step-00   | APPLY     | RUN   | v1/Namespace @ chainsaw-multitenancy
    l.go:52: | 07:35:58 | multitenancy | step-00   | PATCH     | OK    | v1/Namespace @ chainsaw-multitenancy
    l.go:52: | 07:35:58 | multitenancy | step-00   | APPLY     | DONE  | v1/Namespace @ chainsaw-multitenancy
    l.go:52: | 07:35:58 | multitenancy | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:58 | multitenancy | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:58 | multitenancy | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:58 | multitenancy | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | CREATE    | OK    | v1/Service @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-multitenancy/minio
    l.go:52: | 07:35:59 | multitenancy | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/minio
=== NAME  chainsaw/monolithic-multitenancy-static
    l.go:52: | 07:36:03 | monolithic-multitenancy-static | @chainsaw       | CLEANUP   | END   |
=== CONT  chainsaw/tls-singletenant
    l.go:52: | 07:36:03 | tls-singletenant | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-tls-singletenant
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | TRY       | BEGIN |
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | RUN   | v1/Namespace @ chainsaw-tls-singletenant
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | PATCH     | OK    | v1/Namespace @ chainsaw-tls-singletenant
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | DONE  | v1/Namespace @ chainsaw-tls-singletenant
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | CREATE    | OK    | v1/Service @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:03 | tls-singletenant | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-singletenant/minio
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/minio
    l.go:52: | 07:36:04 | multitenancy-rbac | step-00   | TRY       | END   |
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | TRY       | BEGIN |
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-rbac/simplst
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-rbac/simplst
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-rbac/simplst
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader-rbac
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-rbac/view
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-rbac/view
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-rbac/view
    l.go:52: | 07:36:04 | multitenancy-rbac | step-01   | ASSERT    | RUN   | v1/Secret @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:05 | multitenancy-rbac | step-01   | ASSERT    | DONE  | v1/Secret @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:05 | multitenancy-rbac | step-01   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:05 | multitenancy-rbac | step-01   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:05 | multitenancy-rbac | step-01   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-rbac/tempo-simplst-gateway-cabundle
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-rbac/tempo-simplst-gateway-cabundle
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-simplst-gateway
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-simplst-gateway
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-simplst-gateway
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-simplst-gateway
    l.go:52: | 07:36:06 | multitenancy-rbac | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:07 | multitenancy-rbac | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:07 | multitenancy-rbac | step-01   | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:07 | multitenancy-rbac | step-01   | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:07 | multitenancy-rbac | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:08 | multitenancy-rbac | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-rbac/tempo-simplst-gateway
    l.go:52: | 07:36:08 | multitenancy-rbac | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-compactor
=== NAME  chainsaw/route
    l.go:52: | 07:36:08 | route | Install Minio storage                      | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-route/minio
    l.go:52: | 07:36:08 | route | Install Minio storage                      | TRY       | END   |
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | TRY       | BEGIN |
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | APPLY     | RUN   | v1/Secret @ chainsaw-route/minio-test
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | CREATE    | OK    | v1/Secret @ chainsaw-route/minio-test
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | APPLY     | DONE  | v1/Secret @ chainsaw-route/minio-test
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-route/simplest
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-route/simplest
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-route/simplest
    l.go:52: | 07:36:08 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-route/tempo-simplest-query-frontend
=== NAME  chainsaw/monolithic-s3-tls
    l.go:52: | 07:36:08 | monolithic-s3-tls | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-tls-mono-st
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | TRY       | BEGIN |
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | RUN   | v1/PersistentVolumeClaim @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | CREATE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | DONE  | v1/PersistentVolumeClaim @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | RUN   | apps/v1/Deployment @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | CREATE    | OK    | apps/v1/Deployment @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | DONE  | apps/v1/Deployment @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | RUN   | v1/Service @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | CREATE    | OK    | v1/Service @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | DONE  | v1/Service @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:08 | tls-singletenant-monolithic | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:09 | tls-singletenant-monolithic | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:09 | tls-singletenant-monolithic | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:09 | tls-singletenant-monolithic | step-00   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-mono-st/minio
=== NAME  chainsaw/monolithic-multitenancy-openshift
    l.go:52: | 07:36:09 | monolithic-multitenancy-openshift | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/monolithic-extraconfig
    l.go:52: | 07:36:09 | monolithic-extraconfig | @chainsaw                | CREATE    | OK    | v1/Namespace @ chainsaw-monoextcfg
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | TRY       | BEGIN |
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monoextcfg/simplest
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monoextcfg/simplest
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monoextcfg/simplest
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monoextcfg/simplest
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monoextcfg/simplest
    l.go:52: | 07:36:09 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-monoextcfg/tempo-simplest
=== NAME  chainsaw/route
    l.go:52: | 07:36:09 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-route/tempo-simplest-query-frontend
    l.go:52: | 07:36:09 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-route/tempo-simplest
    l.go:52: | 07:36:09 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-route/tempo-simplest
    l.go:52: | 07:36:09 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-route/tempo-simplest-compactor
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tst/verify-traces-jaeger
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | TRY       | END   |
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces from TraceQL     | TRY       | BEGIN |
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces from TraceQL     | APPLY     | RUN   | batch/v1/Job @ chainsaw-tst/verify-traces-traceql
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces from TraceQL     | CREATE    | OK    | batch/v1/Job @ chainsaw-tst/verify-traces-traceql
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces from TraceQL     | APPLY     | DONE  | batch/v1/Job @ chainsaw-tst/verify-traces-traceql
    l.go:52: | 07:36:10 | tempo-single-tenant-auth | Verify traces from TraceQL     | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tst/verify-traces-traceql
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:36:10 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-compactor
    l.go:52: | 07:36:10 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-distributor
    l.go:52: | 07:36:10 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-distributor
    l.go:52: | 07:36:10 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-querier
    l.go:52: | 07:36:11 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-querier
    l.go:52: | 07:36:11 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-query-frontend
    l.go:52: | 07:36:11 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-query-frontend
    l.go:52: | 07:36:11 | component-replicas | Create TempoStack instance                        | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-replicas/tempo-cmpreps-ingester
    l.go:52: | 07:36:11 | component-replicas | Create TempoStack instance                        | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-replicas/tempo-cmpreps-ingester
    l.go:52: | 07:36:11 | component-replicas | Create TempoStack instance                        | TRY       | END   |
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | TRY       | BEGIN |
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | PATCH     | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | v1/Secret @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | v1/Secret @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway-cabundle
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway-cabundle
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-cmpreps-gateway
    l.go:52: | 07:36:11 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-gateway
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces from TraceQL     | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tst/verify-traces-traceql
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces from TraceQL     | TRY       | END   |
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces from TraceQL     | CLEANUP   | BEGIN |
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces from TraceQL     | DELETE    | OK    | batch/v1/Job @ chainsaw-tst/verify-traces-traceql
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces from TraceQL     | CLEANUP   | END   |
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | CLEANUP   | BEGIN |
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | DELETE    | OK    | batch/v1/Job @ chainsaw-tst/verify-traces-jaeger
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Verify traces using Jaeger UI  | CLEANUP   | END   |
    l.go:52: | 07:36:13 | tempo-single-tenant-auth | Generate traces                | CLEANUP   | BEGIN |
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Generate traces                | DELETE    | OK    | batch/v1/Job @ chainsaw-tst/generate-traces
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Generate traces                | CLEANUP   | END   |
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Create TempoStack instance     | CLEANUP   | BEGIN |
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Create TempoStack instance     | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tst/tempo-st
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Create TempoStack instance     | CLEANUP   | END   |
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Install Minio for object store | CLEANUP   | BEGIN |
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Install Minio for object store | DELETE    | OK    | v1/Secret @ chainsaw-tst/minio
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Install Minio for object store | DELETE    | OK    | v1/Service @ chainsaw-tst/minio
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Install Minio for object store | DELETE    | OK    | apps/v1/Deployment @ chainsaw-tst/minio
    l.go:52: | 07:36:14 | tempo-single-tenant-auth | Install Minio for object store | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tst/minio
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:36:15 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:15 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:15 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:15 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | v1/Service @ chainsaw-replicas/tempo-cmpreps-gateway
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:36:15 | tempo-single-tenant-auth | Install Minio for object store | CLEANUP   | END   |
    l.go:52: | 07:36:15 | tempo-single-tenant-auth | @chainsaw                      | CLEANUP   | BEGIN |
    l.go:52: | 07:36:15 | tempo-single-tenant-auth | @chainsaw                      | DELETE    | OK    | v1/Namespace @ chainsaw-tst
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:36:15 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | v1/Service @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:36:15 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-compactor
=== NAME  chainsaw/receivers-tls
    l.go:52: | 07:36:15 | receivers-tls | @chainsaw | CLEANUP   | END   |
=== CONT  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-assured-gopher
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | TRY       | BEGIN |
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-assured-gopher/simplest
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-assured-gopher/simplest
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-assured-gopher/simplest
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | APPLY     | RUN   | v1/ConfigMap @ chainsaw-assured-gopher/custom-ca
=== NAME  chainsaw/tempostack-extraconfig
    l.go:52: | 07:36:15 | tempostack-extraconfig | @chainsaw               | CLEANUP   | END   |
=== CONT  chainsaw/generate
    l.go:52: | 07:36:15 | generate | @chainsaw | CREATE    | OK    | v1/Namespace @ chainsaw-maximum-kangaroo
    l.go:52: | 07:36:15 | generate | step-00   | TRY       | BEGIN |
    l.go:52: | 07:36:15 | generate | step-00   | APPLY     | RUN   | v1/Secret @ chainsaw-maximum-kangaroo/minio-test
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | CREATE    | OK    | v1/ConfigMap @ chainsaw-assured-gopher/custom-ca
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | APPLY     | DONE  | v1/ConfigMap @ chainsaw-assured-gopher/custom-ca
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | APPLY     | RUN   | v1/Secret @ chainsaw-assured-gopher/tempo-cert
=== NAME  chainsaw/generate
    l.go:52: | 07:36:15 | generate | step-00   | CREATE    | OK    | v1/Secret @ chainsaw-maximum-kangaroo/minio-test
    l.go:52: | 07:36:15 | generate | step-00   | APPLY     | DONE  | v1/Secret @ chainsaw-maximum-kangaroo/minio-test
    l.go:52: | 07:36:15 | generate | step-00   | TRY       | END   |
    l.go:52: | 07:36:15 | generate | step-01   | TRY       | BEGIN |
    l.go:52: | 07:36:15 | generate | step-01   | CMD       | RUN   |
        === COMMAND
        /bin/sh -c RELATED_IMAGE_TEMPO=docker.io/grafana/tempo:2.7.0 RELATED_IMAGE_TEMPO_QUERY=docker.io/grafana/tempo-query:2.7.0 RELATED_IMAGE_TEMPO_GATEWAY=quay.io/observatorium/api:main-2024-11-05-28e4c83 RELATED_IMAGE_TEMPO_GATEWAY_OPA=quay.io/observatorium/opa-openshift:main-2024-10-09-7237863 ../../../bin/manager generate --config config.yaml --cr cr.yaml --output generated.yaml
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | CREATE    | OK    | v1/Secret @ chainsaw-assured-gopher/tempo-cert
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | APPLY     | DONE  | v1/Secret @ chainsaw-assured-gopher/tempo-cert
    l.go:52: | 07:36:15 | monolithic-ingestion-mtls | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-assured-gopher/tempo-simplest
=== NAME  chainsaw/generate
    l.go:52: | 07:36:15 | generate | step-01   | CMD       | DONE  |
    l.go:52: | 07:36:15 | generate | step-01   | CMD       | RUN   |
        === COMMAND
        /usr/local/bin/kubectl apply -n chainsaw-maximum-kangaroo -f generated.yaml
=== NAME  chainsaw/tempostack-resources
    l.go:52: | 07:36:16 | tempostack-resources | @chainsaw                                                | CLEANUP   | END   |
=== NAME  chainsaw/generate
    l.go:52: | 07:36:16 | generate | step-01   | CMD       | LOG   |
        === STDOUT
        configmap/tempo-generated-tempo created
        serviceaccount/tempo-generated-tempo created
        deployment.apps/tempo-generated-tempo-distributor created
        service/tempo-generated-tempo-distributor created
        statefulset.apps/tempo-generated-tempo-ingester created
        service/tempo-generated-tempo-ingester created
        service/tempo-generated-tempo-gossip-ring created
        service/tempo-generated-tempo-query-frontend created
        service/tempo-generated-tempo-query-frontend-discovery created
        deployment.apps/tempo-generated-tempo-query-frontend created
        deployment.apps/tempo-generated-tempo-querier created
        service/tempo-generated-tempo-querier created
        deployment.apps/tempo-generated-tempo-compactor created
        service/tempo-generated-tempo-compactor created
    l.go:52: | 07:36:16 | generate | step-01   | CMD       | DONE  |
    l.go:52: | 07:36:16 | generate | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-maximum-kangaroo/tempo-generated-tempo-distributor
=== NAME  chainsaw/monolithic-receivers-tls
    l.go:52: | 07:36:18 | monolithic-receivers-tls | @chainsaw                           | CLEANUP   | END   |
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-00   | TRY       | END   |
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | TRY       | BEGIN |
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-tls-mono-st/mono
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-tls-mono-st/mono
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-tls-mono-st/mono
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-tls-mono-st/mono
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-tls-mono-st/mono
    l.go:52: | 07:36:18 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-tls-mono-st/tempo-mono
=== NAME  chainsaw/receivers-mtls
    l.go:52: | 07:36:25 | receivers-mtls | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/compatibility
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-shining-owl/tempo-simplest-compactor
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-shining-owl/tempo-simplest-ingester
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-shining-owl/tempo-simplest-ingester
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-compactor
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-compactor
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-distributor
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-distributor
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-gossip-ring
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-gossip-ring
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-ingester
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-ingester
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-querier
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-querier
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-query-frontend
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-query-frontend
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-shining-owl/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-shining-owl/tempo-simplest-query-frontend-discovery
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | RUN   | networking.k8s.io/v1/Ingress @ chainsaw-shining-owl/tempo-simplest-query-frontend
    l.go:52: | 07:36:28 | compatibility | step-01   | ASSERT    | DONE  | networking.k8s.io/v1/Ingress @ chainsaw-shining-owl/tempo-simplest-query-frontend
    l.go:52: | 07:36:28 | compatibility | step-01   | TRY       | END   |
    l.go:52: | 07:36:28 | compatibility | step-02   | TRY       | BEGIN |
    l.go:52: | 07:36:28 | compatibility | step-02   | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempo simplest -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' | grep True
    l.go:52: | 07:36:29 | compatibility | step-02   | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:36:29 | compatibility | step-02   | SCRIPT    | DONE  |
    l.go:52: | 07:36:29 | compatibility | step-02   | TRY       | END   |
    l.go:52: | 07:36:29 | compatibility | step-03   | TRY       | BEGIN |
    l.go:52: | 07:36:29 | compatibility | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-shining-owl/generate-traces
    l.go:52: | 07:36:29 | compatibility | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-shining-owl/generate-traces
    l.go:52: | 07:36:29 | compatibility | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-shining-owl/generate-traces
    l.go:52: | 07:36:29 | compatibility | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-shining-owl/generate-traces
=== NAME  chainsaw/multitenancy
    l.go:52: | 07:36:31 | multitenancy | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/minio
    l.go:52: | 07:36:31 | multitenancy | step-00   | TRY       | END   |
    l.go:52: | 07:36:31 | multitenancy | step-01   | TRY       | BEGIN |
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-multitenancy/simplest
    l.go:52: | 07:36:31 | multitenancy | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-multitenancy/simplest
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-multitenancy/simplest
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader
    l.go:52: | 07:36:31 | multitenancy | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader
    l.go:52: | 07:36:31 | multitenancy | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-multitenancy/view
    l.go:52: | 07:36:31 | multitenancy | step-01   | CREATE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-multitenancy/view
    l.go:52: | 07:36:31 | multitenancy | step-01   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-multitenancy/view
    l.go:52: | 07:36:31 | multitenancy | step-01   | ASSERT    | RUN   | v1/Secret @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | DONE  | v1/Secret @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-multitenancy/tempo-simplest-gateway-cabundle
=== NAME  chainsaw/compatibility
    l.go:52: | 07:36:32 | compatibility | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-shining-owl/generate-traces
    l.go:52: | 07:36:32 | compatibility | step-03   | TRY       | END   |
    l.go:52: | 07:36:32 | compatibility | step-04   | TRY       | BEGIN |
    l.go:52: | 07:36:32 | compatibility | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-shining-owl/verify-traces-jaeger
    l.go:52: | 07:36:32 | compatibility | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-shining-owl/verify-traces-jaeger
    l.go:52: | 07:36:32 | compatibility | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-shining-owl/verify-traces-jaeger
    l.go:52: | 07:36:32 | compatibility | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-shining-owl/verify-traces-jaeger
=== NAME  chainsaw/multitenancy
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-multitenancy/tempo-simplest-gateway-cabundle
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-simplest-gateway
    l.go:52: | 07:36:32 | multitenancy | step-01   | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-simplest-gateway
    l.go:52: | 07:36:33 | multitenancy | step-01   | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-simplest-gateway
    l.go:52: | 07:36:33 | multitenancy | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:34 | multitenancy | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:34 | multitenancy | step-01   | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:35 | multitenancy | step-01   | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:35 | multitenancy | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:35 | multitenancy | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-multitenancy/tempo-simplest-gateway
    l.go:52: | 07:36:35 | multitenancy | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-compactor
=== NAME  chainsaw/compatibility
    l.go:52: | 07:36:36 | compatibility | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-shining-owl/verify-traces-jaeger
    l.go:52: | 07:36:36 | compatibility | step-04   | TRY       | END   |
    l.go:52: | 07:36:36 | compatibility | step-05   | TRY       | BEGIN |
    l.go:52: | 07:36:36 | compatibility | step-05   | APPLY     | RUN   | batch/v1/Job @ chainsaw-shining-owl/verify-traces-grafana
    l.go:52: | 07:36:37 | compatibility | step-05   | CREATE    | OK    | batch/v1/Job @ chainsaw-shining-owl/verify-traces-grafana
    l.go:52: | 07:36:37 | compatibility | step-05   | APPLY     | DONE  | batch/v1/Job @ chainsaw-shining-owl/verify-traces-grafana
    l.go:52: | 07:36:37 | compatibility | step-05   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-shining-owl/verify-traces-grafana
    l.go:52: | 07:36:40 | compatibility | step-05   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-shining-owl/verify-traces-grafana
    l.go:52: | 07:36:40 | compatibility | step-05   | TRY       | END   |
    l.go:52: | 07:36:40 | compatibility | step-05   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:40 | compatibility | step-05   | DELETE    | OK    | batch/v1/Job @ chainsaw-shining-owl/verify-traces-grafana
    l.go:52: | 07:36:40 | compatibility | step-05   | CLEANUP   | END   |
    l.go:52: | 07:36:40 | compatibility | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:40 | compatibility | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-shining-owl/verify-traces-jaeger
    l.go:52: | 07:36:40 | compatibility | step-04   | CLEANUP   | END   |
    l.go:52: | 07:36:40 | compatibility | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:40 | compatibility | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-shining-owl/generate-traces
    l.go:52: | 07:36:40 | compatibility | step-03   | CLEANUP   | END   |
    l.go:52: | 07:36:40 | compatibility | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:40 | compatibility | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-shining-owl/simplest
    l.go:52: | 07:36:40 | compatibility | step-01   | CLEANUP   | END   |
    l.go:52: | 07:36:40 | compatibility | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:40 | compatibility | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-shining-owl/minio
    l.go:52: | 07:36:40 | compatibility | step-00   | DELETE    | OK    | v1/Service @ chainsaw-shining-owl/minio
    l.go:52: | 07:36:40 | compatibility | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-shining-owl/minio
    l.go:52: | 07:36:40 | compatibility | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-shining-owl/minio
    l.go:52: | 07:36:41 | compatibility | step-00   | CLEANUP   | END   |
    l.go:52: | 07:36:41 | compatibility | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:36:41 | compatibility | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-shining-owl
=== NAME  chainsaw/generate
    l.go:52: | 07:36:42 | generate | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-maximum-kangaroo/tempo-generated-tempo-distributor
    l.go:52: | 07:36:42 | generate | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-maximum-kangaroo/tempo-generated-tempo-distributor
    l.go:52: | 07:36:42 | generate | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-maximum-kangaroo/tempo-generated-tempo-distributor
    l.go:52: | 07:36:42 | generate | step-01   | TRY       | END   |
    l.go:52: | 07:36:42 | generate | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:42 | generate | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-maximum-kangaroo/minio-test
    l.go:52: | 07:36:42 | generate | step-00   | CLEANUP   | END   |
    l.go:52: | 07:36:42 | generate | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:36:42 | generate | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-maximum-kangaroo
=== NAME  chainsaw/tls-singletenant
    l.go:52: | 07:36:47 | tls-singletenant | step-00   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:36:47 | tls-singletenant | step-00   | TRY       | END   |
    l.go:52: | 07:36:47 | tls-singletenant | step-01   | TRY       | BEGIN |
    l.go:52: | 07:36:47 | tls-singletenant | step-01   | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tls-singletenant/simplest
    l.go:52: | 07:36:47 | tls-singletenant | step-01   | CREATE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tls-singletenant/simplest
    l.go:52: | 07:36:47 | tls-singletenant | step-01   | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tls-singletenant/simplest
    l.go:52: | 07:36:47 | tls-singletenant | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-singletenant/tempo-simplest-compactor
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-compactor
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-distributor
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-distributor
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-querier
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-querier
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-query-frontend
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-viable-doberman/tempo-simplest-query-frontend
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-viable-doberman/tempo-simplest-ingester
    l.go:52: | 07:36:51 | custom-ca | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-viable-doberman/tempo-simplest-ingester
    l.go:52: | 07:36:51 | custom-ca | step-01   | TRY       | END   |
    l.go:52: | 07:36:51 | custom-ca | step-02   | TRY       | BEGIN |
    l.go:52: | 07:36:51 | custom-ca | step-02   | APPLY     | RUN   | batch/v1/Job @ chainsaw-viable-doberman/generate-traces
    l.go:52: | 07:36:51 | custom-ca | step-02   | CREATE    | OK    | batch/v1/Job @ chainsaw-viable-doberman/generate-traces
    l.go:52: | 07:36:51 | custom-ca | step-02   | APPLY     | DONE  | batch/v1/Job @ chainsaw-viable-doberman/generate-traces
    l.go:52: | 07:36:51 | custom-ca | step-02   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-viable-doberman/generate-traces
=== NAME  chainsaw/tempo-single-tenant-auth
    l.go:52: | 07:36:52 | tempo-single-tenant-auth | @chainsaw                      | CLEANUP   | END   |
=== NAME  chainsaw/monolithic-extraconfig
    l.go:52: | 07:36:52 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-monoextcfg/tempo-simplest
    l.go:52: | 07:36:52 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | RUN   | v1/Service @ chainsaw-monoextcfg/tempo-simplest
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | DONE  | v1/Service @ chainsaw-monoextcfg/tempo-simplest
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | RUN   | v1/Service @ chainsaw-monoextcfg/tempo-simplest-jaegerui
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | DONE  | v1/Service @ chainsaw-monoextcfg/tempo-simplest-jaegerui
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-monoextcfg/tempo-simplest-config
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-monoextcfg/tempo-simplest-config
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | TRY       | END   |
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | CLEANUP   | BEGIN |
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-monoextcfg/simplest
    l.go:52: | 07:36:53 | monolithic-extraconfig | Install Tempo Monolithic | CLEANUP   | END   |
    l.go:52: | 07:36:53 | monolithic-extraconfig | @chainsaw                | CLEANUP   | BEGIN |
    l.go:52: | 07:36:53 | monolithic-extraconfig | @chainsaw                | DELETE    | OK    | v1/Namespace @ chainsaw-monoextcfg
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:36:55 | custom-ca | step-02   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-viable-doberman/generate-traces
    l.go:52: | 07:36:55 | custom-ca | step-02   | TRY       | END   |
    l.go:52: | 07:36:55 | custom-ca | step-03   | TRY       | BEGIN |
    l.go:52: | 07:36:55 | custom-ca | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-viable-doberman/verify-traces
    l.go:52: | 07:36:55 | custom-ca | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-viable-doberman/verify-traces
    l.go:52: | 07:36:55 | custom-ca | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-viable-doberman/verify-traces
    l.go:52: | 07:36:55 | custom-ca | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-viable-doberman/verify-traces
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-assured-gopher/tempo-simplest
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-01   | TRY       | END   |
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | TRY       | BEGIN |
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | APPLY     | RUN   | v1/Secret @ chainsaw-assured-gopher/opentelemetry-collector-cert
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:36:59 | custom-ca | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-viable-doberman/verify-traces
    l.go:52: | 07:36:59 | custom-ca | step-03   | TRY       | END   |
    l.go:52: | 07:36:59 | custom-ca | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:59 | custom-ca | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-viable-doberman/verify-traces
    l.go:52: | 07:36:59 | custom-ca | step-03   | CLEANUP   | END   |
    l.go:52: | 07:36:59 | custom-ca | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:59 | custom-ca | step-02   | DELETE    | OK    | batch/v1/Job @ chainsaw-viable-doberman/generate-traces
    l.go:52: | 07:36:59 | custom-ca | step-02   | CLEANUP   | END   |
    l.go:52: | 07:36:59 | custom-ca | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:59 | custom-ca | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-viable-doberman/simplest
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | CREATE    | OK    | v1/Secret @ chainsaw-assured-gopher/opentelemetry-collector-cert
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | APPLY     | DONE  | v1/Secret @ chainsaw-assured-gopher/opentelemetry-collector-cert
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:36:59 | custom-ca | step-01   | DELETE    | OK    | v1/ConfigMap @ chainsaw-viable-doberman/custom-ca
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | APPLY     | RUN   | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-assured-gopher/opentelemetry
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:36:59 | custom-ca | step-01   | CLEANUP   | END   |
    l.go:52: | 07:36:59 | custom-ca | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:36:59 | custom-ca | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-viable-doberman/minio
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | CREATE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-assured-gopher/opentelemetry
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | APPLY     | DONE  | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-assured-gopher/opentelemetry
    l.go:52: | 07:36:59 | monolithic-ingestion-mtls | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-assured-gopher/opentelemetry-collector
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:36:59 | custom-ca | step-00   | DELETE    | OK    | v1/Service @ chainsaw-viable-doberman/minio
    l.go:52: | 07:36:59 | custom-ca | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-viable-doberman/minio
    l.go:52: | 07:36:59 | custom-ca | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-viable-doberman/minio-cert
    l.go:52: | 07:36:59 | custom-ca | step-00   | CLEANUP   | END   |
    l.go:52: | 07:36:59 | custom-ca | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:36:59 | custom-ca | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-viable-doberman
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-assured-gopher/opentelemetry-collector
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-02   | ASSERT    | RUN   | v1/Service @ chainsaw-assured-gopher/opentelemetry-collector
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-02   | ASSERT    | DONE  | v1/Service @ chainsaw-assured-gopher/opentelemetry-collector
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-02   | TRY       | END   |
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-03   | TRY       | BEGIN |
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-assured-gopher/generate-traces
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-assured-gopher/generate-traces
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-assured-gopher/generate-traces
    l.go:52: | 07:37:01 | monolithic-ingestion-mtls | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-assured-gopher/generate-traces
=== NAME  chainsaw/monolithic-extraconfig
    l.go:52: | 07:37:01 | monolithic-extraconfig | @chainsaw                | CLEANUP   | END   |
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-tls-mono-st/tempo-mono
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | v1/Pod @ chainsaw-tls-mono-st/tempo-mono-0
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | v1/Pod @ chainsaw-tls-mono-st/tempo-mono-0
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-tls-mono-st/tempo-mono
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-tls-mono-st/tempo-mono
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | v1/Service @ chainsaw-tls-mono-st/tempo-mono-jaegerui
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | v1/Service @ chainsaw-tls-mono-st/tempo-mono-jaegerui
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-tls-mono-st/tempo-mono-jaegerui
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-tls-mono-st/tempo-mono-jaegerui
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-tls-mono-st/tempo-mono-config
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-tls-mono-st/tempo-mono-config
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-01   | TRY       | END   |
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-02   | TRY       | BEGIN |
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-02   | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-mono-st/dev
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-02   | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-mono-st/dev
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-02   | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-mono-st/dev
    l.go:52: | 07:37:02 | tls-singletenant-monolithic | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-mono-st/dev-collector
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-mono-st/dev-collector
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-02   | TRY       | END   |
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | TRY       | BEGIN |
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-grpc
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-grpc
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-grpc
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-http
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-http
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-http
    l.go:52: | 07:37:04 | tls-singletenant-monolithic | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-grpc
=== NAME  chainsaw/generate
    l.go:52: | 07:37:04 | generate | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-assured-gopher/generate-traces
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-03   | TRY       | END   |
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-04   | TRY       | BEGIN |
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-assured-gopher/verify-traces
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-assured-gopher/verify-traces
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-assured-gopher/verify-traces
    l.go:52: | 07:37:05 | monolithic-ingestion-mtls | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-assured-gopher/verify-traces
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-grpc
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-http
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-http
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-03   | TRY       | END   |
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | TRY       | BEGIN |
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-grpc
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-grpc
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-grpc
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-http
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-http
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-http
    l.go:52: | 07:37:07 | tls-singletenant-monolithic | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-grpc
=== NAME  chainsaw/route
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-route/tempo-simplest-compactor
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-route/tempo-simplest-distributor
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-route/tempo-simplest-distributor
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-route/tempo-simplest-querier
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-route/tempo-simplest-querier
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-route/tempo-simplest-query-frontend
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-route/tempo-simplest-query-frontend
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-route/tempo-simplest-ingester
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-route/tempo-simplest-ingester
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | TRY       | END   |
    l.go:52: | 07:37:13 | route | Check the status of TempoStack             | TRY       | BEGIN |
    l.go:52: | 07:37:13 | route | Check the status of TempoStack             | CMD       | RUN   |
        === COMMAND
        /usr/bin/sh -c kubectl get --namespace $NAMESPACE tempo simplest -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' | grep True
    l.go:52: | 07:37:13 | route | Check the status of TempoStack             | SCRIPT    | LOG   |
        === STDOUT
        True
    l.go:52: | 07:37:13 | route | Check the status of TempoStack             | SCRIPT    | DONE  |
    l.go:52: | 07:37:13 | route | Check the status of TempoStack             | TRY       | END   |
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | CLEANUP   | BEGIN |
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-route/simplest
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | DELETE    | OK    | v1/Secret @ chainsaw-route/minio-test
    l.go:52: | 07:37:13 | route | Install TempoStack with ingress type route | CLEANUP   | END   |
    l.go:52: | 07:37:13 | route | Install Minio storage                      | CLEANUP   | BEGIN |
    l.go:52: | 07:37:13 | route | Install Minio storage                      | DELETE    | OK    | v1/Secret @ chainsaw-route/minio
    l.go:52: | 07:37:13 | route | Install Minio storage                      | DELETE    | OK    | v1/Service @ chainsaw-route/minio
    l.go:52: | 07:37:13 | route | Install Minio storage                      | DELETE    | OK    | apps/v1/Deployment @ chainsaw-route/minio
    l.go:52: | 07:37:13 | route | Install Minio storage                      | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-route/minio
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-compactor
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-distributor
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-distributor
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-querier
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-querier
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-query-frontend
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-query-frontend
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-replicas/tempo-cmpreps-ingester
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-replicas/tempo-cmpreps-ingester
    l.go:52: | 07:37:14 | component-replicas | Scale TempoStack components replicas to 2         | TRY       | END   |
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | TRY       | BEGIN |
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-replicas/dev
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-replicas/dev
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-replicas/dev
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-cmprep
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-cmprep
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-cmprep
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-cmprep
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-cmprep
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-cmprep
    l.go:52: | 07:37:14 | component-replicas | Install OTEL collector                            | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/dev-collector
=== NAME  chainsaw/route
    l.go:52: | 07:37:14 | route | Install Minio storage                      | CLEANUP   | END   |
    l.go:52: | 07:37:14 | route | @chainsaw                                  | CLEANUP   | BEGIN |
    l.go:52: | 07:37:14 | route | @chainsaw                                  | DELETE    | OK    | v1/Namespace @ chainsaw-route
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:37:15 | component-replicas | Install OTEL collector                            | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/dev-collector
    l.go:52: | 07:37:15 | component-replicas | Install OTEL collector                            | TRY       | END   |
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | TRY       | BEGIN |
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | APPLY     | RUN   | batch/v1/Job @ chainsaw-replicas/generate-traces-grpc
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | CREATE    | OK    | batch/v1/Job @ chainsaw-replicas/generate-traces-grpc
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | APPLY     | DONE  | batch/v1/Job @ chainsaw-replicas/generate-traces-grpc
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | APPLY     | RUN   | batch/v1/Job @ chainsaw-replicas/generate-traces-http
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | CREATE    | OK    | batch/v1/Job @ chainsaw-replicas/generate-traces-http
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | APPLY     | DONE  | batch/v1/Job @ chainsaw-replicas/generate-traces-http
    l.go:52: | 07:37:15 | component-replicas | Generate traces                                   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-replicas/generate-traces-grpc
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-compactor
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-distributor
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-distributor
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-querier
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-querier
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-query-frontend
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/tempo-simplst-query-frontend
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-rbac/tempo-simplst-ingester
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-rbac/tempo-simplst-ingester
    l.go:52: | 07:37:16 | multitenancy-rbac | step-01   | TRY       | END   |
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | TRY       | BEGIN |
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-rbac/dev
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-rbac/dev
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-rbac/dev
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-rbac
    l.go:52: | 07:37:16 | multitenancy-rbac | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-rbac/dev-collector
    l.go:52: | 07:37:17 | multitenancy-rbac | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-rbac/dev-collector
    l.go:52: | 07:37:17 | multitenancy-rbac | step-02   | TRY       | END   |
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | TRY       | BEGIN |
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-rbac/generate-traces-grpc
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-rbac/generate-traces-grpc
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-rbac/generate-traces-grpc
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-rbac/generate-traces-http
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-rbac/generate-traces-http
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-rbac/generate-traces-http
    l.go:52: | 07:37:17 | multitenancy-rbac | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-rbac/generate-traces-grpc
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-assured-gopher/verify-traces
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-04   | TRY       | END   |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-assured-gopher/verify-traces
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-04   | CLEANUP   | END   |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-assured-gopher/generate-traces
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-03   | CLEANUP   | END   |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-02   | DELETE    | OK    | opentelemetry.io/v1beta1/OpenTelemetryCollector @ chainsaw-assured-gopher/opentelemetry
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-02   | DELETE    | OK    | v1/Secret @ chainsaw-assured-gopher/opentelemetry-collector-cert
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-02   | CLEANUP   | END   |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-01   | DELETE    | OK    | v1/Secret @ chainsaw-assured-gopher/tempo-cert
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-01   | DELETE    | OK    | v1/ConfigMap @ chainsaw-assured-gopher/custom-ca
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-assured-gopher/simplest
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | step-01   | CLEANUP   | END   |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:37:19 | monolithic-ingestion-mtls | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-assured-gopher
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:37:19 | component-replicas | Generate traces                                   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-replicas/generate-traces-grpc
    l.go:52: | 07:37:19 | component-replicas | Generate traces                                   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-replicas/generate-traces-http
    l.go:52: | 07:37:19 | component-replicas | Generate traces                                   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-replicas/generate-traces-http
    l.go:52: | 07:37:19 | component-replicas | Generate traces                                   | TRY       | END   |
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | TRY       | BEGIN |
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-grpc
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | CREATE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-grpc
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-grpc
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-grpc
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | CREATE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-grpc
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-grpc
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-http
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | CREATE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-http
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-http
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-http
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | CREATE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-http
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | APPLY     | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-http
    l.go:52: | 07:37:19 | component-replicas | Verify traces                                     | ASSERT    | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-grpc
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-grpc
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-http
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-http
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | TRY       | END   |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-http
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/verify-traces-grpc
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-04   | CLEANUP   | END   |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-http
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-mono-st/generate-traces-grpc
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-03   | CLEANUP   | END   |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-02   | CLEANUP   | BEGIN |
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:37:21 | multitenancy-rbac | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-rbac/generate-traces-grpc
    l.go:52: | 07:37:21 | multitenancy-rbac | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-rbac/generate-traces-http
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-02   | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-mono-st/dev
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:37:21 | multitenancy-rbac | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-rbac/generate-traces-http
    l.go:52: | 07:37:21 | multitenancy-rbac | step-03   | TRY       | END   |
    l.go:52: | 07:37:21 | multitenancy-rbac | step-04   | TRY       | BEGIN |
    l.go:52: | 07:37:21 | multitenancy-rbac | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-grpc
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-02   | CLEANUP   | END   |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoMonolithic @ chainsaw-tls-mono-st/mono
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-01   | CLEANUP   | END   |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:21 | tls-singletenant-monolithic | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-tls-mono-st/minio
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:37:21 | multitenancy-rbac | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-grpc
    l.go:52: | 07:37:21 | multitenancy-rbac | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-grpc
    l.go:52: | 07:37:21 | multitenancy-rbac | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-http
    l.go:52: | 07:37:22 | multitenancy-rbac | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-http
    l.go:52: | 07:37:22 | multitenancy-rbac | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-http
    l.go:52: | 07:37:22 | multitenancy-rbac | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-grpc
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:22 | tls-singletenant-monolithic | step-00   | DELETE    | OK    | v1/Service @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:37:22 | tls-singletenant-monolithic | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:37:22 | tls-singletenant-monolithic | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tls-mono-st/minio
    l.go:52: | 07:37:22 | tls-singletenant-monolithic | step-00   | CLEANUP   | END   |
    l.go:52: | 07:37:22 | tls-singletenant-monolithic | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:37:22 | tls-singletenant-monolithic | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-tls-mono-st
=== NAME  chainsaw/compatibility
    l.go:52: | 07:37:29 | compatibility | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/tls-singletenant-monolithic
    l.go:52: | 07:37:30 | tls-singletenant-monolithic | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/custom-ca
    l.go:52: | 07:37:33 | custom-ca | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-grpc
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-grpc
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-grpc
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-http
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-http
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | RUN   | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-http
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | ASSERT    | DONE  | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-http
    l.go:52: | 07:37:33 | component-replicas | Verify traces                                     | TRY       | END   |
    l.go:52: | 07:37:33 | component-replicas | Scale down the TempoStack component replicas to 1 | TRY       | BEGIN |
    l.go:52: | 07:37:33 | component-replicas | Scale down the TempoStack component replicas to 1 | APPLY     | RUN   | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | PATCH     | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | APPLY     | DONE  | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | v1/Secret @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | v1/Secret @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway-cabundle
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-replicas/tempo-cmpreps-gateway-cabundle
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | v1/ServiceAccount @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | v1/ServiceAccount @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | v1/Service @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | v1/Service @ chainsaw-replicas/tempo-cmpreps-gateway
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-compactor
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-compactor
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-distributor
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-distributor
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-querier
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-querier
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-query-frontend
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-replicas/tempo-cmpreps-query-frontend
    l.go:52: | 07:37:34 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-replicas/tempo-cmpreps-ingester
=== NAME  chainsaw/multitenancy
    l.go:52: | 07:37:34 | multitenancy | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-compactor
    l.go:52: | 07:37:34 | multitenancy | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-distributor
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-distributor
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-querier
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-querier
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-query-frontend
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/tempo-simplest-query-frontend
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | RUN   | apps/v1/StatefulSet @ chainsaw-multitenancy/tempo-simplest-ingester
    l.go:52: | 07:37:35 | multitenancy | step-01   | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-multitenancy/tempo-simplest-ingester
    l.go:52: | 07:37:35 | multitenancy | step-01   | TRY       | END   |
    l.go:52: | 07:37:35 | multitenancy | step-02   | TRY       | BEGIN |
    l.go:52: | 07:37:35 | multitenancy | step-02   | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-multitenancy/dev
    l.go:52: | 07:37:35 | multitenancy | step-02   | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-multitenancy/dev
    l.go:52: | 07:37:35 | multitenancy | step-02   | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-multitenancy/dev
    l.go:52: | 07:37:35 | multitenancy | step-02   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write
    l.go:52: | 07:37:35 | multitenancy | step-02   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write
    l.go:52: | 07:37:35 | multitenancy | step-02   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write
    l.go:52: | 07:37:35 | multitenancy | step-02   | APPLY     | RUN   | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces
    l.go:52: | 07:37:35 | multitenancy | step-02   | CREATE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces
    l.go:52: | 07:37:35 | multitenancy | step-02   | APPLY     | DONE  | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces
    l.go:52: | 07:37:35 | multitenancy | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-multitenancy/dev-collector
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-grpc
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-http
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-http
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | TRY       | END   |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-http
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-rbac/verify-traces-traceql-grpc
    l.go:52: | 07:37:35 | multitenancy-rbac | step-04   | CLEANUP   | END   |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-rbac/generate-traces-http
    l.go:52: | 07:37:35 | multitenancy-rbac | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-rbac/generate-traces-grpc
    l.go:52: | 07:37:35 | multitenancy-rbac | step-03   | CLEANUP   | END   |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-02   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-rbac
    l.go:52: | 07:37:35 | multitenancy-rbac | step-02   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-rbac
    l.go:52: | 07:37:35 | multitenancy-rbac | step-02   | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-rbac/dev
    l.go:52: | 07:37:35 | multitenancy-rbac | step-02   | CLEANUP   | END   |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:35 | multitenancy-rbac | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-rbac/view
    l.go:52: | 07:37:35 | multitenancy-rbac | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader-rbac
    l.go:52: | 07:37:35 | multitenancy-rbac | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader-rbac
    l.go:52: | 07:37:36 | multitenancy-rbac | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-rbac/simplst
    l.go:52: | 07:37:36 | multitenancy-rbac | step-01   | CLEANUP   | END   |
    l.go:52: | 07:37:36 | multitenancy-rbac | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:36 | multitenancy-rbac | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-rbac/minio
    l.go:52: | 07:37:36 | multitenancy-rbac | step-00   | DELETE    | OK    | v1/Service @ chainsaw-rbac/minio
    l.go:52: | 07:37:36 | multitenancy-rbac | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-rbac/minio
    l.go:52: | 07:37:36 | multitenancy-rbac | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-rbac/minio
=== NAME  chainsaw/multitenancy
    l.go:52: | 07:37:37 | multitenancy | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-multitenancy/dev-collector
    l.go:52: | 07:37:37 | multitenancy | step-02   | TRY       | END   |
    l.go:52: | 07:37:37 | multitenancy | step-03   | TRY       | BEGIN |
    l.go:52: | 07:37:37 | multitenancy | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-multitenancy/generate-traces-grpc
    l.go:52: | 07:37:37 | multitenancy | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-multitenancy/generate-traces-grpc
    l.go:52: | 07:37:37 | multitenancy | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-multitenancy/generate-traces-grpc
    l.go:52: | 07:37:37 | multitenancy | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-multitenancy/generate-traces-http
    l.go:52: | 07:37:37 | multitenancy | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-multitenancy/generate-traces-http
    l.go:52: | 07:37:37 | multitenancy | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-multitenancy/generate-traces-http
    l.go:52: | 07:37:37 | multitenancy | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-multitenancy/generate-traces-grpc
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:37:37 | multitenancy-rbac | step-00   | CLEANUP   | END   |
    l.go:52: | 07:37:37 | multitenancy-rbac | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:37:37 | multitenancy-rbac | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-rbac
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:37:38 | component-replicas | Scale down the TempoStack component replicas to 1 | ASSERT    | DONE  | apps/v1/StatefulSet @ chainsaw-replicas/tempo-cmpreps-ingester
    l.go:52: | 07:37:38 | component-replicas | Scale down the TempoStack component replicas to 1 | TRY       | END   |
    l.go:52: | 07:37:38 | component-replicas | Verify traces                                     | CLEANUP   | BEGIN |
    l.go:52: | 07:37:38 | component-replicas | Verify traces                                     | DELETE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-http
    l.go:52: | 07:37:38 | component-replicas | Verify traces                                     | DELETE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-http
    l.go:52: | 07:37:38 | component-replicas | Verify traces                                     | DELETE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-traceql-grpc
    l.go:52: | 07:37:38 | component-replicas | Verify traces                                     | DELETE    | OK    | batch/v1/Job @ chainsaw-replicas/verify-traces-grpc
    l.go:52: | 07:37:38 | component-replicas | Verify traces                                     | CLEANUP   | END   |
    l.go:52: | 07:37:38 | component-replicas | Generate traces                                   | CLEANUP   | BEGIN |
    l.go:52: | 07:37:38 | component-replicas | Generate traces                                   | DELETE    | OK    | batch/v1/Job @ chainsaw-replicas/generate-traces-http
    l.go:52: | 07:37:38 | component-replicas | Generate traces                                   | DELETE    | OK    | batch/v1/Job @ chainsaw-replicas/generate-traces-grpc
    l.go:52: | 07:37:38 | component-replicas | Generate traces                                   | CLEANUP   | END   |
    l.go:52: | 07:37:38 | component-replicas | Install OTEL collector                            | CLEANUP   | BEGIN |
    l.go:52: | 07:37:38 | component-replicas | Install OTEL collector                            | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-cmprep
    l.go:52: | 07:37:38 | component-replicas | Install OTEL collector                            | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write-cmprep
    l.go:52: | 07:37:38 | component-replicas | Install OTEL collector                            | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-replicas/dev
    l.go:52: | 07:37:38 | component-replicas | Install OTEL collector                            | CLEANUP   | END   |
    l.go:52: | 07:37:38 | component-replicas | Create TempoStack instance                        | CLEANUP   | BEGIN |
    l.go:52: | 07:37:38 | component-replicas | Create TempoStack instance                        | DELETE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-replicas/view
    l.go:52: | 07:37:38 | component-replicas | Create TempoStack instance                        | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ replicas-traces-reader
    l.go:52: | 07:37:38 | component-replicas | Create TempoStack instance                        | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ replicas-traces-reader
    l.go:52: | 07:37:38 | component-replicas | Create TempoStack instance                        | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-replicas/cmpreps
    l.go:52: | 07:37:38 | component-replicas | Create TempoStack instance                        | CLEANUP   | END   |
    l.go:52: | 07:37:38 | component-replicas | Create Minio storage instance                     | CLEANUP   | BEGIN |
    l.go:52: | 07:37:38 | component-replicas | Create Minio storage instance                     | DELETE    | OK    | v1/Secret @ chainsaw-replicas/minio
    l.go:52: | 07:37:38 | component-replicas | Create Minio storage instance                     | DELETE    | OK    | v1/Service @ chainsaw-replicas/minio
    l.go:52: | 07:37:38 | component-replicas | Create Minio storage instance                     | DELETE    | OK    | apps/v1/Deployment @ chainsaw-replicas/minio
    l.go:52: | 07:37:38 | component-replicas | Create Minio storage instance                     | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-replicas/minio
    l.go:52: | 07:37:40 | component-replicas | Create Minio storage instance                     | CLEANUP   | END   |
    l.go:52: | 07:37:40 | component-replicas | @chainsaw                                         | CLEANUP   | BEGIN |
    l.go:52: | 07:37:40 | component-replicas | @chainsaw                                         | DELETE    | OK    | v1/Namespace @ chainsaw-replicas
=== NAME  chainsaw/route
    l.go:52: | 07:37:40 | route | @chainsaw                                  | CLEANUP   | END   |
=== NAME  chainsaw/multitenancy
    l.go:52: | 07:37:41 | multitenancy | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-multitenancy/generate-traces-grpc
    l.go:52: | 07:37:41 | multitenancy | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-multitenancy/generate-traces-http
    l.go:52: | 07:37:41 | multitenancy | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-multitenancy/generate-traces-http
    l.go:52: | 07:37:41 | multitenancy | step-03   | TRY       | END   |
    l.go:52: | 07:37:41 | multitenancy | step-04   | TRY       | BEGIN |
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-multitenancy/verify-traces-grpc
    l.go:52: | 07:37:41 | multitenancy | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-grpc
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-multitenancy/verify-traces-grpc
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:37:41 | multitenancy | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-multitenancy/verify-traces-http
    l.go:52: | 07:37:41 | multitenancy | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-http
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-multitenancy/verify-traces-http
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:37:41 | multitenancy | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:37:41 | multitenancy | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:37:41 | multitenancy | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-multitenancy/verify-traces-grpc
=== NAME  chainsaw/tls-singletenant
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-singletenant/tempo-simplest-compactor
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-singletenant/tempo-simplest-distributor
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-singletenant/tempo-simplest-distributor
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-singletenant/tempo-simplest-query-frontend
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-singletenant/tempo-simplest-query-frontend
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | RUN   | route.openshift.io/v1/Route @ chainsaw-tls-singletenant/tempo-simplest-query-frontend
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | DONE  | route.openshift.io/v1/Route @ chainsaw-tls-singletenant/tempo-simplest-query-frontend
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | RUN   | v1/ConfigMap @ chainsaw-tls-singletenant/tempo-simplest
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | ASSERT    | DONE  | v1/ConfigMap @ chainsaw-tls-singletenant/tempo-simplest
    l.go:52: | 07:37:54 | tls-singletenant | step-01   | TRY       | END   |
    l.go:52: | 07:37:54 | tls-singletenant | step-02   | TRY       | BEGIN |
    l.go:52: | 07:37:54 | tls-singletenant | step-02   | APPLY     | RUN   | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-singletenant/dev
    l.go:52: | 07:37:54 | tls-singletenant | step-02   | CREATE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-singletenant/dev
    l.go:52: | 07:37:54 | tls-singletenant | step-02   | APPLY     | DONE  | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-singletenant/dev
    l.go:52: | 07:37:54 | tls-singletenant | step-02   | ASSERT    | RUN   | apps/v1/Deployment @ chainsaw-tls-singletenant/dev-collector
=== NAME  chainsaw/monolithic-ingestion-mtls
    l.go:52: | 07:37:56 | monolithic-ingestion-mtls | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/tls-singletenant
    l.go:52: | 07:37:56 | tls-singletenant | step-02   | ASSERT    | DONE  | apps/v1/Deployment @ chainsaw-tls-singletenant/dev-collector
    l.go:52: | 07:37:56 | tls-singletenant | step-02   | TRY       | END   |
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | TRY       | BEGIN |
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-grpc
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-grpc
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-grpc
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-http
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-http
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-http
    l.go:52: | 07:37:56 | tls-singletenant | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-grpc
    l.go:52: | 07:37:59 | tls-singletenant | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-grpc
    l.go:52: | 07:37:59 | tls-singletenant | step-03   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-http
    l.go:52: | 07:38:00 | tls-singletenant | step-03   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-http
    l.go:52: | 07:38:00 | tls-singletenant | step-03   | TRY       | END   |
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | TRY       | BEGIN |
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-grpc
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-grpc
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-grpc
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | APPLY     | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-http
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | CREATE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-http
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | APPLY     | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-http
    l.go:52: | 07:38:00 | tls-singletenant | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-grpc
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-grpc
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | ASSERT    | RUN   | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-http
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | ASSERT    | DONE  | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-http
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | TRY       | END   |
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-http
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/verify-traces-grpc
    l.go:52: | 07:38:15 | tls-singletenant | step-04   | CLEANUP   | END   |
    l.go:52: | 07:38:15 | tls-singletenant | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:38:15 | tls-singletenant | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-http
    l.go:52: | 07:38:15 | tls-singletenant | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-tls-singletenant/generate-traces-grpc
    l.go:52: | 07:38:15 | tls-singletenant | step-03   | CLEANUP   | END   |
    l.go:52: | 07:38:15 | tls-singletenant | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:38:15 | tls-singletenant | step-02   | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-tls-singletenant/dev
    l.go:52: | 07:38:15 | tls-singletenant | step-02   | CLEANUP   | END   |
    l.go:52: | 07:38:15 | tls-singletenant | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:38:15 | tls-singletenant | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-tls-singletenant/simplest
    l.go:52: | 07:38:15 | tls-singletenant | step-01   | CLEANUP   | END   |
    l.go:52: | 07:38:15 | tls-singletenant | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:38:15 | tls-singletenant | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:38:15 | tls-singletenant | step-00   | DELETE    | OK    | v1/Service @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:38:15 | tls-singletenant | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:38:16 | tls-singletenant | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-tls-singletenant/minio
    l.go:52: | 07:38:16 | tls-singletenant | step-00   | CLEANUP   | END   |
    l.go:52: | 07:38:16 | tls-singletenant | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:38:16 | tls-singletenant | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-tls-singletenant
=== NAME  chainsaw/multitenancy-rbac
    l.go:52: | 07:38:19 | multitenancy-rbac | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/component-replicas
    l.go:52: | 07:38:21 | component-replicas | @chainsaw                                         | CLEANUP   | END   |
=== NAME  chainsaw/tls-singletenant
    l.go:52: | 07:38:54 | tls-singletenant | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/multitenancy
    l.go:52: | 07:42:41 | multitenancy | step-04   | ASSERT    | ERROR | batch/v1/Job @ chainsaw-multitenancy/verify-traces-grpc
        === ERROR
        -----------------------------------------------------
        batch/v1/Job/chainsaw-multitenancy/verify-traces-grpc
        -----------------------------------------------------
        * status.succeeded: Required value: field not found in the input object
        
        --- expected
        +++ actual
        @@ -3,6 +3,5 @@
         metadata:
           name: verify-traces-grpc
           namespace: chainsaw-multitenancy
        -status:
        -  succeeded: 1
        +status: {}
    l.go:52: | 07:42:41 | multitenancy | step-04   | TRY       | END   |
    l.go:52: | 07:42:41 | multitenancy | step-04   | CLEANUP   | BEGIN |
    l.go:52: | 07:42:41 | multitenancy | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-http
    l.go:52: | 07:42:41 | multitenancy | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-http
    l.go:52: | 07:42:41 | multitenancy | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-traceql-grpc
    l.go:52: | 07:42:41 | multitenancy | step-04   | DELETE    | OK    | batch/v1/Job @ chainsaw-multitenancy/verify-traces-grpc
    l.go:52: | 07:42:42 | multitenancy | step-04   | CLEANUP   | END   |
    l.go:52: | 07:42:42 | multitenancy | step-03   | CLEANUP   | BEGIN |
    l.go:52: | 07:42:42 | multitenancy | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-multitenancy/generate-traces-http
    l.go:52: | 07:42:42 | multitenancy | step-03   | DELETE    | OK    | batch/v1/Job @ chainsaw-multitenancy/generate-traces-grpc
    l.go:52: | 07:42:42 | multitenancy | step-03   | CLEANUP   | END   |
    l.go:52: | 07:42:42 | multitenancy | step-02   | CLEANUP   | BEGIN |
    l.go:52: | 07:42:42 | multitenancy | step-02   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces
    l.go:52: | 07:42:42 | multitenancy | step-02   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-write
    l.go:52: | 07:42:42 | multitenancy | step-02   | DELETE    | OK    | opentelemetry.io/v1alpha1/OpenTelemetryCollector @ chainsaw-multitenancy/dev
    l.go:52: | 07:42:42 | multitenancy | step-02   | CLEANUP   | END   |
    l.go:52: | 07:42:42 | multitenancy | step-01   | CLEANUP   | BEGIN |
    l.go:52: | 07:42:42 | multitenancy | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/RoleBinding @ chainsaw-multitenancy/view
    l.go:52: | 07:42:42 | multitenancy | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRoleBinding @ tempostack-traces-reader
    l.go:52: | 07:42:42 | multitenancy | step-01   | DELETE    | OK    | rbac.authorization.k8s.io/v1/ClusterRole @ tempostack-traces-reader
    l.go:52: | 07:42:42 | multitenancy | step-01   | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-multitenancy/simplest
    l.go:52: | 07:42:42 | multitenancy | step-01   | CLEANUP   | END   |
    l.go:52: | 07:42:42 | multitenancy | step-00   | CLEANUP   | BEGIN |
    l.go:52: | 07:42:42 | multitenancy | step-00   | DELETE    | OK    | v1/Secret @ chainsaw-multitenancy/minio
    l.go:52: | 07:42:42 | multitenancy | step-00   | DELETE    | OK    | v1/Service @ chainsaw-multitenancy/minio
    l.go:52: | 07:42:42 | multitenancy | step-00   | DELETE    | OK    | apps/v1/Deployment @ chainsaw-multitenancy/minio
    l.go:52: | 07:42:42 | multitenancy | step-00   | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-multitenancy/minio
    l.go:52: | 07:42:43 | multitenancy | step-00   | CLEANUP   | END   |
    l.go:52: | 07:42:43 | multitenancy | @chainsaw | CLEANUP   | BEGIN |
    l.go:52: | 07:42:43 | multitenancy | @chainsaw | DELETE    | OK    | v1/Namespace @ chainsaw-multitenancy
    l.go:52: | 07:43:21 | multitenancy | @chainsaw | CLEANUP   | END   |
=== NAME  chainsaw/tempostack-retention-global
    l.go:52: | 08:20:50 | tempostack-retention-global | Wait for the TempoStack global retention time period     | SLEEP     | DONE  |
    l.go:52: | 08:20:50 | tempostack-retention-global | Wait for the TempoStack global retention time period     | TRY       | END   |
    l.go:52: | 08:20:50 | tempostack-retention-global | The number of traces must be 0 post the retention period | TRY       | BEGIN |
    l.go:52: | 08:20:50 | tempostack-retention-global | The number of traces must be 0 post the retention period | APPLY     | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger-ret
    l.go:52: | 08:20:51 | tempostack-retention-global | The number of traces must be 0 post the retention period | CREATE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger-ret
    l.go:52: | 08:20:51 | tempostack-retention-global | The number of traces must be 0 post the retention period | APPLY     | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger-ret
    l.go:52: | 08:20:51 | tempostack-retention-global | The number of traces must be 0 post the retention period | ASSERT    | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger-ret
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | ASSERT    | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger-ret
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | TRY       | END   |
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | TRY       | BEGIN |
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | APPLY     | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana-ret
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | CREATE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana-ret
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | APPLY     | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana-ret
    l.go:52: | 08:20:54 | tempostack-retention-global | The number of traces must be 0 post the retention period | ASSERT    | RUN   | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana-ret
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | ASSERT    | DONE  | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana-ret
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | TRY       | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | DELETE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana-ret
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | CLEANUP   | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | DELETE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger-ret
    l.go:52: | 08:20:58 | tempostack-retention-global | The number of traces must be 0 post the retention period | CLEANUP   | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-05                                                  | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-05                                                  | DELETE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-grafana
    l.go:52: | 08:20:58 | tempostack-retention-global | step-05                                                  | CLEANUP   | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-04                                                  | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-04                                                  | DELETE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/verify-traces-jaeger
    l.go:52: | 08:20:58 | tempostack-retention-global | step-04                                                  | CLEANUP   | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-03                                                  | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-03                                                  | DELETE    | OK    | batch/v1/Job @ chainsaw-smashing-grouper/generate-traces
    l.go:52: | 08:20:58 | tempostack-retention-global | step-03                                                  | CLEANUP   | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-01                                                  | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-01                                                  | DELETE    | OK    | tempo.grafana.com/v1alpha1/TempoStack @ chainsaw-smashing-grouper/global
    l.go:52: | 08:20:58 | tempostack-retention-global | step-01                                                  | CLEANUP   | END   |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-00                                                  | CLEANUP   | BEGIN |
    l.go:52: | 08:20:58 | tempostack-retention-global | step-00                                                  | DELETE    | OK    | v1/Secret @ chainsaw-smashing-grouper/minio
    l.go:52: | 08:20:58 | tempostack-retention-global | step-00                                                  | DELETE    | OK    | v1/Service @ chainsaw-smashing-grouper/minio
    l.go:52: | 08:20:58 | tempostack-retention-global | step-00                                                  | DELETE    | OK    | apps/v1/Deployment @ chainsaw-smashing-grouper/minio
    l.go:52: | 08:20:58 | tempostack-retention-global | step-00                                                  | DELETE    | OK    | v1/PersistentVolumeClaim @ chainsaw-smashing-grouper/minio
    l.go:52: | 08:20:59 | tempostack-retention-global | step-00                                                  | CLEANUP   | END   |
    l.go:52: | 08:20:59 | tempostack-retention-global | @chainsaw                                                | CLEANUP   | BEGIN |
    l.go:52: | 08:20:59 | tempostack-retention-global | @chainsaw                                                | DELETE    | OK    | v1/Namespace @ chainsaw-smashing-grouper
    l.go:52: | 08:21:30 | tempostack-retention-global | @chainsaw                                                | CLEANUP   | END   |
--- FAIL: chainsaw (1668.33s)
    --- PASS: chainsaw/ossm-monolithic-otel (254.65s)
    --- PASS: chainsaw/ossm-tempostack (232.53s)
    --- PASS: chainsaw/ossm-tempostack-otel (219.87s)
    --- PASS: chainsaw/otel-tempo-serverless (286.53s)
    --- PASS: chainsaw/tempo-serverless (276.77s)
    --- PASS: chainsaw/monitoring (138.69s)
    --- PASS: chainsaw/monolithic-monitoring (68.78s)
    --- PASS: chainsaw/red-metrics (190.51s)
    --- PASS: chainsaw/operator-metrics (15.07s)
    --- PASS: chainsaw/gateway (33.37s)
    --- PASS: chainsaw/monolithic-route (56.58s)
    --- PASS: chainsaw/reconcile (90.28s)
    --- PASS: chainsaw/monolithic-pv (94.57s)
    --- PASS: chainsaw/monolithic-memory (99.96s)
    --- PASS: chainsaw/monolithic-single-tenant-auth (105.05s)
    --- PASS: chainsaw/monolithic-multitenancy-static (109.70s)
    --- PASS: chainsaw/monolithic-s3-tls (114.88s)
    --- PASS: chainsaw/monolithic-multitenancy-openshift (100.39s)
    --- PASS: chainsaw/receivers-tls (121.78s)
    --- PASS: chainsaw/tempostack-extraconfig (121.91s)
    --- PASS: chainsaw/tempostack-resources (122.75s)
    --- PASS: chainsaw/monolithic-receivers-tls (124.24s)
    --- PASS: chainsaw/receivers-mtls (131.66s)
    --- PASS: chainsaw/tempo-single-tenant-auth (158.83s)
    --- PASS: chainsaw/monolithic-extraconfig (52.59s)
    --- PASS: chainsaw/generate (48.71s)
    --- PASS: chainsaw/compatibility (139.48s)
    --- PASS: chainsaw/tls-singletenant-monolithic (82.17s)
    --- PASS: chainsaw/custom-ca (109.44s)
    --- PASS: chainsaw/route (107.14s)
    --- PASS: chainsaw/monolithic-ingestion-mtls (100.65s)
    --- PASS: chainsaw/multitenancy-rbac (150.75s)
    --- PASS: chainsaw/component-replicas (214.50s)
    --- PASS: chainsaw/tls-singletenant (171.03s)
    --- FAIL: chainsaw/multitenancy (442.23s)
    --- PASS: chainsaw/tempostack-retention-global (2836.64s)
FAIL
Tests Summary...
- Passed  tests 35
- Failed  tests 1
- Skipped tests 0
Done with failures.
Error: some tests failed
{"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2025-04-14T08:21:30Z"}
error: failed to execute wrapped command: exit status 1 
INFO[2025-04-14T08:21:31Z] Step tempo-interop-aws-distributed-tracing-tests-tempo-interop failed after 1h16m30s. 
INFO[2025-04-14T08:21:31Z] Step phase test failed after 1h23m17s.       
INFO[2025-04-14T08:21:31Z] Running multi-stage phase post               
INFO[2025-04-14T08:21:31Z] Running step tempo-interop-aws-gather-aws-console. 
INFO[2025-04-14T08:21:52Z] Step tempo-interop-aws-gather-aws-console succeeded after 21s. 
INFO[2025-04-14T08:21:52Z] Running step tempo-interop-aws-gather-must-gather. 
INFO[2025-04-14T08:24:28Z] Step tempo-interop-aws-gather-must-gather succeeded after 2m36s. 
INFO[2025-04-14T08:24:28Z] Running step tempo-interop-aws-gather-extra. 
INFO[2025-04-14T08:27:19Z] Step tempo-interop-aws-gather-extra succeeded after 2m50s. 
INFO[2025-04-14T08:27:19Z] Running step tempo-interop-aws-gather-audit-logs. 
INFO[2025-04-14T08:27:50Z] Step tempo-interop-aws-gather-audit-logs succeeded after 31s. 
INFO[2025-04-14T08:27:50Z] Running step tempo-interop-aws-ipi-deprovision-deprovision. 
INFO[2025-04-14T08:32:07Z] Step tempo-interop-aws-ipi-deprovision-deprovision succeeded after 4m16s. 
INFO[2025-04-14T08:32:07Z] Running step tempo-interop-aws-aws-deprovision-users-and-policies. 
INFO[2025-04-14T08:32:17Z] Step tempo-interop-aws-aws-deprovision-users-and-policies succeeded after 10s. 
INFO[2025-04-14T08:32:17Z] Running step tempo-interop-aws-firewatch-report-issues. 
INFO[2025-04-14T08:32:45Z] Logs for container test in pod tempo-interop-aws-firewatch-report-issues: 
INFO[2025-04-14T08:32:45Z] 2025-04-14T08:32:42.547760 src.jira_config_gen.jira_config_gen INFO Config file written to /tmp/jira.config
firewatch report --gcs-bucket qe-private-deck --gcs-creds-file /tmp/secrets/private-deck/creds.json --firewatch-config-path=https://raw.githubusercontent.com/CSPI-QE/cspi-utils/main/firewatch-base-configs/aws-ipi/lp-interop.json
2025-04-14T08:32:44.099048 src.objects.jira_base INFO Jira authentication successful...
2025-04-14T08:32:44.193866 src.objects.rule ERROR Value for "jira_assignee" or $FIREWATCH_DEFAULT_JIRA_ASSIGNEE is not an email address in firewatch rule: "{'step': 'distributed-tracing-tests-*', 'failure_type': 'test_failure', 'classification': 'Tempo e2e tests', 'jira_project': 'TRACING', 'jira_assignee': '!default', 'group': {'name': 'lp-tests', 'priority': 2}, 'jira_additional_labels': ['interop-tests', '4.19-lp', 'self-managed-lp', 'tempo-lp']}"
{"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2025-04-14T08:32:44Z"}
error: failed to execute wrapped command: exit status 1 
INFO[2025-04-14T08:32:45Z] Step tempo-interop-aws-firewatch-report-issues failed after 27s. 
INFO[2025-04-14T08:32:45Z] Running step tempo-interop-aws-job-re-trigger. 
INFO[2025-04-14T08:33:57Z] Step tempo-interop-aws-job-re-trigger succeeded after 1m11s. 
INFO[2025-04-14T08:33:57Z] Step phase post failed after 12m26s.         
INFO[2025-04-14T08:33:57Z] Releasing leases for test tempo-interop-aws  
INFO[2025-04-14T08:33:57Z] Ran for 2h27m10s                             
ERRO[2025-04-14T08:33:57Z] Some steps failed:                           
ERRO[2025-04-14T08:33:57Z] 
  * could not run steps: step tempo-interop-aws failed: ["tempo-interop-aws" test steps failed: "tempo-interop-aws" pod "tempo-interop-aws-distributed-tracing-tests-tempo-interop" failed: could not watch pod: the pod ci-op-q80zlqyr/tempo-interop-aws-distributed-tracing-tests-tempo-interop failed after 1h16m28s (failed containers: test): ContainerFailed one or more containers exited

Container test exited with code 1, reason Error
---
ASS: chainsaw/monitoring (138.69s)
    --- PASS: chainsaw/monolithic-monitoring (68.78s)
    --- PASS: chainsaw/red-metrics (190.51s)
    --- PASS: chainsaw/operator-metrics (15.07s)
    --- PASS: chainsaw/gateway (33.37s)
    --- PASS: chainsaw/monolithic-route (56.58s)
    --- PASS: chainsaw/reconcile (90.28s)
    --- PASS: chainsaw/monolithic-pv (94.57s)
    --- PASS: chainsaw/monolithic-memory (99.96s)
    --- PASS: chainsaw/monolithic-single-tenant-auth (105.05s)
    --- PASS: chainsaw/monolithic-multitenancy-static (109.70s)
    --- PASS: chainsaw/monolithic-s3-tls (114.88s)
    --- PASS: chainsaw/monolithic-multitenancy-openshift (100.39s)
    --- PASS: chainsaw/receivers-tls (121.78s)
    --- PASS: chainsaw/tempostack-extraconfig (121.91s)
    --- PASS: chainsaw/tempostack-resources (122.75s)
    --- PASS: chainsaw/monolithic-receivers-tls (124.24s)
    --- PASS: chainsaw/receivers-mtls (131.66s)
    --- PASS: chainsaw/tempo-single-tenant-auth (158.83s)
    --- PASS: chainsaw/monolithic-extraconfig (52.59s)
    --- PASS: chainsaw/generate (48.71s)
    --- PASS: chainsaw/compatibility (139.48s)
    --- PASS: chainsaw/tls-singletenant-monolithic (82.17s)
    --- PASS: chainsaw/custom-ca (109.44s)
    --- PASS: chainsaw/route (107.14s)
    --- PASS: chainsaw/monolithic-ingestion-mtls (100.65s)
    --- PASS: chainsaw/multitenancy-rbac (150.75s)
    --- PASS: chainsaw/component-replicas (214.50s)
    --- PASS: chainsaw/tls-singletenant (171.03s)
    --- FAIL: chainsaw/multitenancy (442.23s)
    --- PASS: chainsaw/tempostack-retention-global (2836.64s)
FAIL
Tests Summary...
- Passed  tests 35
- Failed  tests 1
- Skipped tests 0
Done with failures.
Error: some tests failed
{"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2025-04-14T08:21:30Z"}
error: failed to execute wrapped command: exit status 1
---
Link to step on registry info site: https://steps.ci.openshift.org/reference/distributed-tracing-tests-tempo-interop
Link to job on registry info site: https://steps.ci.openshift.org/job?org=openshift&repo=grafana-tempo-operator&branch=main&test=tempo-interop-aws&variant=tempo-product-ocp-4.19-lp-interop, "tempo-interop-aws" post steps failed: "tempo-interop-aws" pod "tempo-interop-aws-firewatch-report-issues" failed: could not watch pod: the pod ci-op-q80zlqyr/tempo-interop-aws-firewatch-report-issues failed after 21s (failed containers: test): ContainerFailed one or more containers exited

Container test exited with code 1, reason Error
---
2025-04-14T08:32:42.547760 src.jira_config_gen.jira_config_gen INFO Config file written to /tmp/jira.config
firewatch report --gcs-bucket qe-private-deck --gcs-creds-file /tmp/secrets/private-deck/creds.json --firewatch-config-path=https://raw.githubusercontent.com/CSPI-QE/cspi-utils/main/firewatch-base-configs/aws-ipi/lp-interop.json
2025-04-14T08:32:44.099048 src.objects.jira_base INFO Jira authentication successful...
2025-04-14T08:32:44.193866 src.objects.rule ERROR Value for "jira_assignee" or $FIREWATCH_DEFAULT_JIRA_ASSIGNEE is not an email address in firewatch rule: "{'step': 'distributed-tracing-tests-*', 'failure_type': 'test_failure', 'classification': 'Tempo e2e tests', 'jira_project': 'TRACING', 'jira_assignee': '!default', 'group': {'name': 'lp-tests', 'priority': 2}, 'jira_additional_labels': ['interop-tests', '4.19-lp', 'self-managed-lp', 'tempo-lp']}"
{"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"sigs.k8s.io/prow/pkg/entrypoint/run.go:84","func":"sigs.k8s.io/prow/pkg/entrypoint.Options.internalRun","level":"error","msg":"Error executing test process","severity":"error","time":"2025-04-14T08:32:44Z"}
error: failed to execute wrapped command: exit status 1
---
Link to step on registry info site: https://steps.ci.openshift.org/reference/firewatch-report-issues
Link to job on registry info site: https://steps.ci.openshift.org/job?org=openshift&repo=grafana-tempo-operator&branch=main&test=tempo-interop-aws&variant=tempo-product-ocp-4.19-lp-interop] 
INFO[2025-04-14T08:33:57Z] Reporting job state 'failed' with reason 'executing_graph:step_failed:utilizing_lease:executing_test:executing_multi_stage_test'