OCM_ENV=$API_HOST SET_ENVIRONMENT="1" OC_HOST=$(oc whoami --show-server) CLUSTER_ID=$(cat "${SHARED_DIR}/cluster-id") CLUSTER_NAME=$(cat "${SHARED_DIR}/cluster-name") OCM_TOKEN=$(cat /var/run/secrets/ci.openshift.io/cluster-profile/ocm-token) ROBOT_EXTRA_ARGS="-i $TEST_MARKER -e AutomationBug -e Resources-GPU -e Resources-2GPUS" RUN_SCRIPT_ARGS="--skip-oclogin true --set-urls-variables true --test-artifact-dir ${ARTIFACT_DIR}/results" export OCM_ENV export SET_ENVIRONMENT export OC_HOST export CLUSTER_NAME export OCM_TOKEN export ROBOT_EXTRA_ARGS export RUN_SCRIPT_ARGS export CLUSTER_ID mkdir "$ARTIFACT_DIR/results" # running RHOAI testsuite ./ods_ci/build/run.sh RUN SCRIPT ARGS: --skip-oclogin true --set-urls-variables true --test-artifact-dir /logs/artifacts/results ROBOT EXTRA ARGS: -i Smoke -e AutomationBug -e Resources-GPU -e Resources-2GPUS SET TEST ENVIRONMENT: 1 -- USE OCM to install IDPs: 1 -----| SET_ENVIRONMENT option is enabled. ODS-CI is going to configure the test environment for you..|----- ---> Performing log in OCM ocm envirnment: stage Stage) validating user_config.json user_config.json found! Starting json validation.. --> Going through requested users configuration validating prefix: htp-user- --> suffix type: incremental_with_rand_base validating prefix: htp-basic-user- --> suffix type: incremental_with_rand_base --> Going through requested users configuration validating prefix: ldap-op- --> suffix type: incremental_with_rand_base validating prefix: ldap-usr- --> suffix type: incremental_with_rand_base validating prefix: ldap-noaccess- --> suffix type: incremental_with_rand_base validating prefix: ldap-special --> suffix type: custom Stage) Looking for LDAP and HTPASSWD already present in the cluster... ---- | Installing the required IDPs | ---- host: https://api.rhoai-a921.n8id.s1.devshift.org:6443 Stage) Setting HTPASSWD Identity provider --> Generating users based on requested configuration elaborating prefix: htp-user- --> suffix type: incremental_with_rand_base elaborating prefix: htp-basic-user- --> suffix type: incremental_with_rand_base --> Configuring HTP IDP and users Cluster name is rhoai-a921 Configuring IDP for cluster 'rhoai-a921' Identity Provider 'htpasswd' has been created. You need to ensure that there is a list of cluster administrators defined. See 'ocm create user --help' for more information. To login into the console, open https://console-openshift-console.apps.rhoai-a921.n8id.s1.devshift.org and click on htpasswd. Securely store your username and password. If you lose these credentials, you will have to delete and recreate the IDP. Added 'cluster-admins' user 'htp-user-KfqejXAgldFGpSmPawcQ' to cluster 'rhoai-a921' ----> Performing log in with newly created HTP user ----> Performing log in the cluster using oc CLI command Login failed (401 Unauthorized) Verify you have provided the correct credentials. Login failed 1 times. Trying again in 30 seconds (max 7 times). Login failed (401 Unauthorized) Verify you have provided the correct credentials. Login failed 2 times. Trying again in 30 seconds (max 7 times). Login successful. You have access to 115 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Login successful. You have access to 115 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Login successful. You have access to 115 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Login successful. You have access to 115 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Login successful. You have access to 115 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". ---> Adding additional HTP users, if needed per requested configuration Adding password for user htp-basic-user-yDqOdoHRvWZFKEAMBaUz1 Adding password for user htp-basic-user-yDqOdoHRvWZFKEAMBaUz2 secret/htpasswd-secret-27lb0bm10pjer4l1qs2nngu0ugs3cfnk replaced Stage) Setting LDAP Identity provider --> Generating users based on requested configuration elaborating prefix: ldap-op- --> suffix type: incremental_with_rand_base elaborating prefix: ldap-usr- --> suffix type: incremental_with_rand_base elaborating prefix: ldap-noaccess- --> suffix type: incremental_with_rand_base elaborating prefix: ldap-special --> suffix type: custom --> configuring LDAP server and users namespace/openldap created secret/openldap created service/openldap created deployment.apps/openldap created { "kind": "IdentityProvider", "type": "LDAPIdentityProvider", "href": "/api/clusters_mgmt/v1/clusters/27l9lhno8j1inje7inkshmmric5aa38q/identity_providers/27lb0t00labiolvhjkpkohjj3s0n221o", "id": "27lb0t00labiolvhjkpkohjj3s0n221o", "name": "ldap-provider-qe", "mapping_method": "claim", "ldap": { "attributes": { "id": [ "dn" ], "name": [ "cn" ], "preferred_username": [ "uid" ] }, "bind_dn": "cn=admin,dc=example,dc=org", "insecure": true, "url": "ldap://openldap.openldap.svc.cluster.local:1389/dc=example,dc=org?uid" } } Error: EOF Error: EOF Error: EOF Error: EOF Stage) Configure RHODS test user groups group.user.openshift.io/rhods-admins created group.user.openshift.io/rhods-users created group.user.openshift.io/rhods-noaccess created Error from server (AlreadyExists): groups.user.openshift.io "dedicated-admins" already exists rhods-admins dedicated-admins group.user.openshift.io/rhods-admins added: "ldap-op-NKeTiwEUMldZBAHQWPsV1" group.user.openshift.io/rhods-admins added: "ldap-op-NKeTiwEUMldZBAHQWPsV2" group.user.openshift.io/rhods-admins added: "ldap-op-NKeTiwEUMldZBAHQWPsV3" group.user.openshift.io/rhods-admins added: "ldap-op-NKeTiwEUMldZBAHQWPsV4" group.user.openshift.io/rhods-admins added: "ldap-op-NKeTiwEUMldZBAHQWPsV5" Added 'dedicated-admins' user 'ldap-op-NKeTiwEUMldZBAHQWPsV1' to cluster 'rhoai-a921' Added 'dedicated-admins' user 'ldap-op-NKeTiwEUMldZBAHQWPsV2' to cluster 'rhoai-a921' Added 'dedicated-admins' user 'ldap-op-NKeTiwEUMldZBAHQWPsV3' to cluster 'rhoai-a921' Added 'dedicated-admins' user 'ldap-op-NKeTiwEUMldZBAHQWPsV4' to cluster 'rhoai-a921' Added 'dedicated-admins' user 'ldap-op-NKeTiwEUMldZBAHQWPsV5' to cluster 'rhoai-a921' rhods-users group.user.openshift.io/rhods-users added: "ldap-usr-fUuyVaCiXnPdNDIoMAmv1" group.user.openshift.io/rhods-users added: "ldap-usr-fUuyVaCiXnPdNDIoMAmv2" group.user.openshift.io/rhods-users added: "ldap-usr-fUuyVaCiXnPdNDIoMAmv3" group.user.openshift.io/rhods-users added: "ldap-usr-fUuyVaCiXnPdNDIoMAmv4" group.user.openshift.io/rhods-users added: "ldap-usr-fUuyVaCiXnPdNDIoMAmv5" rhods-noaccess group.user.openshift.io/rhods-noaccess added: "ldap-noaccess-yDWlhTYEPvgiCLdaNKfo1" group.user.openshift.io/rhods-noaccess added: "ldap-noaccess-yDWlhTYEPvgiCLdaNKfo2" group.user.openshift.io/rhods-noaccess added: "ldap-noaccess-yDWlhTYEPvgiCLdaNKfo3" group.user.openshift.io/rhods-noaccess added: "ldap-noaccess-yDWlhTYEPvgiCLdaNKfo4" group.user.openshift.io/rhods-noaccess added: "ldap-noaccess-yDWlhTYEPvgiCLdaNKfo5" rhods-users group.user.openshift.io/rhods-users added: "ldap-special." group.user.openshift.io/rhods-users added: "ldap-special^" group.user.openshift.io/rhods-users added: "ldap-special$" group.user.openshift.io/rhods-users added: "ldap-special*" group.user.openshift.io/rhods-users added: "ldap-special?" group.user.openshift.io/rhods-users added: "ldap-special(" group.user.openshift.io/rhods-users added: "ldap-special)" group.user.openshift.io/rhods-users added: "ldap-special[" group.user.openshift.io/rhods-users added: "ldap-special]" group.user.openshift.io/rhods-users added: "ldap-special{" group.user.openshift.io/rhods-users added: "ldap-special}" group.user.openshift.io/rhods-users added: "ldap-special|" group.user.openshift.io/rhods-users added: "ldap-special@" group.user.openshift.io/rhods-users added: "ldap-special;" Stage) Sleeping 180sec to wait for IDPs to become available -----| ODS-CI is starting the tests run...|----- ods_ci/test-variables.yml INFO: getting RHODS URLs from the cluster as per --set-urls-variables OCP Console URL set to: https://console-openshift-console.apps.rhoai-a921.n8id.s1.devshift.org RHODS Dashboard URL set to: https://rhods-dashboard-redhat-ods-applications.apps.rhoai-a921.n8id.s1.devshift.org RHODS API Server URL set to: https://api.rhoai-a921.n8id.s1.devshift.org:6443 RHODS Prometheus URL set to: https://prometheus-redhat-ods-monitoring.apps.rhoai-a921.n8id.s1.devshift.org INFO: we found a yq executable skipping OC login as per parameter --skip-oclogin ============================================================================== Tests ============================================================================== Tests.Deploy ============================================================================== Tests.Deploy.Installation ============================================================================== 2023-11-21 19:04:21,541 - RPA.core.certificates - INFO - Truststore not in use, HTTPS traffic validated against `certifi` package. (requires Python 3.10.12 and 'pip' 23.2.1 at minimum) Tests.Deploy.Installation.Post Install :: Post install test cases that main... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Deploy.Installation.Post Install: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify RHODS Display Name and Version :: Verify consistent rhods d... | PASS | ------------------------------------------------------------------------------ Verify RHODS Notebooks Network Policies :: Verifies that the netwo... [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify All The Pods Are Using Image Digest Instead Of Tags :: Veri... | PASS | ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Deploy.Installation.Post Install: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Deploy.Installation.Post Install :: Post install test cases ... | FAIL | 3 tests, 2 passed, 1 failed ============================================================================== Tests.Deploy.Installation | FAIL | 3 tests, 2 passed, 1 failed ============================================================================== Tests.Deploy | FAIL | 3 tests, 2 passed, 1 failed ============================================================================== Tests.Monitor And Manage ============================================================================== Tests.Monitor And Manage.Metrics ============================================================================== Tests.Monitor And Manage.Metrics.Metrics :: Test suite testing ODS Metrics ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Monitor And Manage.Metrics.Metrics: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Test Existence of Prometheus Alerting Rules :: Verifies the promet... | FAIL | SLOs-haproxy_backend_http_responses_total was not found in Prometheus rules ------------------------------------------------------------------------------ Test Existence of Prometheus Recording Rules :: Verifies the prome... | FAIL | SLOs - RHODS Operator was not found in Prometheus rules ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Monitor And Manage.Metrics.Metrics: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Monitor And Manage.Metrics.Metrics :: Test suite testing ODS... | FAIL | 2 tests, 0 passed, 2 failed ============================================================================== Tests.Monitor And Manage.Metrics.Billing Metrics :: Test suite testing ODS ... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Monitor And Manage.Metrics.Billing Metrics: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify OpenShift Monitoring Results Are Correct When Running Undef... [ WARN ] Exception managing chrome: Permission denied (os error 13) | PASS | ------------------------------------------------------------------------------ Test Billing Metric (Notebook Cpu Usage) On OpenShift Monitoring :... [ WARN ] Exception managing chrome: Permission denied (os error 13) [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. Also teardown failed: Several failures occurred: 1) Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. 2) Element 'xpath://img[@alt="Red Hat OpenShift Data Science Logo"]' did not appear in 20 seconds. 3) Element 'xpath://h1[text()="Enabled"]' did not appear in 1 minute 15 seconds. 4) Element 'xpath://*[(contains(@class, 'odh-card')) and (contains(@class, 'pf-c-card'))]' did not appear in 10 seconds. 5) Text 'Applications' did not appear in 2 minutes 30 seconds. 6) Element with locator '//button[text()="Applications"]' not found. 7) Text 'Enabled' did not appear in 5 seconds. 8) Element with locator '//a[text()="Enabled"]' not found. 9) Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. 10) Element 'xpath://img[@alt="Red Hat OpenShift Data Science Logo"]' did not appear in 20 seconds. 11) Element 'xpath://h1[text()="Enabled"]' did not appear in 1 minute 15 seconds. 12) Element 'xpath://*[(contains(@class, 'odh-card')) and (contains(@class, 'pf-c-card'))]' did not appear in 10 seconds. 13) Link with locator 'xpath://div[contains(@class,'pf-l-gallery')]/div[contains(@class,'pf-c-card')]/div[@class="pf-c-card__title"]//span[text()="Jupyter"]/../../..//div[contains(@class,"pf-c-card__footer")]/a' not found. ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Monitor And Manage.Metrics.Billing Metrics: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Monitor And Manage.Metrics.Billing Metrics :: Test suite tes... | FAIL | 2 tests, 1 passed, 1 failed ============================================================================== Tests.Monitor And Manage.Metrics | FAIL | 4 tests, 1 passed, 3 failed ============================================================================== Tests.Monitor And Manage.Alerts ============================================================================== Tests.Monitor And Manage.Alerts.Alerts :: RHODS monitoring alerts test suite ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Monitor And Manage.Alerts.Alerts: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify All Alerts Severity :: Verifies that all alerts have the ex... [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 120" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 900" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 3600" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 10800" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 120" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 900" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 3600" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 10800" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 120" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 900" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 3600" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 10800" was not found in Prometheus | FAIL | Several failures occurred: 1) Alert "RHODS Dashboard Route Error Burn Rate 120" was not found in Prometheus 2) Alert "RHODS Dashboard Route Error Burn Rate 900" was not found in Prometheus 3) Alert "RHODS Dashboard Route Error Burn Rate 3600" was not found in Prometheus 4) Alert "RHODS Dashboard Route Error Burn Rate 10800" was not found in Prometheus 5) Alert "RHODS Jupyter Probe Success Burn Rate 120" was not found in Prometheus 6) Alert "RHODS Jupyter Probe Success Burn Rate 900" was not found in Prometheus 7) Alert "RHODS Jupyter Probe Success Burn Rate 3600" was not found in Prometheus 8) Alert "RHODS Jupyter Probe Success Burn Rate 10800" was not found in Prometheus 9) Alert "RHODS Dashboard Probe Success Burn Rate 120" was not found in Prometheus 10) Alert "RHODS Dashboard Probe Success Burn Rate 900" was not found in Prometheus 11) Alert "RHODS Dashboard Probe Success Burn Rate 3600" was not found in Prometheus 12) Alert "RHODS Dashboard Probe Success Burn Rate 10800" was not found in Prometheus ------------------------------------------------------------------------------ Verify No Alerts Are Firing Except For DeadManSnitch :: Verifies t... [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 120" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 900" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 3600" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Route Error Burn Rate 10800" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 120" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 900" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 3600" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Jupyter Probe Success Burn Rate 10800" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 120" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 900" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 3600" was not found in Prometheus [ WARN ] ERROR: Alert "RHODS Dashboard Probe Success Burn Rate 10800" was not found in Prometheus | PASS | ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Monitor And Manage.Alerts.Alerts: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Monitor And Manage.Alerts.Alerts :: RHODS monitoring alerts ... | FAIL | 2 tests, 1 passed, 1 failed ============================================================================== Tests.Monitor And Manage.Alerts | FAIL | 2 tests, 1 passed, 1 failed ============================================================================== Tests.Monitor And Manage | FAIL | 6 tests, 2 passed, 4 failed ============================================================================== Tests.Ods Dashboard ============================================================================== Tests.Ods Dashboard.Ods Dashboard ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ods Dashboard.Ods Dashboard: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify RHODS Explore Section Contains Only Expected ISVs :: It ver... [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify CSS Style Of Getting Started Descriptions :: Verifies the C... [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Ods Dashboard: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Ods Dashboard | FAIL | 2 tests, 0 passed, 2 failed ============================================================================== Tests.Ods Dashboard.Ods Dashboard Settings :: Tests features in ODS Dashboa... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ods Dashboard.Ods Dashboard Settings: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify That Administrators Can Access "Cluster Settings" :: Verifi... [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Ods Dashboard Settings: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Ods Dashboard Settings :: Tests features in OD... | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ods Dashboard.Ods Dashboard Projects ============================================================================== Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects :: Suite ... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] [ WARN ] Exception managing chrome: Permission denied (os error 13) Verify Data Science Projects Page Is Accessible :: Verifies "Data ... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify User Can Access Jupyter Launcher From DS Project Page :: Ve... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify Workbench Images Have Multiple Versions :: Verifies that wo... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify User Can Create A Data Science Project :: Verifies users ca... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify User Can Create And Start A Workbench With Existent PV Stor... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify User Can Create And Start A Workbench Adding A New PV Stora... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify Users Can Start, Stop, Launch And Delete A Workbench :: Ver... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify Users Can Start, Stop And Launch A Workbench From DS Projec... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify User Can Delete A Data Science Project :: Verifies users ca... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ [ WARN ] msg=There is probably no DS Projects with Diplay Name equal to ODS-CI Common Prj [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects ... | FAIL | Suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. 9 tests, 0 passed, 9 failed ============================================================================== Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects Permissio... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects Permissions Mgmt: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:900, state:firing)', 'RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] [ WARN ] Exception managing chrome: Permission denied (os error 13) Verify User Can Access Permission Tab In Their Owned DS Project ::... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects Permissions Mgmt: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Ods Dashboard Projects.Ods Dashboard Projects ... | FAIL | Suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. Also suite teardown failed: Several failures occurred: 1) Variable '${USER_A}' not found. 2) Variable '${USER_A}' not found. 3) Variable '${USER_A}' not found. 4) Variable '${USER_C}' not found. 5) Variable '${USER_B}' not found. 6) ResourceOperationFailed: Delete failed Reason: 404 Reason: Not Found HTTP response headers: HTTPHeaderDict({'Audit-Id': 'a2f90b8d-d057-4413-b9f2-a7e0d7e7b86e, a2f90b8d-d057-4413-b9f2-a7e0d7e7b86e', 'Cache-Control': 'no-cache, private, no-cache, private', 'Content-Length': '238', 'Content-Type': 'application/json', 'Date': 'Tue, 21 Nov 2023 19:15:30 GMT', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'X-Kubernetes-Pf-Flows... [ Message content over the limit has been removed. ] File "/tmp/.cache/pypoetry/virtualenvs/ods-ci-UC6Fl63A-py3.9/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api return self.__call_api(resource_path, method, File "/tmp/.cache/pypoetry/virtualenvs/ods-ci-UC6Fl63A-py3.9/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api response_data = self.request( File "/tmp/.cache/pypoetry/virtualenvs/ods-ci-UC6Fl63A-py3.9/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 415, in request return self.rest_client.DELETE(url, File "/tmp/.cache/pypoetry/virtualenvs/ods-ci-UC6Fl63A-py3.9/lib/python3.9/site-packages/kubernetes/client/rest.py", line 265, in DELETE return self.request("DELETE", url, File "/tmp/.cache/pypoetry/virtualenvs/ods-ci-UC6Fl63A-py3.9/lib/python3.9/site-packages/kubernetes/client/rest.py", line 233, in request raise ApiException(http_resp=r) 1 test, 0 passed, 1 failed ============================================================================== Tests.Ods Dashboard.Ods Dashboard Projects | FAIL | 10 tests, 0 passed, 10 failed ============================================================================== Tests.Ods Dashboard.Model Serving ============================================================================== Tests.Ods Dashboard.Model Serving.Model Serving ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ods Dashboard.Model Serving.Model Serving: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] [ WARN ] Exception managing chrome: Permission denied (os error 13) Verify Model Serving Installation :: Verifies that the core compon... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify Openvino_IR Model Via UI :: Test the deployment of an openv... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Test Inference Without Token Authentication :: Test the inference ... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Model not deployed, skipping deletion step during teardown [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Model Serving.Model Serving: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Model Serving.Model Serving | FAIL | Suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. 3 tests, 0 passed, 3 failed ============================================================================== Tests.Ods Dashboard.Model Serving.Model Serving Customruntimes :: Collectio... ============================================================================== [ WARN ] Exception managing chrome: Permission denied (os error 13) Verify RHODS Admins Can Import A Custom Serving Runtime Template B... | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Verify RHODS Admins Can Delete A Custom Serving Runtime Template | FAIL | Parent suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ [ WARN ] msg=There is probably no DS Projects with Diplay Name equal to CustomServingRuntimesProject [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Model Serving.Model Serving Customruntimes: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Model Serving.Model Serving Customruntimes :: ... | FAIL | Suite setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. 2 tests, 0 passed, 2 failed ============================================================================== Tests.Ods Dashboard.Model Serving | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== Tests.Ods Dashboard.Data Science Pipelines ============================================================================== Tests.Ods Dashboard.Data Science Pipelines.Data-Science-Pipelines-Ui :: Sui... ============================================================================== Installing OpenShift Pipelines operator: pipelines-1.12 (AWS 4.14 Self-Managed: False) Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Error from server (NotFound): deployments.apps "openshift-pipelines-operator" not found Verify User Can Create, Run and Delete A DS Pipeline From DS Proje... | FAIL | Parent suite setup failed: Error installing OpenShift Pipelines operator ------------------------------------------------------------------------------ [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Trdwn: Tests.Ods Dashboard.Data Science Pipelines.Data-Science-Pipelines-Ui: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Tests.Ods Dashboard.Data Science Pipelines.Data-Science-Pipelines-... | FAIL | Suite setup failed: Error installing OpenShift Pipelines operator Also suite teardown failed: Variable '${PROJECTS_TO_DELETE}' not found. 1 test, 0 passed, 1 failed ============================================================================== Tests.Ods Dashboard.Data Science Pipelines | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ods Dashboard | FAIL | 19 tests, 0 passed, 19 failed ============================================================================== Tests.Jupyterhub ============================================================================== Tests.Jupyterhub.Base-User-Shutdown-Test :: Test Case that verifies a base ... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Jupyterhub.Base-User-Shutdown-Test: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify Base User Can Stop A Running Server :: Verifies that a base... [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Jupyterhub.Base-User-Shutdown-Test :: Test Case that verifie... | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Jupyterhub.Multiple-Image-Tags :: Test Suite for the multiple noteboo... ============================================================================== Verify All OOTB Images Have Version Dropdowns :: Verifies all imag... Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Jupyterhub.Multiple-Image-Tags: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Setup failed: Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Jupyterhub.Multiple-Image-Tags :: Test Suite for the multipl... | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Jupyterhub.Special-User-Testing ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Jupyterhub.Special-User-Testing: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Test Special Usernames [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Jupyterhub.Special-User-Testing | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Jupyterhub.Test ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Jupyterhub.Test: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:900, state:firing)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Logged Into OpenShift [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Element with locator 'xpath=//*[@aria-label='Application launcher']/button' not found. ------------------------------------------------------------------------------ Can Launch Jupyterhub | FAIL | Element with locator 'xpath://button[@aria-label="Application launcher"]' not found. ------------------------------------------------------------------------------ Can Login To Jupyterhub | FAIL | Text 'Start a notebook server' did not appear in 5 seconds. ------------------------------------------------------------------------------ Can Spawn Notebook | FAIL | Element 'xpath://div[.="Notebook image"]/..' not visible after 5 seconds. ------------------------------------------------------------------------------ Tests.Jupyterhub.Test | FAIL | 4 tests, 0 passed, 4 failed ============================================================================== Tests.Jupyterhub | FAIL | 7 tests, 0 passed, 7 failed ============================================================================== Tests.Must Gather ============================================================================== Tests.Must Gather.Test-Must-Gather-Logs ============================================================================== Verify that the must-gather image provides RHODS logs and info | PASS | ------------------------------------------------------------------------------ Tests.Must Gather.Test-Must-Gather-Logs | PASS | 1 test, 1 passed, 0 failed ============================================================================== Tests.Must Gather | PASS | 1 test, 1 passed, 0 failed ============================================================================== Tests.Ai Apps ============================================================================== Tests.Ai Apps.Anaconda Commercial Edition ============================================================================== Tests.Ai Apps.Anaconda Commercial Edition.Anaconda Commercial Edition :: Te... ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ai Apps.Anaconda Commercial Edition.Anaconda Commercial Edition: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify Anaconda Professional Is Available In RHODS Dashboard Explo... [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Ai Apps.Anaconda Commercial Edition.Anaconda Commercial Edit... | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Anaconda Commercial Edition | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Ibm Watson Studio ============================================================================== Tests.Ai Apps.Ibm Watson Studio.Ibm Watson Studio ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ai Apps.Ibm Watson Studio.Ibm Watson Studio: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify IBM Watson Studio Is Available In RHODS Dashboard Explore Page [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Ai Apps.Ibm Watson Studio.Ibm Watson Studio | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Ibm Watson Studio | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Intel Aikit ============================================================================== Tests.Ai Apps.Intel Aikit.Intel Aikit ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ai Apps.Intel Aikit.Intel Aikit: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify Intel AIKIT Is Available In RHODS Dashboard Explore Page [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Ai Apps.Intel Aikit.Intel Aikit | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Intel Aikit | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Rhoam ============================================================================== Tests.Ai Apps.Rhoam.Rhoam ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ai Apps.Rhoam.Rhoam: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify RHOAM Is Available In RHODS Dashboard Explore Page [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Ai Apps.Rhoam.Rhoam | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Rhoam | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Openvino ============================================================================== Tests.Ai Apps.Openvino.Openvino ============================================================================== Prometheus is running in the namespace: redhat-ods-monitoring [ WARN ] Executing keyword 'Alerts Should Not Be Firing' failed: Suite Setup: Tests.Ai Apps.Openvino.Openvino: Alerts should not be firing: ['RHODS Dashboard Route Error Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Route Error Burn Rate (for:10800, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:3600, state:pending)', 'RHODS Dashboard Probe Success Burn Rate (for:10800, state:pending)'] Verify OpenVino Is Available In RHODS Dashboard Explore Page [ WARN ] Exception managing chrome: Permission denied (os error 13) | FAIL | Condition 'return document.title == "Red Hat OpenShift Data Science"' did not become true in 15 seconds. ------------------------------------------------------------------------------ Tests.Ai Apps.Openvino.Openvino | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps.Openvino | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Tests.Ai Apps | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== Tests | FAIL | 41 tests, 5 passed, 36 failed ============================================================================== Output: /logs/artifacts/results/ods-ci-2023-11-21-19-04-pFTByB2rGK/output.xml XUnit: /logs/artifacts/results/ods-ci-2023-11-21-19-04-pFTByB2rGK/xunit_test_result.xml Log: /logs/artifacts/results/ods-ci-2023-11-21-19-04-pFTByB2rGK/log.html Report: /logs/artifacts/results/ods-ci-2023-11-21-19-04-pFTByB2rGK/test_report.html 36