Loading...

Type: Bug
Resolution: Unresolved
Priority: Undefined
Fix Version/s: None
Affects Version/s: 4.20
Component/s: Storage
Labels:
None

Activity Type:
Quality / Stability / Reliability
Blocked:
False
Blocked Reason:

Hide

None

Show
None
Story Points:
None
Severity:
None
Regression:
None

Target Backport Versions:
None
Target Version:

4.21.0
Release Blocker:
None
Sprint:
None

SFDC Cases Counter:
SFDC Cases Open:
SFDC Cases Links:

PX Review Complete:
PX Priority Data:
PX Impact Score:
PX Technical Impact:
PX Impact Range:

Release Note Status:
None
Release Note Type:
None
Release Note Text:
None

Escape Reason:
None
Escape Impact:
None
Corrective Measures:
None
SDLC stage when should've been found:
None

Description of problem:

co/storage reported Progressing=True only for a node reboot which should not happened during a normal cluster upgrade.

Job example

Sep 26 02:13:26.188 W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverControllerServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverControllerServiceControllerProgressing: Waiting for Deployment to deploy pods
Sep 26 02:13:26.188 - 16s   W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverControllerServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverControllerServiceControllerProgressing: Waiting for Deployment to deploy pods
Sep 26 02:18:35.044 W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:18:35.044 - 171s  W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:21:37.010 W clusteroperator/storage condition/Progressing reason/VolumeDataSourceValidatorDeploymentController_Deploying status/True VolumeDataSourceValidatorDeploymentControllerProgressing: Waiting for Deployment to deploy pods
Sep 26 02:21:37.010 - 9s    W clusteroperator/storage condition/Progressing reason/VolumeDataSourceValidatorDeploymentController_Deploying status/True VolumeDataSourceValidatorDeploymentControllerProgressing: Waiting for Deployment to deploy pods
Sep 26 02:25:17.314 W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:25:17.314 - 93s   W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:27:24.502 W clusteroperator/storage condition/Progressing reason/GCPPD_Deploying status/True GCPPDProgressing: Waiting for Deployment to deploy pods
Sep 26 02:27:24.502 - 25s   W clusteroperator/storage condition/Progressing reason/GCPPD_Deploying status/True GCPPDProgressing: Waiting for Deployment to deploy pods
Sep 26 02:29:03.333 W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:29:03.333 - 54s   W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:32:28.271 W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:32:28.271 - 77s   W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:37:59.193 W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
Sep 26 02:37:59.193 - 61s   W clusteroperator/storage condition/Progressing reason/GCPPDCSIDriverOperatorCR_GCPPDDriverNodeServiceController_Deploying status/True GCPPDCSIDriverOperatorCRProgressing: GCPPDDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
{code:none}
The example job does an upgrade from 4.20.0-0.ci-2025-09-23-172020 to 4.21.0-0.ci-2025-09-26-000607

How reproducible:

Seems always for 4.20 - 4.21 upgrades

Steps to Reproduce:

    1.
    2.
    3.

Actual results:

Expected results:

co does not go Progressing=True only for a node reboot

Additional info:

relates to

OTA-1637 Fail CI if any Cluster Operator reports Progressing=True only up to cluster scaling or a node rebooting

In Progress

links to

openshift/library-go#2033: OCPBUGS-62634: Fix CSI node DaemonSet progressing

openshift/library-go#2034: OCPBUGS-62634, OCPBUGS-62624: Fix DeploymentController Progressing

Details

Description

Attachments

Issue Links

Easy Agile Planning Poker

Activity

People

Dates