Description of problem - Provide a detailed description of the issue encountered, including logs/command-output snippets and screenshots if the issue is observed in the UI:

DRClusters not created after creating DRPolicy for 2nd set of Peer clusters. Peer (managed) OpenShift clusters are air-gap disconnected.

The OCP platform infrastructure and deployment type (AWS, Bare Metal, VMware, etc. Please clarify if it is platform agnostic deployment), (IPI/UPI):

Bare Metal 

The ODF deployment type (Internal, External, Internal-Attached (LSO), Multicluster, DR, Provider, etc):

 External - Ceph Stretch Mode for Metro-DR use.

The version of all relevant components (OCP, ODF, RHCS, ACM whichever is applicable):

ACM 2.12.3
OCP 4.16
ODF 4.16.3

Does this issue impact your ability to continue to work with the product?

 Yes
DRclusters for 2nd set of Peer Clusters are not created so DR configuration does not complete.

Is there any workaround available to the best of your knowledge?

 No

Can this issue be reproduced? If so, please provide the hit rate

 Yes, 100% of the time
 
Steps to Reproduce:

1. Create Metro-DR configuration with hub + 4 managed clusters (2 Peer cluster sets). Managed clusters are air-gap disconnected.
2. Create DRPolicy for first Peer Cluster set and validate DR configuration
3. Create DRPolicy for second Peer Cluster set

Actual results:

 DRclusters for 2nd set of Peer Clusters not created

Expected results:

 DRClusters created and all DR configuration completed correctly.

Logs collected and log location:

ACM must-gather + managed clusters ocp-wldc-prd-01 and ocp-rdc-prd-01.
https://drive.google.com/file/d/1loj43__gUtsfgwjKN5Q_pTyPiLPkOIQ8/view?usp=sharing

Additional info:

DRPolicy metrodr-prd was created for 2nd set of peer clusters ocp-wldc-prd-01 and ocp-rdc-prd-01.

Name:         metrodr-prd
Namespace:    
Labels:       <none>
Annotations:  <none>
API Version:  ramendr.openshift.io/v1alpha1
Kind:         DRPolicy
Metadata:
  Creation Timestamp:  2025-01-29T21:15:57Z
  Generation:          1
  Resource Version:    569988482
  UID:                 7bed278e-dd68-4489-837f-32a7c4d5a3a1
Spec:
  Dr Clusters:
    ocp-wldc-prd-01
    ocp-rdc-prd-01
  Replication Class Selector:
  Scheduling Interval:  0m
  Volume Snapshot Class Selector:
Status:
  Conditions:
    Last Transition Time:  2025-01-29T21:15:57Z
    Message:               failed to find DRClusters specified in policy ([ocp-wldc-prd-01 ocp-rdc-prd-01])
    Observed Generation:   1
    Reason:                DRClusterNotFound
    Status:                False
    Type:                  Validated
Events:                    <none>
Name:         metrodr-qa
Namespace:    
Labels:       cluster.open-cluster-management.io/backup=ramen
Annotations:  <none>
API Version:  ramendr.openshift.io/v1alpha1
Kind:         DRPolicy
Metadata:
  Creation Timestamp:  2024-12-12T14:44:21Z
  Finalizers:
    drpolicies.ramendr.openshift.io/ramen
  Generation:        1
  Resource Version:  471009506
  UID:               1ed9416b-1057-45c1-a752-f51eadef45e8
Spec:
  Dr Clusters:
    ocp-rdc-qa-01
    ocp-wldc-qa-01
  Replication Class Selector:
  Scheduling Interval:  0m
  Volume Snapshot Class Selector:
Status:
  Conditions:
    Last Transition Time:  2024-12-12T14:44:21Z
    Message:               drpolicy validated
    Observed Generation:   1
    Reason:                Succeeded
    Status:                True
    Type:                  Validated
Events:                    <none>