Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-38609

Azure deprovision rate limiting

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      Destroying azure cluster failed due to rate limiting:
      time="2024-08-15T21:36:33Z" level=info msg="Loading azure creds" credsFilePath=/.azure/osServicePrincipal.json
      time="2024-08-15T21:36:34Z" level=debug msg="found base domain resource group name=os4-common from tags"
      time="2024-08-15T21:36:34Z" level=debug msg="found network resource group name=hive-c79bc65a-cc67-47-hdt5k-rg from tags"
      time="2024-08-15T21:36:37Z" level=debug msg="deleting public records"
      time="2024-08-15T21:36:37Z" level=debug msg="removing matching private records from ci.azure.devcluster.openshift.com"
      time="2024-08-15T21:37:28Z" level=debug msg="failed to delete public records for hive-c79bc65a-cc67-4750-a0a2-431b84e7419d.ci.azure.devcluster.openshift.com: dns.RecordSetsClient#listByDNSZoneNextResults: Failure responding to next results request: StatusCode=429 -- Original Error: autorest/azure: Service returned an error. Status=429 Code=\"Throttled\" Message=\"Too many operations are requested. Current operation is throttled.\""
      time="2024-08-15T21:37:28Z" level=debug msg="deleting public records"
      ...<repeat>...
      
          

      ref (not sure how long this will be good for)

      Version-Release number of selected component (if applicable):

      Hive vendors installer as:
      
      github.com/openshift/installer v0.9.0-master.0.20240613201043-5e36f8fb1dde
          

      How reproducible:

      Intermittent. Everyone's favorite.
          

      Steps to Reproduce:

          1. Run hive e2e-azure against master
          2. Goto 1
          

      Actual results:

      Deprovision fails due to rate limiting.
          

      Expected results:

      Deprovision succeeds.
          

      Additional info:

      
          

              jhixson_redhat John Hixson
              efried.openshift Eric Fried
              None
              None
              Gaoyun Pei Gaoyun Pei
              None
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: