Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-9318

[IPI on Alibabacloud] some resources (eni, security group, slb, oss bucket) are not put into the specified resource group

XMLWordPrintable

    • Quality / Stability / Reliability
    • None
    • None
    • None
    • Important
    • None
    • Unspecified
    • None
    • None
    • Rejected
    • None
    • None
    • Known Issue
    • Hide
      Cause: Some Alibabacloud services not working very well in terms of resource group support.

      Consequence: Some resources created by OCP installer, including the ENI and the security group of the Internet NAT Gateway, the OSS bucket of image-registry, and Ingress SLB, are put into the default resource group.

      Workaround (if any): n/a

      Result:
      Show
      Cause: Some Alibabacloud services not working very well in terms of resource group support. Consequence: Some resources created by OCP installer, including the ENI and the security group of the Internet NAT Gateway, the OSS bucket of image-registry, and Ingress SLB, are put into the default resource group. Workaround (if any): n/a Result:
    • None
    • None
    • None
    • None

      Version:
      ./openshift-install 4.11.0-0.nightly-2022-06-11-054027
      built from commit e7724f20e2384e50e73bf8d1dce2a5eb52c1fdab
      release image registry.ci.openshift.org/ocp/release@sha256:158f720226a184361c116b7bfa6c14637c283098459db3f131634ce05d7195e7
      release architecture amd64

      Platform: alibabacloud

      Please specify: IPI

      What happened?
      With "resourceGroupID" specified (see below example snippet) in install-config.yaml, some resources, including 1 eni and 1 security group (for a nat gateway), 1 oss bucket and 1 slb, are put into the default resource group, rather than the specified one.

      platform:
      alibabacloud:
      region: cn-zhangjiakou
      resourceGroupID: rg-aek2wky7lxk4f5y

      Note that the OSS bucket issue has a bug while its https://bugzilla.redhat.com/show_bug.cgi?id=2039304#c3 says Alibaba will add the support in April 2022, so mention it again here.

      What did you expect to happen?
      All resources of the cluster should be put into the specified resource group (if any).

      How to reproduce it (as minimally and precisely as possible)?
      Always.

      Anything else we need to know?

      >FYI the cluster resources which were put into the default resource group (i.e. "rg-acfnw6kdej3hyai"):
      $ aliyun resourcemanager ListResources --ResourceGroupId rg-acfnw6kdej3hyai --Region cn-zhangjiakou --endpoint resourcemanager.cn-zhangjiakou.aliyuncs.com --PageSize 100 --output cols=CreateDate,ResourceType,Service,ResourceId rows=Resources.Resource[]
      CreateDate | ResourceType | Service | ResourceId
      ---------- | ------------ | ------- | ----------
      >2022-06-14T14:14:21+08:00 | eni | ecs | eni-8vbelaywtnd2qmba1ij6
      2022-06-14T14:16:25+08:00 | eni | ecs | eni-8vbfrp1skeu21z4fxbpv
      >2022-06-14T14:14:20+08:00 | securitygroup | ecs | sg-8vbdu24ar7vg3n669bb6
      2022-06-14T14:16:25+08:00 | securitygroup | ecs | sg-8vbi1f8ddrryec1uwu1s
      2022-06-14T14:17:34+08:00 | bucket | oss | weinliu4113-wklwj-bootstrap
      >2022-06-14T14:34:00+08:00 | bucket | oss | jiwei-0614-02-pql8b-image-registry-cn-zhangjiakou-sbyafweixjvq
      >2022-06-14T14:30:29+08:00 | loadbalancer | slb | lb-pn7xev3qlh4dyo77th0t5

      $
      $ aliyun vpc DescribeNatGateways --RegionId cn-zhangjiakou --endpoint vpc.cn-zhangjiakou.aliyuncs.com --VpcId vpc-8vb3j3qa39gh21co3ckv4 --output cols=CreationTime,Name,NatGatewayId,NatGatewayPrivateInfo.EniInstanceId rows=NatGateways.NatGateway[]
      CreationTime | Name| NatGatewayId| NatGatewayPrivateInfo.EniInstanceId
      ------------ | ----| ------------| -----------------------------------
      2022-06-14T06:14:18Z | jiwei-0614-02-pql8b-ngw | ngw-8vbiq3jcrk3is571u2dwk | eni-8vbelaywtnd2qmba1ij6

      $
      $ aliyun ecs DescribeSecurityGroups --RegionId cn-zhangjiakou --endpoint ecs.cn-zhangjiakou.aliyuncs.com --VpcId vpc-8vb3j3qa39gh21co3ckv4 --output cols=CreationTime,SecurityGroupId,SecurityGroupName,ResourceGroupId rows=SecurityGroups.SecurityGroup[]
      CreationTime | SecurityGroupId | SecurityGroupName| ResourceGroupId
      ------------ | --------------- | -----------------| ---------------
      2022-06-14T06:14:20Z | sg-8vbdu24ar7vg3n669bb6 | ngw-8vbiq3jcrk3is571u2dwk_security_group |
      2022-06-14T06:14:05Z | sg-8vba3jdemw3vhj5w6n15 | jiwei-0614-02-pql8b-sg-master| rg-aek2wky7lxk4f5y
      2022-06-14T06:14:04Z | sg-8vbb1lwld0k1w42qm7d5 | jiwei-0614-02-pql8b-sg-worker| rg-aek2wky7lxk4f5y

      $
      $ ossutil bucket-tagging --method get oss://jiwei-0614-02-pql8b-image-registry-cn-zhangjiakou-sbyafweixjvq --endpoint oss-cn-zhangjiakou.aliyuncs.com
      index tag key tag value
      ---------------------------------------------------
      0 "GISV""ocp"
      1 "Name""jiwei-0614-02-pql8b-image-registry"
      2 "kubernetes.io/cluster/jiwei-0614-02-pql8b" "owned"
      3 "sigs.k8s.io/cloud-provider-alibaba/origin" "ocp"

      0.200506(s) elapsed
      $
      $ aliyun slb DescribeLoadBalancers --RegionId cn-zhangjiakou --endpoint slb.cn-zhangjiakou.aliyuncs.com --Tags "[

      {'TagKey': 'ack.aliyun.com', 'Tagvalue': 'jiwei-0614-02-pql8b'}

      ]" --output cols=CreateTime,LoadBalancerId,LoadBalancerName,Address,AddressType,ResourceGroupId rows=LoadBalancers.LoadBalancer[]
      CreateTime| LoadBalancerId | LoadBalancerName | Address | AddressType | ResourceGroupId
      ----------| -------------- | ---------------- | ------- | ----------- | ---------------
      2022-06-14T14:30Z | lb-pn7xev3qlh4dyo77th0t5 | a48907b2146534d1ab47644ee3f6cc0d | 39.103.202.37 | internet| rg-acfnw6kdej3hyai

      $ aliyun slb DescribeLoadBalancers --RegionId cn-zhangjiakou --endpoint slb.cn-zhangjiakou.aliyuncs.com --Tags "[

      {'TagKey': 'kubernetes.io/cluster/jiwei-0614-02-pql8b', 'Tagvalue': 'owned'}

      ]" --output cols=CreateTime,LoadBalancerId,LoadBalancerName,Address,AddressType,ResourceGroupId rows=LoadBalancers.LoadBalancer[]
      CreateTime| LoadBalancerId | LoadBalancerName | Address | AddressType | ResourceGroupId
      ----------| -------------- | ---------------- | ------- | ----------- | ---------------
      2022-06-14T14:14Z | lb-pn7kc9xenftrk5prr7zn2 | jiwei-0614-02-pql8b-slb-internal | 10.0.64.146 | intranet| rg-aek2wky7lxk4f5y
      2022-06-14T14:14Z | lb-pn73stphc1u8j53lbb6zu | jiwei-0614-02-pql8b-slb-external | 39.99.253.248 | internet| rg-aek2wky7lxk4f5y

      $

      FYI the flexy-install job: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/ocp-common/job/Flexy-install/111704/

              openshift_jira_bot OpenShift Jira Bot
              rhn-support-jiwei Jianli Wei
              None
              None
              Jianli Wei Jianli Wei
              None
              Red Hat Employee
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: