Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-15331

Failing to reconcile kube-apiserver advertisementAddress

XMLWordPrintable

    • Important
    • No
    • Hypershift Sprint 238, Hypershift Sprint 239, Hypershift Sprint 240, Hypershift Sprint 241, Hypershift Sprint 242, Hypershift Sprint 243
    • 6
    • Approved
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      Once the https://issues.redhat.com/browse/OCPBUGS-14783 is fixed we found another issue which prevents the KubeapiServer's init-container to finish successful. The init-container tries to reach the Kubeapiserver in a ipv4 based url and that's not up, it should go to the IPv6 one.

       

            [OCPBUGS-15331] Failing to reconcile kube-apiserver advertisementAddress

            GitLab CEE Bot added a comment -

            Ian Main mentioned this issue in a merge request of Service Delivery / app-interface on branch ibm_integration_bump:

            Bump IBM integration to our latest prod image.

            GitLab CEE Bot added a comment - Ian Main mentioned this issue in a merge request of Service Delivery / app-interface on branch ibm_integration_bump : Bump IBM integration to our latest prod image.

            Errata Tool added a comment -

            Since the problem described in this issue should be resolved in a recent advisory, it has been closed.

            For information on the advisory (Important: OpenShift Container Platform 4.14.0 bug fix and security update), and where to find the updated files, follow the link below.

            If the solution does not work for you, open a new bug report.
            https://access.redhat.com/errata/RHSA-2023:5006

            Errata Tool added a comment - Since the problem described in this issue should be resolved in a recent advisory, it has been closed. For information on the advisory (Important: OpenShift Container Platform 4.14.0 bug fix and security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2023:5006

            Juan Manuel Parrilla Madrid added a comment -

            Hey rhn-support-liangli, epassaro@redhat.com opened yesterday this bug https://issues.redhat.com/browse/OCPBUGS-20246 which tracks the issue you mentioned in the comment 2h ago. So I think you can close this bug and I will take care of the Elsa's one. I will let you know when this other get solved.

            Juan Manuel Parrilla Madrid added a comment - Hey rhn-support-liangli , epassaro@redhat.com opened yesterday this bug https://issues.redhat.com/browse/OCPBUGS-20246 which tracks the issue you mentioned in the comment 2h ago. So I think you can close this bug and I will take care of the Elsa's one. I will let you know when this other get solved.

            Liangquan Li added a comment -

            Summary: On Dual-stack BM, the kube-apiserver of the HostedCluster can be in a ready state, the status of KubeAPIServerAvailable can be to true, KubeapiServer's init-container can to finish successful. I think this bug can be closed.
            But, I found below errors in Kube-apiserver now and past. log: http://pastebin.test.redhat.com/1110326
            jparrill@redhat.com Do you think we need to open new bug to track this issue?

            Liangquan Li added a comment - Summary: On Dual-stack BM, the kube-apiserver of the HostedCluster can be in a ready state, the status of KubeAPIServerAvailable can be to true, KubeapiServer's init-container can to finish successful. I think this bug can be closed. But, I found below errors in Kube-apiserver now and past. log:  http://pastebin.test.redhat.com/1110326 jparrill@redhat.com Do you think we need to open new bug to track this issue?

            Liangquan Li added a comment - - edited 
            /tmp/hcp create kubeconfig --namespace $(oc get hostedcluster -A -ojsonpath='{.items[0].metadata.namespace}') > hostedcluster.kubeconfig
2023/10/10 05:44:00 selected 1 of 1 hostedclusters for the kubeconfig
2023/10/10 05:44:00 adding local-cluster/test01 to kubeconfig
2023/10/10 05:44:00 added local-cluster-test01 to kubeconfig
2023/10/10 05:44:00 created kubeconfig with 1 contexts
[root@vermilion ~]# export KUBECONFIG=hostedcluster.kubeconfig
[root@vermilion ~]# oc get node
E1010 05:44:14.453537  168284 memcache.go:265] couldn't get current server API group list: Get "https://fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s": dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused
E1010 05:44:14.454618  168284 memcache.go:265] couldn't get current server API group list: Get "https://fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s": dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused
E1010 05:44:14.455532  168284 memcache.go:265] couldn't get current server API group list: Get "https://fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s": dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused
E1010 05:44:14.457435  168284 memcache.go:265] couldn't get current server API group list: Get "https://fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s": dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused
E1010 05:44:14.459278  168284 memcache.go:265] couldn't get current server API group list: Get "https://fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s": dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused
The connection to the server fd2e:6f44:5dd8:c956::14:30450 was refused - did you specify the right host or port?

            Liangquan Li added a comment - - edited /tmp/hcp create kubeconfig --namespace $(oc get hostedcluster -A -ojsonpath= '{.items[0].metadata.namespace}' ) > hostedcluster.kubeconfig 2023/10/10 05:44:00 selected 1 of 1 hostedclusters for the kubeconfig 2023/10/10 05:44:00 adding local-cluster/test01 to kubeconfig 2023/10/10 05:44:00 added local-cluster-test01 to kubeconfig 2023/10/10 05:44:00 created kubeconfig with 1 contexts [root@vermilion ~]# export KUBECONFIG=hostedcluster.kubeconfig [root@vermilion ~]# oc get node E1010 05:44:14.453537 168284 memcache.go:265] couldn't get current server API group list: Get "https: //fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s" : dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused E1010 05:44:14.454618 168284 memcache.go:265] couldn't get current server API group list: Get "https: //fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s" : dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused E1010 05:44:14.455532 168284 memcache.go:265] couldn't get current server API group list: Get "https: //fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s" : dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused E1010 05:44:14.457435 168284 memcache.go:265] couldn't get current server API group list: Get "https: //fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s" : dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused E1010 05:44:14.459278 168284 memcache.go:265] couldn't get current server API group list: Get "https: //fd2e:6f44:5dd8:c956::14:30450/api?timeout=32s" : dial tcp [fd2e:6f44:5dd8:c956::14]:30450: connect: connection refused The connection to the server fd2e:6f44:5dd8:c956::14:30450 was refused - did you specify the right host or port?

            Liangquan Li added a comment -

            Check

            ➜  oc get node worker-0.ostest.test.metalkube.org -ojsonpath='{.status.addresses}' | jq
[
  {
    "address": "192.168.111.23",
    "type": "InternalIP"
  },
  {
    "address": "fd2e:6f44:5dd8:c956::17",
    "type": "InternalIP"
  },
  {
    "address": "worker-0.ostest.test.metalkube.org",
    "type": "Hostname"
  }
]
➜  oc get hostedcluster -n local-cluster test01 -ojsonpath='{.status.version}' | jq
{
  "availableUpdates": null,
  "desired": {
    "image": "registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b",
    "version": "4.14.0-0.nightly-2023-10-08-220853"
  },
  "history": [
    {
      "completionTime": null,
      "image": "registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b",
      "startedTime": "2023-10-10T04:39:44Z",
      "state": "Partial",
      "verified": false,
      "version": "4.14.0-0.nightly-2023-10-08-220853"
    }
  ],
  "observedGeneration": 1
}
➜  oc get pod -n local-cluster-test01 | grep "kube-apiserver"                                             
kube-apiserver-79fcf9d49d-jbwp9                       4/4     Running   0          48m
kube-apiserver-79fcf9d49d-q9fhm                       4/4     Running   0          48m
kube-apiserver-79fcf9d49d-z864l                       4/4     Running   0          48m

➜  oc get hostedcluster -n local-cluster test01 -ojsonpath='{.status.conditions[?(@.type == "KubeAPIServerAvailable")]}' | jq
{
  "lastTransitionTime": "2023-10-10T04:37:35Z",
  "message": "Kube APIServer deployment is available",
  "observedGeneration": 2,
  "reason": "AsExpected",
  "status": "True",
  "type": "KubeAPIServerAvailable"
}

➜  oc logs -n local-cluster-test01 -l app=kube-apiserver --tail=-1 -c init-bootstrap 
Writing asset: /tmp/output/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_dns-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagetagmirrorset.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_infrastructure-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_authentication.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_image.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_network.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_oauth.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_security-openshift_01_scc.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_featuregate.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagedigestmirrorset.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_securityinternal-openshift_02_rangeallocation.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_apiserver-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_console.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentpolicy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_ingress.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_scheduler.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_build.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_node.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_config-operator_01_proxy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_project.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_config-operator_01_proxy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_apiserver-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_build.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_ingress.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_network.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_security-openshift_01_scc.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentpolicy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagedigestmirrorset.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_console.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_image.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_dns-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_featuregate.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_infrastructure-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_project.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagetagmirrorset.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_securityinternal-openshift_02_rangeallocation.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_authentication.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_scheduler.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_node.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_oauth.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_infrastructure-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_securityinternal-openshift_02_rangeallocation.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_authentication.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentpolicy.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_node.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_oauth.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_config-operator_01_proxy.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_build.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_dns-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagedigestmirrorset.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_network.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagetagmirrorset.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_apiserver-Default.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_image.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_project.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_scheduler.crd.yaml
Writing asset: /tmp/output/manifests/0000_03_security-openshift_01_scc.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_console.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_featuregate.crd.yaml
Writing asset: /tmp/output/manifests/0000_10_config-operator_01_ingress.crd.yaml

            Liangquan Li added a comment - Check ➜ oc get node worker-0.ostest.test.metalkube.org -ojsonpath= '{.status.addresses}' | jq [ { "address" : "192.168.111.23" , "type" : "InternalIP" }, { "address" : "fd2e:6f44:5dd8:c956::17" , "type" : "InternalIP" }, { "address" : "worker-0.ostest.test.metalkube.org" , "type" : "Hostname" } ] ➜ oc get hostedcluster -n local-cluster test01 -ojsonpath= '{.status.version}' | jq { "availableUpdates" : null , "desired" : { "image" : "registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b" , "version" : "4.14.0-0.nightly-2023-10-08-220853" }, "history" : [ { "completionTime" : null , "image" : "registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b" , "startedTime" : "2023-10-10T04:39:44Z" , "state" : "Partial" , "verified" : false , "version" : "4.14.0-0.nightly-2023-10-08-220853" } ], "observedGeneration" : 1 } ➜ oc get pod -n local-cluster-test01 | grep "kube-apiserver" kube-apiserver-79fcf9d49d-jbwp9 4/4 Running 0 48m kube-apiserver-79fcf9d49d-q9fhm 4/4 Running 0 48m kube-apiserver-79fcf9d49d-z864l 4/4 Running 0 48m ➜ oc get hostedcluster -n local-cluster test01 -ojsonpath= '{.status.conditions[?(@.type == "KubeAPIServerAvailable" )]}' | jq { "lastTransitionTime" : "2023-10-10T04:37:35Z" , "message" : "Kube APIServer deployment is available" , "observedGeneration" : 2, "reason" : "AsExpected" , "status" : "True" , "type" : "KubeAPIServerAvailable" } ➜ oc logs -n local-cluster-test01 -l app=kube-apiserver --tail=-1 -c init-bootstrap Writing asset: /tmp/output/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_dns-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagetagmirrorset.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_infrastructure-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_authentication.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_image.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_network.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_oauth.crd.yaml Writing asset: /tmp/output/manifests/0000_03_security-openshift_01_scc.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_featuregate.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagedigestmirrorset.crd.yaml Writing asset: /tmp/output/manifests/0000_03_securityinternal-openshift_02_rangeallocation.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_apiserver-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_console.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentpolicy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_ingress.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_scheduler.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_build.crd.yaml Writing asset: /tmp/output/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_node.crd.yaml Writing asset: /tmp/output/manifests/0000_03_config-operator_01_proxy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_project.crd.yaml Writing asset: /tmp/output/manifests/0000_03_config-operator_01_proxy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_apiserver-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_build.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_ingress.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_network.crd.yaml Writing asset: /tmp/output/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml Writing asset: /tmp/output/manifests/0000_03_security-openshift_01_scc.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentpolicy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagedigestmirrorset.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_console.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_image.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_dns-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_featuregate.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_infrastructure-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_project.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagetagmirrorset.crd.yaml Writing asset: /tmp/output/manifests/0000_03_securityinternal-openshift_02_rangeallocation.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_authentication.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_scheduler.crd.yaml Writing asset: /tmp/output/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_node.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_oauth.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_infrastructure-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_03_securityinternal-openshift_02_rangeallocation.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_authentication.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentpolicy.crd.yaml Writing asset: /tmp/output/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_node.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_oauth.crd.yaml Writing asset: /tmp/output/manifests/0000_03_config-operator_01_proxy.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_build.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_dns-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagedigestmirrorset.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_network.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagetagmirrorset.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_apiserver-Default.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_image.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml Writing asset: /tmp/output/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_project.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_scheduler.crd.yaml Writing asset: /tmp/output/manifests/0000_03_security-openshift_01_scc.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_console.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_featuregate.crd.yaml Writing asset: /tmp/output/manifests/0000_10_config-operator_01_ingress.crd.yaml

            Liangquan Li added a comment -

            Config Storage

            curl https://gitlab.cee.redhat.com/wduan/openshift_storage/-/raw/master/nfs/deploy_nfs_provisioner.sh | bash -x
➜  oc get sc -A                                                                                    
NAME            PROVISIONER       RECLAIMPOLICY   VOLUMEBINDINGMODE   ALLOWVOLUMEEXPANSION   AGE
nfs (default)   example.com/nfs   Delete          Immediate           false                  49m

            Install MCE-DownStream

            curl https://raw.githubusercontent.com/LiangquanLi930/hypershift-util/main/hack/install-mce.sh && bash install-mce.sh
➜ oc get "$(oc get multiclusterengines -oname)" -ojsonpath="{.status.currentVersion}" | cut -c 1-3 2.4

            Create HostedCluster

            [root@vermilion ~]# curl https://raw.githubusercontent.com/LiangquanLi930/hypershift-util/main/hack/mce-agent.sh | bash -x
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   907  100   907    0     0   3978      0 --:--:-- --:--:-- --:--:--  3960
+ set -exuo pipefail
++ oc get ConsoleCLIDownload hcp-cli-download -o json
++ jq -r '.spec.links[] | select(.text | test("Linux for x86_64")).href'
+ downURL=https://hcp-cli-download-multicluster-engine.apps.ostest.test.metalkube.org/linux/amd64/hcp.tar.gz
+ curl -k --output /tmp/hcp.tar.gz https://hcp-cli-download-multicluster-engine.apps.ostest.test.metalkube.org/linux/amd64/hcp.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 32.3M  100 32.3M    0     0   343M      0 --:--:-- --:--:-- --:--:--  343M
+ pushd /tmp
/tmp ~
+ tar -xvf /tmp/hcp.tar.gz
./hcp
+ chmod +x /tmp/hcp
+ popd
~
+ CLUSTER_NAME=test01
++ date
+ echo 'Tuesday, October 10, 2023 04:35:31 UTC Creating HyperShift cluster test01' 
Tuesday, October 10, 2023 04:35:31 UTC Creating HyperShift cluster test01
+ oc create ns local-cluster-test01
namespace/local-cluster-test01 created
++ oc get dns/cluster '-ojsonpath={.spec.baseDomain}'
+ BASEDOMAIN=ostest.test.metalkube.org
++ oc get clusterversion version '-ojsonpath={.status.desired.image}'
+ PLAYLOADIMAGE=registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b
+ echo 'extract secret/pull-secret'
extract secret/pull-secret
+ oc extract secret/pull-secret -n openshift-config --to=/tmp --confirm
/tmp/.dockerconfigjson
+ /tmp/hcp create cluster agent --name=test01 --pull-secret=/tmp/.dockerconfigjson --namespace local-cluster --agent-namespace=local-cluster-test01 --base-domain=ostest.test.metalkube.org --release-image registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b
2023-10-10T04:35:33Z	INFO	detected "fd2e:6f44:5dd8:c956::14" from node "master-0.ostest.test.metalkube.org" as external-api-server-address
2023-10-10T04:35:33Z	INFO	Applied Kube resource	{"kind": "Namespace", "namespace": "", "name": "local-cluster"}
2023-10-10T04:35:33Z	INFO	Applied Kube resource	{"kind": "Secret", "namespace": "local-cluster", "name": "test01-pull-secret"}
2023-10-10T04:35:33Z	INFO	Applied Kube resource	{"kind": "", "namespace": "local-cluster", "name": "test01"}
2023-10-10T04:35:33Z	INFO	Applied Kube resource	{"kind": "Role", "namespace": "local-cluster-test01", "name": "capi-provider-role"}
2023-10-10T04:35:33Z	INFO	Applied Kube resource	{"kind": "Secret", "namespace": "local-cluster", "name": "test01-etcd-encryption-key"}
2023-10-10T04:35:33Z	INFO	Applied Kube resource	{"kind": "NodePool", "namespace": "local-cluster", "name": "test01"}

            Liangquan Li added a comment - Config Storage curl https: //gitlab.cee.redhat.com/wduan/openshift_storage/-/raw/master/nfs/deploy_nfs_provisioner.sh | bash -x ➜ oc get sc -A NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE nfs ( default ) example.com/nfs Delete Immediate false 49m Install MCE-DownStream curl https: //raw.githubusercontent.com/LiangquanLi930/hypershift-util/main/hack/install-mce.sh && bash install-mce.sh ➜ oc get "$(oc get multiclusterengines -oname)" -ojsonpath= "{.status.currentVersion}" | cut -c 1-3 2.4 Create HostedCluster [root@vermilion ~]# curl https: //raw.githubusercontent.com/LiangquanLi930/hypershift-util/main/hack/mce-agent.sh | bash -x % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 907 100 907 0 0 3978 0 --:--:-- --:--:-- --:--:-- 3960 + set -exuo pipefail ++ oc get ConsoleCLIDownload hcp-cli-download -o json ++ jq -r '.spec.links[] | select(.text | test( "Linux for x86_64" )).href' + downURL=https: //hcp-cli-download-multicluster-engine.apps.ostest.test.metalkube.org/linux/amd64/hcp.tar.gz + curl -k --output /tmp/hcp.tar.gz https: //hcp-cli-download-multicluster-engine.apps.ostest.test.metalkube.org/linux/amd64/hcp.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 32.3M 100 32.3M 0 0 343M 0 --:--:-- --:--:-- --:--:-- 343M + pushd /tmp /tmp ~ + tar -xvf /tmp/hcp.tar.gz ./hcp + chmod +x /tmp/hcp + popd ~ + CLUSTER_NAME=test01 ++ date + echo 'Tuesday, October 10, 2023 04:35:31 UTC Creating HyperShift cluster test01' Tuesday, October 10, 2023 04:35:31 UTC Creating HyperShift cluster test01 + oc create ns local-cluster-test01 namespace/local-cluster-test01 created ++ oc get dns/cluster '-ojsonpath={.spec.baseDomain}' + BASEDOMAIN=ostest.test.metalkube.org ++ oc get clusterversion version '-ojsonpath={.status.desired.image}' + PLAYLOADIMAGE=registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b + echo 'extract secret/pull-secret' extract secret/pull-secret + oc extract secret/pull-secret -n openshift-config --to=/tmp --confirm /tmp/.dockerconfigjson + /tmp/hcp create cluster agent --name=test01 --pull-secret=/tmp/.dockerconfigjson --namespace local-cluster --agent-namespace=local-cluster-test01 --base-domain=ostest.test.metalkube.org --release-image registry.build05.ci.openshift.org/ci-ln-4p2sx3b/release@sha256:4c2cb5e22892e3cd91089b4e69a89db28062068b65d80cd8037c5d9f378ff81b 2023-10-10T04:35:33Z INFO detected "fd2e:6f44:5dd8:c956::14" from node "master-0.ostest.test.metalkube.org" as external-api-server-address 2023-10-10T04:35:33Z INFO Applied Kube resource { "kind" : "Namespace" , "namespace" : "", " name ": " local-cluster"} 2023-10-10T04:35:33Z INFO Applied Kube resource { "kind" : "Secret" , "namespace" : "local-cluster" , "name" : "test01-pull-secret" } 2023-10-10T04:35:33Z INFO Applied Kube resource { "kind" : "", " namespace ": " local-cluster ", " name ": " test01"} 2023-10-10T04:35:33Z INFO Applied Kube resource { "kind" : "Role" , "namespace" : "local-cluster-test01" , "name" : "capi-provider-role" } 2023-10-10T04:35:33Z INFO Applied Kube resource { "kind" : "Secret" , "namespace" : "local-cluster" , "name" : "test01-etcd-encryption-key" } 2023-10-10T04:35:33Z INFO Applied Kube resource { "kind" : "NodePool" , "namespace" : "local-cluster" , "name" : "test01" }

              jparrill@redhat.com Juan Manuel Parrilla Madrid
              jparrill@redhat.com Juan Manuel Parrilla Madrid
              Liangquan Li Liangquan Li
              Lubov Shilin
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated:
                Resolved: