openshift-install program fails because it cannot locate the datastore specified in install-config.yaml

4.14

every time

1. create install-config.yaml
2. ---OPENSHIFT-INSTALL
Getting openshift-install binary v4.14.26 from cobbler
level=info msg=Consuming Install Config from target directory
level=fatal msg=failed to fetch Terraform Variables: failed to fetch dependency of "Terraform Variables": failed to generate asset "Platform Provisioning Check": platform.vsphere.failureDomains.topology.datastore: Invalid value: "/CV1-GWP/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8
3.

install failes

install progresses

there may be an issue with the installer and having a folder in the path. 

.\govc.exe datastore.info
...
Name:        CV1-GWPPOD-C19-01-113e8
  Path:      /CV1-GWP/datastore/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-C19-01-113e8
  Type:      VMFS
  URL:       ds:///vmfs/volumes/6421d33f-89506e7b-91d2-84160c74fe50/
  Capacity:  20479.8 GB
  Free:      20475.9 GB
...

the full path is /CV1-GWP/datastore/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-C19-01-113e8


Below are the numerous attempts to find the datastore:

Invalid value: "/CV1-GWP/datastore/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/datastore/CV1-GWPPOD-H09-01-113e8

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": full path of datastore must be provided in format /<datacenter/datastore/<datastore>

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19-01-DSC/datastores/CV1-GWPPOD-H09-01-113e8": full path of datastore must be provided in format /<datacenter/datastore/<datastore>

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19-01-DSC/datastore/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/CV1-GWPPOD-C19-01-DSC/datastore/CV1-GWPPOD-H09-01-113e8

Invalid value: "/CV1-GWPPOD-C19-01-DSC/datastore/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWPPOD-C19-01-DSC/datastore/CV1-GWPPOD-H09-01-113e8

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": full path of datastore must be provided in format /<datacenter/datastore/<datastore>

Invalid value: "/CV1-GWP/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8

Invalid value: "/CV1-GWP/datastore/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/datastore/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": full path of datastore must be provided in format /<datacenter/datastore/<datastore>

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/CV1-GWPPOD-C19/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8

Invalid value: "/CV1-GWP/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/datastore/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/CV1-GWPPOD-C19/CV1-GWPPOD-C19-01-DSC/datastore/CV1-GWPPOD-H09-01-113e8


Customer Notes:

When attempting datastore: "/Datacenter/DatastoreCluster/Datastore" you get the following:


STEP-DEPLOY

---OPENSHIFT-INSTALL
Getting openshift-install binary v4.14.26 from cobbler
level=error msg=failed to fetch Metadata: failed to load asset "Install Config": failed to create install config: invalid "install-config.yaml" file: platform.vsphere.failureDomains.topology.datastore: Invalid value: "/CV1-GWP/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": full path of datastore must be provided in format /<datacenter/datastore/<datastore>
When attempting datastore: "/{{ vsphere.datacenter }}/datastore/{{ vpshere.datastore_cluster}}/{{ vsphere.datastore }}" you get this:


STEP-DEPLOY

---OPENSHIFT-INSTALL
Getting openshift-install binary v4.14.26 from cobbler
level=info msg=Consuming Install Config from target directory
level=fatal msg=failed to fetch Terraform Variables: failed to fetch dependency of "Terraform Variables": failed to generate asset "Platform Provisioning Check": platform.vsphere.failureDomains.topology.datastore: Invalid value: "/CV1-GWP/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8": could not find datastore /CV1-GWP/datastore/CV1-GWPPOD-C19-01-DSC/CV1-GWPPOD-H09-01-113e8


Per the following access article, it states that what I am doing is possible as of 4.14: https://access.redhat.com/solutions/6266251
Resolution
Datastore Cluster is not supported in OpenShift 4.

A vsphere-problem-detector rule was created to detect if Datastore is part of Datastore Cluster in BZ 1919336.

There's a Request For Enhancement (RFE) filled against this: Enable vSphere Datastore Cluster support.

This has been worked in Support using vSphere datastore clusters in datastore path (no storage vMotion).

An individual Datastore that is part of a VMWare vSphere Datastore Cluster, is supported as of OpenShift 4.14
This resolution is confusing though because the first line contradicts the last line.

Storage DRS and vMotion are disabled

Install-config.yaml
additionalTrustBundle: "<path:garmin-ca-bundle#ca-bundle.crt>"
apiVersion: "v1"
baseDomain: "dmz.cv1.garmin.com"
compute:
  - hyperthreading: "Enabled"
    name: "worker"
    platform:
      vsphere:
        coresPerSocket: 2
        cpus: 4
        memoryMB: 32768
        osDisk:
          diskSizeGB: 120
    replicas: 3
controlPlane:
  hyperthreading: "Enabled"
  name: "master"
  platform:
    vsphere:
      coresPerSocket: 2
      cpus: 8
      memoryMB: 32768
      osDisk:
        diskSizeGB: 120
  replicas: 3
imageDigestSources:
  - mirrors:
      - "quay-cv1.garmin.com/cse-platform/openshift-release/openshift/release"
    source: "quay.io/openshift-release-dev/ocp-v4.0-art-dev"
  - mirrors:
      - "quay-cv1.garmin.com/cse-platform/openshift-release/openshift/release-images"
    source: "quay.io/openshift-release-dev/ocp-release"
  - mirrors:
      - "quay-cv1.garmin.com/cse-platform/openshift-redhat-operator-index/multicluster-engine"
    source: "registry.redhat.io/multicluster-engine"
  - mirrors:
      - "quay-cv1.garmin.com/cse-platform/openshift-redhat-operator-index/rhacm2"
    source: "registry.redhat.io/rhacm2"
metadata:
  name: "avi-com000n"
networking:
  clusterNetwork:
    - cidr: "172.22.0.0/16"
      hostPrefix: 24
  machineNetwork:
    - cidr: "10.0.0.0/8"
  networkType: "OVNKubernetes"
  serviceNetwork:
    - "172.23.0.0/20"
platform:
  vsphere:
    apiVIPs:
      - "10.140.247.11"
    diskType: "thin"
    failureDomains:
      - name: "vsphere-cv1"
        region: "datacenter"
        server: "cv1vpa-vimvc300.garmin.com"
        topology:
          computeCluster: "/CV1-GWP/host/CV1-GWP-H09-GENPOP"
          datacenter: "CV1-GWP"
          datastore: "/CV1-GWP/datastore/CV1-GWPPOD-H09-01-113e8"
          networks:
            - "vlan-2718"
        zone: "cluster"
    ingressVIPs:
      - "10.140.247.10"
    vcenters:
      - datacenters:
          - "CV1-GWP"
        password: "<path:#credentials | jsonPath {.VMWARE_VCENTER_OPENSHIFT_ADMINS_AD.password}>"
        port: 443
        server: "cv1vpa-vimvc300.garmin.com"
        user: "<path:#credentials | jsonPath {.VMWARE_VCENTER_OPENSHIFT_ADMINS_AD.username}>"
pullSecret: "<path:pull-secret#dockerconfigjson>"
sshKey: "<path:ssh-public-key#key>"