Uploaded image for project: 'OpenShift Request For Enhancement'
  1. OpenShift Request For Enhancement
  2. RFE-7196

Request for Documentation Enhancement: On-Premise Installation of OpenShift Lightspeed Self-Managed

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • 4.16
    • Lightspeed
    • None
    • Future Sustainability
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      The current documentation does not provide a detailed procedure for deploying OpenShift Lightspeed Self-Managed in an on-premises data center.

      https://docs.openshift.com/lightspeed/1.0tp1/configure/ols-configuring-openshift-lightspeed.html#ols-creating-lightspeed-custom-resource-file-using-web-console_ols-configuring-openshift-lightspeed

      While the documentation includes the required Custom Resource (CR) file, it lacks a clear procedure or references to relevant Red Hat documentation on how to enable the required APIs listed in the CR. Please include a link to the documentation that explains how to configure vLLM to work with the API required by Lightspeed. 

      Additionally, the CR file specifies credentialsSecretRef, but there is no guidance on how to create this secret for various operational scenarios, such as vLLM. The procedure for generating the necessary credentials is missing.

      For instance, can credentialsSecretRef be created using the following command?

      oc create secret generic ollama-credentials --from-literal=apitoken='' -n openshift-operators

      Currently, customers must rely on trial and error. In this case, the customer has deployed a custom Ollama instance with a compatible OpenAI API on a single GPU worker node. This API does not require certificates. However, the CR file does not support this configuration, as it always mandates a secret.

       

      A documented procedure for handling such scenarios would greatly improve the deployment experience.

              gausingh@redhat.com Gaurav Singh
              rhn-support-pplachy Patrik Plachy
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                None
                None