As a admin:
I want to be able to configure OCP Lightspeed with multiple RAGs

So that:
It can answers about not only OpenShift but also OpenStack

Definition of Done:

• lightspeed-service to be able to be configured with multiple RAGs
• OCP Lightspeed being able to answer questions about different projects related to the configured RAGs

Dependencies:

• We first need to be able to generate a RAG for OpenStack (https://issues.redhat.com/browse/OSPRH-13114)

Constraints or Risks:

• The libraries used in lightspeed-service not being able to index different RAGs at the same time

Notes:

When configuring lightspeed-service [0] we are only able to specify one vector database (RAG) at a time, see the following script for it's configuration:

ols_config:
    reference_content:
        product_docs_index_path: "./vector_db/ocp_product_docs/4.15"
        product_docs_index_id: ocp-product-docs-4_15
        embeddings_model_path: "./embeddings_model"

 
In order to have lightspeed-service being able to answer questions about multiple projects (e.g OpenShift and OpenStack) we need to extend the code to allow for multiple RAGs to be configured.

This involves not only it's not only loading the documents via llama_index [1], it also uses a single index when summarizing the document [2]. Perhaps, we first will need to know whether the question asked is related to OpenStack or OpenShift and then use the accordingly Index ID.

Another alternative could also be to have the UI itself to allow the user to select the context (Either OpenShift or OpenStack or others...) before asking the question.

[0 ]https://spaces.redhat.com/pages/viewpage.action?spaceKey=OSP&title=Running+Lightspeed-Service+in+standalone+mode

[1] https://github.com/road-core/service/blob/540a694a7474642c2778c08db3b99a4bf847c023/ols/src/rag_index/index_loader.py#L78-L81

[2] https://github.com/road-core/service/blob/540a694a7474642c2778c08db3b99a4bf847c023/ols/src/query_helpers/docs_summarizer.py#L106-L112