This spike is to investigate, prototype, and define the technical and user experience architecture required to successfully implement the "Developer Lightspeed Notebook" feature (RHDHPLAN-36). The outcome will be a set of actionable recommendations and designs to ensure the feature is feasible, secure, and well-planned before committing to full development.

“NotebookLM feature” requirements:

As a RHDH user, I want to upload my own documents (images, videos, or texts) and ask questions/ learn through Lightspeed, so that I can get full understanding of these provided documents.

1.  RAG functionality
2. https://issues.redhat.com/browse/LCORE-798, do we wait/ help out on this task
3. System prompting
4. Current workflow -> RHDH connects to Lightspeed sidecar, that calls Lightspeed Core API.
5. Do we have a separate workflow for system prompting for this feature?

Acceptance Criteria

1. Create a design doc that discusses the architecture of this feature: https://docs.google.com/document/d/1FtLE3M1fVIwrBSsP4dlcogSydlqGek8ePjkqqTJezeE/edit?tab=t.0
2. Communicate with the Lightspeed Core team for the changes of real time RAG agents regarding https://issues.redhat.com/browse/LCORE-798

Out-of-scoper

  1. This task is to investigate only the backend part of the AI Notebooks feature. Refer to https://issues.redhat.com/browse/RHDHPAI-1208 for the frontend investigation aspect of this feature.