-
Task
-
Resolution: Won't Do
-
Major
-
None
-
None
-
None
-
8
-
False
-
-
False
-
-
-
HAS Sprint 2266, HAS Sprint 2267, HAS Sprint 2268
Task Description (Required)
Create a Software template to develop InstructLab: https://github.com/instructlab
Following the first pass made during https://issues.redhat.com/browse/DEVHAS-680, a new template should be introduced.
This template should be a starting point for someone to use instruct lab.
This template should be deployed on an openshift cluster.
The scope of the current issue is only the implementation of the Software Template. More detailed:
- The gitops pipeline creates a taxonomy repo for the user.
- In order to automatically initialize the instructlab every containerfile should take care of the initialization.
- This could be done by having a pre-defined `config.yaml` included in the sample code.
- The taxonomy repo used for ilab should be the new one created by the pipeline.
- Download the default model. As the model is 4.4G a volume is necessary.
- The deployment should take care of two pods:
-
- Serve the model
- Chat with the model
- Everytime that a user is contributing to the gitops generated repo, this should run a workflow:
-
- Check if the diff is ok (by using ilab diff)
- If successful it triggers a job on the deployment side to generate & train the model already served from the steps above.
The above structure might require new templates for the samples.
If this requires Change Management, complete sections below:Â
Change RequestÂ
N/A
Environment
N/A
Backout Plan
N/A
Downtime
N/A
Risk Level
N/A
Testing
- Testing the new template against a local rhtap cluster to see if everything works fine with the instructlab software template. A recording of the software template should be created too.
Communication
N/A
- relates to
-
RHIDP-10518 [Spike] Investigate InstructLab Software Template
-
- Closed
-