Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-10555

Implement Software template to develop InstructLab Taxonomy

    • Icon: Task Task
    • Resolution: Won't Do
    • Icon: Major Major
    • None
    • None
    • None
    • HAS Sprint 2266, HAS Sprint 2267, HAS Sprint 2268

      Task Description (Required)

      Create a Software template to develop InstructLab: https://github.com/instructlab

      Following the first pass made during https://issues.redhat.com/browse/DEVHAS-680, a new template should be introduced.
      This template should be a starting point for someone to use instruct lab.

      This template should be deployed on an openshift cluster.

      The scope of the current issue is only the implementation of the Software Template. More detailed:

      • The gitops pipeline creates a taxonomy repo for the user.
      • In order to automatically initialize the instructlab every containerfile should take care of the initialization.
        • This could be done by having a pre-defined `config.yaml` included in the sample code.
        • The taxonomy repo used for ilab should be the new one created by the pipeline.
      • Download the default model. As the model is 4.4G a volume is necessary.
      • The deployment should take care of two pods:
        • Serve the model
        • Chat with the model
      • Everytime that a user is contributing to the gitops generated repo, this should run a workflow:
        • Check if the diff is ok (by using ilab diff)
        • If successful it triggers a job on the deployment side to generate & train the model already served from the steps above.

      The above structure might require new templates for the samples.

      If this requires Change Management, complete sections below: 

      Change Request 

      N/A

      Environment

      N/A

      Backout Plan

      N/A

      Downtime

      N/A

      Risk Level

      N/A

      Testing

      • Testing the new template against a local rhtap cluster to see if everything works fine with the instructlab software template. A recording of the software template should be created too.

      Communication

      N/A

              rh-ee-tpetkos Theofanis Petkos
              eyuen@redhat.com Elson Yuen
              RHIDP - AI
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: