Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-3660

Validate effective context window of Teacher Model

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected

      Feature Overview
      To inform and update new best practices on qna.yaml wrt context size and q&a, we need to understand the effective context window of the teacher and student models.

      • The effective context window of the granite-3.1 teacher model has been validated by PSAP team
      • This is follow-up work to validate the effective context window size of the current Mixtral 7x8b teacher model
      • Stretched goal, validate effective context window size for upcoming teacher model candidates:

       

      Goals

      Determine safe range for adjusting best practices in the creation of qna.yaml seed files.

       

      Done:

      • Report with effective context window for the teacher & candidate teacher models.
      • Downstream documentation of the effective context window for the student and teacher models.

       

      Use Cases:
      Include use case diagrams, main success scenarios, alternative flow scenarios.
      <your text here>

      Out of Scope __(Initial completion while in Refinement status):
      High-level list of items or persona’s that are out of scope.
      <your text here>

      Documentation Considerations __(Initial completion while in Refinement status):
      Provide information that needs to be considered and planned so that documentation will meet customer needs. If the feature extends existing functionality, provide a link to its current documentation..
      <your text here>

       

      Questions to Answer __(Initial completion while in Refinement status):
      Include a list of refinement / architectural questions that may need to be answered before coding can begin.
      <your text here>

      Background and Strategic Fit (Initial completion while in Refinement status):
      Provide any additional context is needed to frame the feature.
      <your text here>

      Customer Considerations __(Initial completion while in Refinement status):
      Provide any additional customer-specific considerations that must be made when designing and delivering the Feature.
      <your text here>

       

       

              wcabanba@redhat.com William Caban
              wcabanba@redhat.com William Caban
              Ashish Kamra, Kelly Brown
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: