-
Feature
-
Resolution: Unresolved
-
Normal
-
None
-
None
-
False
-
-
False
-
Not Selected
Feature Overview
To inform and update new best practices on qna.yaml wrt context size and q&a, we need to understand the effective context window of the teacher and student models.
- The effective context window of the granite-3.1 teacher model has been validated by PSAP team
- This is follow-up work to validate the effective context window size of the current Mixtral 7x8b teacher model
- Stretched goal, validate effective context window size for upcoming teacher model candidates:
- llama 3.3 70b
- Qwen2.5-32B-Instruct (for Japanese use cases)
Goals
Determine safe range for adjusting best practices in the creation of qna.yaml seed files.
Done:
- Report with effective context window for the teacher & candidate teacher models.
- Downstream documentation of the effective context window for the student and teacher models.
Use Cases:
Include use case diagrams, main success scenarios, alternative flow scenarios.
<your text here>
Out of Scope __(Initial completion while in Refinement status):
High-level list of items or persona’s that are out of scope.
<your text here>
Documentation Considerations __(Initial completion while in Refinement status):
Provide information that needs to be considered and planned so that documentation will meet customer needs. If the feature extends existing functionality, provide a link to its current documentation..
<your text here>
Questions to Answer __(Initial completion while in Refinement status):
Include a list of refinement / architectural questions that may need to be answered before coding can begin.
<your text here>
Background and Strategic Fit (Initial completion while in Refinement status):
Provide any additional context is needed to frame the feature.
<your text here>
Customer Considerations __(Initial completion while in Refinement status):
Provide any additional customer-specific considerations that must be made when designing and delivering the Feature.
<your text here>
- …