-
Feature
-
Resolution: Unresolved
-
Major
-
None
-
None
-
False
-
-
False
-
Not Selected
-
100% To Do, 0% In Progress, 0% Done
Feature Overview (mandatory - Complete while in New status)
- In 1.3, knowledge and skills will be officially released.
- In 1.4, custom only skills workflow will be enabled.
- Test training effectiveness with skills only workflow which essentially means evaluation checks for the new training regime that skips phase 1 (custom knowledge training).
Goals (mandatory - Complete while in New status)
- An end user might not want to train on both custom knowledge and skills. Some use cases might require training only on custom skills.
- Custom Skills are being learned effectively.
- Unblock Internal Customers (DDIS AI) innovation team and other customers wanting to use skills training.
Requirements (mandatory -_ Complete while in Refinement status):
- Run evaluation benchmarks on skills only workflows
Done - Acceptance Criteria (mandatory - Complete while in Refinement status):
- Eval scores with single phase skills training.
Use Cases - i.e. User Experience & Workflow: (Initial completion while in Refinement status):
- Customers can use compositional skills training for their custom data: an example problem is attached here: https://docs.google.com/document/d/14PKrA1AcLuvt5Dthw8PAgY5Vf-KrvCou1g6js4mtVUE/edit?tab=t.0#heading=h.wihovdffee7f
Out of Scope __(Initial completion while in Refinement status):
Documentation Considerations __(Initial completion while in Refinement status):
Provide information that needs to be considered and planned so that documentation will meet customer needs. If the feature extends existing functionality, provide a link to its current documentation..
- Documentation might include a skills example for a specific industry use case.
Questions to Answer __(Initial completion while in Refinement status):
- N/A
Background and Strategic Fit (Initial completion while in Refinement status):
- Custom Skills training will enable customers to teach LLMs skills to perform custom operations on custom data
Customer Considerations __(Initial completion while in Refinement status):
Provide any additional customer-specific considerations that must be made when designing and delivering the Feature.
- DDIS AI team is the internal customer: Customers can use skills training for their custom data: an example problem is attached here: https://docs.google.com/document/d/14PKrA1AcLuvt5Dthw8PAgY5Vf-KrvCou1g6js4mtVUE/edit?tab=t.0#heading=h.wihovdffee7f.