Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-2245

[Phase 3]: Custom Skills Training Effectiveness

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected
    • 100% To Do, 0% In Progress, 0% Done

      Feature Overview (mandatory - Complete while in New status)

      • In 1.3, knowledge and skills will be officially released. 
      • In 1.4, custom only skills workflow will be enabled. 
      • Test training effectiveness with skills only workflow which essentially means evaluation checks for the new training regime that skips phase 1 (custom knowledge training). 

      Goals (mandatory - Complete while in New status)

      • An end user might not want to train on both custom knowledge and skills. Some use cases might require training only on custom skills. 
      • Custom Skills are being learned effectively. 
      • Unblock Internal Customers (DDIS AI) innovation team and other customers wanting to use skills training. 

      Requirements (mandatory -_ Complete while in Refinement status):

      • Run evaluation benchmarks on skills only workflows 

      Done - Acceptance Criteria (mandatory - Complete while in Refinement status):

      • Eval scores with single phase skills training. 

      Use Cases - i.e. User Experience & Workflow: (Initial completion while in Refinement status):

       

      Out of Scope __(Initial completion while in Refinement status):

       

      Documentation Considerations __(Initial completion while in Refinement status):
      Provide information that needs to be considered and planned so that documentation will meet customer needs. If the feature extends existing functionality, provide a link to its current documentation..

      •   Documentation might include a skills example for a specific industry use case. 

       

      Questions to Answer __(Initial completion while in Refinement status):

      • N/A

       

      Background and Strategic Fit (Initial completion while in Refinement status):

      • Custom Skills training will enable customers to teach LLMs skills to perform custom operations on custom data

       

      Customer Considerations __(Initial completion while in Refinement status):
      Provide any additional customer-specific considerations that must be made when designing and delivering the Feature.

       

              wcabanba@redhat.com William Caban
              rh-ee-asaluja Aditi Saluja
              Dan McPherson, Mustafa Eyceoz
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: