Uploaded image for project: 'Red Hat Enterprise Linux AI'
  1. Red Hat Enterprise Linux AI
  2. RHELAI-3848

Add DataProcessing to KFT Provider

XMLWordPrintable

      Goal: 

      The current InstructLab KFT out of tree provider assumes the data path you are providing has been processed using the training library's DataProcess entry point.

      While this is a fine assumption, adding an optional pre-flight to process the data is necessary as the SDG provider implementation is not planning on processing the data at the ilab-on-ocp SDG component of the KFP does today. 

      Acceptance Criteria:

      Add an optional DataProcess pre-flight to the `supervised_fine_tune` method in the provider and expose it to the user via the provider config.

              cdoern@redhat.com Charles Doern
              cdoern@redhat.com Charles Doern
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: