-
Story
-
Resolution: Done
-
Undefined
-
None
-
None
Goal:
The current InstructLab KFT out of tree provider assumes the data path you are providing has been processed using the training library's DataProcess entry point.
While this is a fine assumption, adding an optional pre-flight to process the data is necessary as the SDG provider implementation is not planning on processing the data at the ilab-on-ocp SDG component of the KFP does today.
Acceptance Criteria:
Add an optional DataProcess pre-flight to the `supervised_fine_tune` method in the provider and expose it to the user via the provider config.