Pre Req:

• Oleg and Models team need to receive the dataset to get numbers around sequence length etc
  • We need hyperparameters (seq length) and model name, system prompt

We need to support the Granite 3.1 model as a student model for the e2e workflow. A new starter dataset will be used. 

1. The config file(s) across all supported hardware configurations need to be updated
2. Update chat template 
   1. Stretch: Can we make the chat template work be dynamic - can we update it to point to the 3.2 model's chat template?
3. System prompt templates

From the Models team, Oleg can be used as a point of contact (will confirm this). As of 03.03, he was waiting on getting the legal-cleared dataset to start tests.