Goal:

Provide high-level goal statement; providing user context and expected user outcome(s) for this Epic. 2-3 sentences... 

With Gaudi 3 in RHEL AI 1.3, we only supported (dev preview) single device inferencing in large part because we did not want to pull in the Ray dependencies. 

This epic is a tracker to figure out a way and implement a solution that supports multi-device inferencing for Gaudi-3 and hopefully does not pull in Ray. 

Acceptance Criteria:

The Acceptance Criteria provides a definition of scope and the expected outcomes - from a users point of view - defines the value proposition

• <your text here>

Open questions:

Any additional details, questions or decisions that need to be made/addressed

• <your text here>
• …