-
Epic
-
Resolution: Unresolved
-
Normal
-
None
-
None
-
unitxt package update request
-
False
-
-
False
-
Done
-
AIPCC-11621 - build packages for AutoRAG Core Engine and KFP Integration
-
-
33% To Do, 0% In Progress, 67% Done
Package Request Details
Requester: jdanek
Team: Notebooks Images
Package Name: unitxt
Package Source: pypi
Source URL: N/A
Version: any
Hardware Requirements: All indexes (CPU, CUDA, ROCm).
Business Justification
Related Jira Ticket: AIPCC-5985
IBM Research LLM evaluation framework (v1.26+) referenced in AIPCC-5985 Gemini product doc scan (Doug Hellmann, 2026-02-13). Also appears in Jira roadmap items RHAISTRAT-26 (Red Hat AI Evaluation Stack / eval-hub) and RHAISTRAT-979 (Core Evaluation Stack control plane). Unitxt provides the largest catalog of benchmarking tools supporting text, tables, vision, speech, and code evaluation. Listed under 'Evaluating AI Systems' section 3.2 of product documentation. Source: master list #153, GEM column.
Delivery Timeline
Target Date: 2026-03-01
Testing Requirements
Default probe tests only
This request was automatically created via the CI/CD Dashboard Package Request Form.
- relates to
-
AIPCC-5985 review existing tutorials for packages that we need to build
-
- Refinement
-
