Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-8158

testcollections repository pins specific versions of some packages, preventing tests of newer builds

    • Icon: Epic Epic
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • Development Platform
    • None
    • no testcollection constraints
    • False
    • Hide

      None

      Show
      None
    • False
    • In Progress
    • AIPCC-6117automate updates to the packages in the package index
    • 0% To Do, 50% In Progress, 50% Done

      The testcollections pipeline repository includes several constraints that pin to specific versions:

      $ cat collections/*/*/constraints.txt
      #
      #
      #
      # Constrain packages we are patching to ensure reliable and repeatable build
      llama-stack==0.3.0rc1+rhai0
      # Fixes: https://issues.redhat.com/browse/RHAIENG-1451
      # TODO: Remove this constraint once the issue is resolved
      kfp-kubernetes==2.14.6
      # Fixes: https://issues.redhat.com/browse/RHAIENG-1468
      # TODO: Remove this constraint once the issue is resolved
      # Resolve pyarrow conflict between llama-stack-provider-ragas (==20.0.0) and datasets (>=21.0.0)
      pyarrow>=21.0.0
      # Fixes: https://issues.redhat.com/browse/RHAIENG-1484
      # TODO: Remove this constraint once the issue is resolved
      # Resolve botocore conflict between aiobotocore and boto3 by using compatible versions
      # aiobotocore 2.16.1 requires botocore<1.35.89,>=1.35.74
      botocore==1.35.88
      boto3==1.35.88
      aiobotocore==2.16.1
      # kubernetes 34.1.0 requires urllib3<2.4.0,>=1.24.2
      # ibm-cos-sdk-core 2.14.3 requires urllib3>=2.5.0 (incompatible!)
      # ibm-cos-sdk-core 2.14.2 requires urllib3<3,>=1.26.18 (compatible!)
      # Downgrade ibm-cos-sdk-core to 2.14.2 until kubernetes 35.0.0 is released
      ibm-cos-sdk-core==2.14.2
      ibm-cos-sdk==2.14.2
      #
      # #
      ## Constrain packages we are patching to ensure reliable and repeatable build
      # Constrain packages we are patching to ensure reliable and repeatable build# AIPCC-5334
      numba<=0.61.2
      ##

      AND

      $ grep == collections/*/*/requirements.txt
      collections/llama-stack/cpu-ubi9/requirements.txt:llama_stack_provider_lmeval==0.3.1
      collections/llama-stack/cpu-ubi9/requirements.txt:llama_stack_provider_ragas[remote]==0.4.1
      collections/llama-stack/cpu-ubi9/requirements.txt:llama_stack_provider_trustyai_fms==0.2.3
      collections/torch-deps/cpu-ubi9/requirements.txt:boto3==1.35.42
      collections/torch-deps/cpu-ubi9/requirements.txt:build==1.3.0
      collections/torch-deps/cpu-ubi9/requirements.txt:coremltools==8.3
      collections/torch-deps/cpu-ubi9/requirements.txt:dill==0.3.7
      collections/torch-deps/cpu-ubi9/requirements.txt:expecttest==0.3.0
      collections/torch-deps/cpu-ubi9/requirements.txt:fbscribelogger==0.1.7
      collections/torch-deps/cpu-ubi9/requirements.txt:flatbuffers==24.12.23
      collections/torch-deps/cpu-ubi9/requirements.txt:hypothesis==6.56.4
      collections/torch-deps/cpu-ubi9/requirements.txt:junitparser==2.1.1
      collections/torch-deps/cpu-ubi9/requirements.txt:lark==0.12.0
      collections/torch-deps/cpu-ubi9/requirements.txt:librosa==0.10.2
      collections/torch-deps/cpu-ubi9/requirements.txt:mypy==1.16.0
      collections/torch-deps/cpu-ubi9/requirements.txt:networkx==2.8.8
      collections/torch-deps/cpu-ubi9/requirements.txt:ninja==1.11.1.4
      collections/torch-deps/cpu-ubi9/requirements.txt:numba==0.60.0
      collections/torch-deps/cpu-ubi9/requirements.txt:numpy==2.0.2
      collections/torch-deps/cpu-ubi9/requirements.txt:pandas==2.0.3
      collections/torch-deps/cpu-ubi9/requirements.txt:opt-einsum==3.3
      collections/torch-deps/cpu-ubi9/requirements.txt:optree==0.13.0
      collections/torch-deps/cpu-ubi9/requirements.txt:pillow==11.0.0
      collections/torch-deps/cpu-ubi9/requirements.txt:protobuf==5.29.5
      collections/torch-deps/cpu-ubi9/requirements.txt:pytest==7.3.2
      collections/torch-deps/cpu-ubi9/requirements.txt:pytest-xdist==3.3.1
      collections/torch-deps/cpu-ubi9/requirements.txt:pytest-flakefinder==1.1.0
      collections/torch-deps/cpu-ubi9/requirements.txt:pytest-rerunfailures==10.3
      collections/torch-deps/cpu-ubi9/requirements.txt:pytest-subtests==0.13.1
      collections/torch-deps/cpu-ubi9/requirements.txt:xdoctest==1.3.0
      collections/torch-deps/cpu-ubi9/requirements.txt:pygments==2.15.0
      collections/torch-deps/cpu-ubi9/requirements.txt:scikit-image==0.22.0
      collections/torch-deps/cpu-ubi9/requirements.txt:scipy==1.14.1
      collections/torch-deps/cpu-ubi9/requirements.txt:typing-extensions==4.12.2
      collections/torch-deps/cpu-ubi9/requirements.txt:unittest-xml-reporting==3.2.0
      collections/torch-deps/cpu-ubi9/requirements.txt:lintrunner==0.12.7
      collections/torch-deps/cpu-ubi9/requirements.txt:redis==4.0.0
      collections/torch-deps/cpu-ubi9/requirements.txt:ghstack==0.8.0
      collections/torch-deps/cpu-ubi9/requirements.txt:jinja2==3.1.6
      collections/torch-deps/cpu-ubi9/requirements.txt:pytest-cpp==2.3.0
      collections/torch-deps/cpu-ubi9/requirements.txt:z3-solver==4.15.1.0
      collections/torch-deps/cpu-ubi9/requirements.txt:tensorboard==2.13.0
      collections/torch-deps/cpu-ubi9/requirements.txt:pywavelets==1.7.0
      collections/torch-deps/cpu-ubi9/requirements.txt:lxml==5.3.0
      collections/torch-deps/cpu-ubi9/requirements.txt:PyGithub==2.3.0
      collections/torch-deps/cpu-ubi9/requirements.txt:sympy==1.13.3
      collections/torch-deps/cpu-ubi9/requirements.txt:onnx==1.19.1
      collections/torch-deps/cpu-ubi9/requirements.txt:onnxscript==0.5.4
      collections/torch-deps/cpu-ubi9/requirements.txt:parameterized==0.8.1
      collections/torch-deps/cpu-ubi9/requirements.txt:pwlf==2.2.1
      collections/torch-deps/cpu-ubi9/requirements.txt:pyyaml==6.0.3
      collections/torch-deps/cpu-ubi9/requirements.txt:# setuptools==78.1.1
      collections/torch-deps/cpu-ubi9/requirements.txt:packaging==23.1
      collections/torch-deps/cpu-ubi9/requirements.txt:scons==4.5.2
      collections/torch-deps/cpu-ubi9/requirements.txt:pulp==2.9.0
      collections/torch-deps/cpu-ubi9/requirements.txt:dataclasses_json==0.6.7
      collections/torch-deps/cpu-ubi9/requirements.txt:cmake==3.31.6
      collections/torch-deps/cpu-ubi9/requirements.txt:tlparse==0.4.0
      collections/torch-deps/cpu-ubi9/requirements.txt:filelock==3.18.0
      collections/torch-deps/cpu-ubi9/requirements.txt:setuptools-git-versioning==2.1.0
      collections/torch-deps/cpu-ubi9/requirements.txt:scikit-build==0.18.1
      collections/torch-deps/cpu-ubi9/requirements.txt:pyre-extensions==0.0.32
      collections/torch-deps/cpu-ubi9/requirements.txt:tabulate==0.9.0
      
      1. We should fix the constraints and requirements specifiers.
      2. We should add a linter to the repository to prevent similar mistakes in the future.

              rh-ee-shikhan Shifa Khan
              dhellman@redhat.com Doug Hellmann
              Antonio's Team
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: