Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-8614

Fromager resolver builds wrong version of boto3 for TerraKit 0.1.3.

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • Development Platform
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • DP Sprint 24, DP Sprint 25

      Description of problem:

      Fromager builds a broken combination of packages for for TerraKit 0.1.3.

      TerraKit has a dependency chain aiobotocore==3.1.0, on botocore<1.42.20, so Fromager includes botocore==1.42.19. Another branch of the dependency tree depends on boto3. Fromager pulls the latest versions 1.42.25, 1.42.26, although the latest versions are not compatible with botocore==1.42.19.

      Version numbers (base image, wheels, builder, etc):

      https://gitlab.com/redhat/rhel-ai/rhai/pipeline/-/releases/3.3.850+rhaiis-cuda13.0-ubi9-x86_64

       

      Steps to Reproduce:

          1. Use CUDA 13.0 image with 3.3 test index https://console.redhat.com/api/pypi/public-rhai/rhoai/3.3/cuda13.0-ubi9-test/simple/
           2. uv pip install vllm terratorch torchgeo terrakit

      Actual results:

      $ uv pip install terrakit
      Using Python 3.12.9 environment at: .
        × No solution found when resolving dependencies:
        ╰─▶ Because boto3==1.42.25 depends on botocore>=1.42.25 and only the following versions of boto3 are available:
                boto3==1.42.25
                boto3==1.42.26
            we can conclude that boto3<1.42.26 depends on botocore>=1.42.25.
            And because boto3==1.42.26 depends on botocore>=1.42.26, we can conclude that all versions of boto3 depend on botocore>=1.42.25. (1)      Because aiobotocore==3.1.0 depends on botocore<1.42.20 and only aiobotocore==3.1.0 is available, we can conclude that aiobotocore==3.1.0 depends on botocore<1.42.20.
            And because s3fs==2026.1.0 depends on aiobotocore==3.1.0, we can conclude that s3fs==2026.1.0 depends on botocore<1.42.20.
            And because we know from (1) that all versions of boto3 depend on botocore>=1.42.25, we can conclude that all versions of boto3 and s3fs==2026.1.0 are incompatible.
            And because only s3fs==2026.1.0 is available, we can conclude that all versions of boto3 and all versions of s3fs are incompatible.
            And because terrakit==0.1.3 depends on boto3 and s3fs, we can conclude that terrakit==0.1.3 cannot be used.
            And because only terrakit==0.1.3 is available and you require terrakit, we can conclude that your requirements are unsatisfiable.
      (app-root) /opt/app-root$ uv pip install terrakit 'botocore<1.42.20'
      Using Python 3.12.9 environment at: .
        × No solution found when resolving dependencies:
        ╰─▶ Because only the following versions of boto3 are available:
                boto3==1.42.25
                boto3==1.42.26
            and boto3==1.42.25 depends on botocore>=1.42.25, we can conclude that boto3<1.42.26 depends on botocore>=1.42.25.
            And because boto3==1.42.26 depends on botocore>=1.42.26, we can conclude that all versions of boto3 depend on botocore>=1.42.25.
            And because terrakit==0.1.3 depends on boto3 and only terrakit==0.1.3 is available, we can conclude that all versions of terrakit depend on botocore>=1.42.25.
            And because you require terrakit and botocore<1.42.20, we can conclude that your requirements are unsatisfiable.

      Expected results:

      Fromager should have included boto3==1.42.19 in the index

      Additional info:

      I can successfully install the entire package set when I pull boto3 1.42.19 from PyPI

       

      $ uv pip install terrakit 'botocore<1.42.20' vllm https://files.pythonhosted.org/packages/f1/ca/2b46e9fa3953c21a258b06e33f14452d97646ffbe7ace125e6aec62d4d7c/boto3-1.42.19-py3-none-any.whl

       

       

              Unassigned Unassigned
              cheimes@redhat.com Christian Heimes
              Doug Hellmann
              Antonio's Team
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: