Uploaded image for project: 'AI Platform Core Components'
  1. AI Platform Core Components
  2. AIPCC-8942

[QA][PyTorch UT][CPU, sGPU] test/test_datapipe.py - TestCaptureDataFrame failure

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • None
    • None
    • PyTorch
    • False
    • Hide

      None

      Show
      None
    • False

      Description

      Summary: Test for basic dataframe capture failing due to numpy binary incompatibility on CPU and sGPU platforms.

      Test Class: test/test_datapipe.py::TestCaptureDataFrame
      Number of Failing Tests: 1
      Platform: CPU, sGPU (CUDA)
      Test Type: Unit Test

      Version Information:

      • PyTorch Commit: 6bdd8c9
      • Branch: main
      • Test Date: 2026-01-14
      • Sprint: Sprint 24

      Failure Pattern:
      Single root cause - numpy binary incompatibility with pandas

      Common Error:
      code
      ValueError: numpy.dtype size changed, may indicate binary incompatibility. Expected 96 from C header, got 88 from PyObject
      code

      Failing Tests:
      1. test_basic_capture

      Steps to Reproduce:
      code
      TEST_CONFIG=cpu python3 test/run_test.py -i test_datapipe
      TEST_CONFIG=cuda python3 test/run_test.py -i test_datapipe
      code

      Expected Result:
      Test should pass with compatible numpy/pandas versions

      Actual Result:
      Test fails with numpy binary incompatibility error

      Root Cause Analysis:
      This error indicates a version mismatch between the numpy version used to compile pandas and the numpy runtime version. This is a known issue when upgrading numpy to 2.0+ with packages compiled against numpy 1.x

      Potential Solutions:
      1. Reinstall pandas compiled against the current numpy version
      2. Downgrade numpy to version compatible with current pandas build
      3. Use pip install --no-build-isolation when installing pandas

      Priority: P3

              Unassigned Unassigned
              pytorch-engineering PyTorch Engineering
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: