Uploaded image for project: 'Red Hat OpenShift AI Engineering'
  1. Red Hat OpenShift AI Engineering
  2. RHOAIENG-545

[Elyra] Selected Runtime Image from Pipeline property field doesn't work in Pipeline editor

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • None
    • RHOAI_2.5.0_GA
    • IDE
    • False
    • Hide

      None

      Show
      None
    • False
    • Release Notes
    • Known Issue
    • Done
    • Hide
      1. Let's have a cluster with Red Hat OpenShift Pipelines operator installed
      2. Open the RHOAI and create a new Data science project
      3. In that project:
        1. Create a data connection e.g. using AWS S3 bucket
        2. Create a pipeline server
        3. Create a workbench selecting one of the images that supports Elyra, e.g. Tensorflow
          • let's use the 2023.2 version of the image (Recommended one)
          • don't forget to use the previously created data connection in this workbench
          • create a following ENV property as Config Map: PIPELINES_SSL_SA_CERTS=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt
      4. Wait a bit until the workbench is ready and running and then login to that env
      5. In the JupyterLab IDE clone following repository
      6. Then in the file tree move to notebooks/500__jupyterhub/elyra/run-pipelines-on-data-science-pipelines
      7. Open the hello-generic-world.pipeline file
      8. The pipeline environment IDE opens for you. The pipeline definition contains it's own runtime images pre-defined for particular nodes. But we want our own so let's use the pipeline defaults for that:
        1. Near the right upper corner, there is a button (rectangle with an arrow, looks like an exit pictogram) - click on it
        2. A new options separated into three different tabs are now revealed to you
        3. Choose the PIPELINE PROPERTIES tab
        4. Scroll down to section Generic Node Defaults
        5. In the field Runtime Image select one of the predefined images
        6. Click on any of the nodes of the pipeline to select it and then switch to NODE PROPERTIES tab to see that value in Runtime Image in that tab is like Use pipeline default: [name of the image you selected before]
      9. Save changes via the floppy disk pictogram button
      10. Now run the pipeline (play pictogram button)
      11. Data should be uploaded successfully and a new pipeline run should be in progress
      12. Go to the pod yaml file for your pipeline (OC project namespace is same as the name of your data science project)
      13. In that pod yaml you can search for the runtime-image string and check what image hash id was used for actual execution
      Show
      Let's have a cluster with Red Hat OpenShift Pipelines operator installed Open the RHOAI and create a new Data science project In that project: Create a data connection e.g. using AWS S3 bucket Create a pipeline server Create a workbench selecting one of the images that supports Elyra, e.g. Tensorflow let's use the 2023.2 version of the image (Recommended one) don't forget to use the previously created data connection in this workbench create a following ENV property as Config Map: PIPELINES_SSL_SA_CERTS=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt Wait a bit until the workbench is ready and running and then login to that env In the JupyterLab IDE clone following repository Then in the file tree move to notebooks/500__jupyterhub/elyra/run-pipelines-on-data-science-pipelines Open the hello-generic-world.pipeline file The pipeline environment IDE opens for you. The pipeline definition contains it's own runtime images pre-defined for particular nodes. But we want our own so let's use the pipeline defaults for that: Near the right upper corner, there is a button (rectangle with an arrow, looks like an exit pictogram) - click on it A new options separated into three different tabs are now revealed to you Choose the PIPELINE PROPERTIES tab Scroll down to section Generic Node Defaults In the field Runtime Image select one of the predefined images Click on any of the nodes of the pipeline to select it and then switch to NODE PROPERTIES tab to see that value in Runtime Image in that tab is like Use pipeline default: [name of the image you selected before] Save changes via the floppy disk pictogram button Now run the pipeline (play pictogram button) Data should be uploaded successfully and a new pipeline run should be in progress Go to the pod yaml file for your pipeline (OC project namespace is same as the name of your data science project) In that pod yaml you can search for the runtime-image string and check what image hash id was used for actual execution

    Description

      When I want to execute (Elyra?) pipeline from the pipeline editor in JupyterLab and want to setup the default runtime image for the whole pipeline via Generic Node Defaults -> Runtime Image field that is available in the PIPELINE PROPERTIES tab, then after I choose some image of the available ones, save the pipeline and then execute it, I can see that the default image wasn't updated and the one that was already pre-set in the pipeline file was used.

      When I I open the pipeline file in a regular text editor instead of the pipeline editor, I can see that there is still the original runtime image configured for the particular nodes of the pipeline.

      Screenshots: elyra-pipeline-01.png, elyra-pipeline-02.png, elyra-pipeline-03.png and elyra-pipeline-04.png.

      —

      Expected behavior is so that the default runtime image is used instead of the original one for all the nodes in the pipeline unless defined otherwise for particular node.

      —

      RCA

      TBD

       

      Solution

      Dev:

       - Elyra code base for checking on pipeline properties artibutes not getting compiled. 
       - Fix the compilation issue.
       - Update elyra with a release.
       - Update the notebooks.

      QE:

       - Manually to test the process.
       - [Extension]Expand ODS-ci to have test case, to select runtime-image from pipeline properties.  

      Docs:

      • Update the known issues.

       

       

      Attachments

        1. elyra-pipeline-01.png
          elyra-pipeline-01.png
          139 kB
        2. elyra-pipeline-02.png
          elyra-pipeline-02.png
          141 kB
        3. elyra-pipeline-03.png
          elyra-pipeline-03.png
          136 kB
        4. elyra-pipeline-04.png
          elyra-pipeline-04.png
          258 kB

        Activity

          People

            Unassigned Unassigned
            jstourac@redhat.com Jan Stourac
            RHOAI IDE
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              PagerDuty