Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-10303

Spike: Investigate what configuration is required to run road-core container inside RHDH pod

    • Icon: Story Story
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • None
    • None
    • RHDHPAI Sprint 3267, RHDHPAI Sprint 3268

      Story (Required)

      as part of DEVAI-286, a proper configuration set has been verified working properly for local deployment. use the configuration as a starting point and investigate what additional configs are required to run as a container within RHDH pod

       

      This issue is only to investigate and manually set&verify a working configuration as prereq for https://issues.redhat.com/browse/DEVAI-258

      Background (Required)

      we have discussed to run road-core upstream image as a sidecar container inside RHDH pod upon RHDH instance creation.

      the sidecar will need to be pull & start conditionally depending if the `lightspeed-backend` plugin is enabled.

       

      but we will need to know what configuration is required to properly run road-core container inside RHDH pod

       

      Out of scope

      <Defines what is not included in this story>

      the actual implementation is out of scope

      Approach (Required)

       

      there are some instructions on run with podman: https://github.com/road-core/service?tab=readme-ov-file#optionally-run-with-podman

      also oepnshift has an instruction on running as an openshift deployment: https://github.com/road-core/service?tab=readme-ov-file#optionally-run-inside-an-openshift-environment
      check the instruction to see if any of those configurations apply to run inside rhdh pod.

       

      Dependencies

      <Describes what this story depends on. Dependent Stories and EPICs should be linked to the story.>

      Acceptance Criteria (Required)

      if RHIDP-4939 is not fixed, ssh into RHDH container, able to send Curl request to <containerHost>/v1/query and get a response from LLM server

      if RHIDP-4939 is fixed, able to use a sample plugin to send request to <containerHost>/v1/query and get a response from LLM server

       

      documentation updates (design docs, release notes etc)
      demo needed
      SOP required
      education module update (Filled by DEVAI team only)
      R&D label required (Filled by DEVAI team only)

      Done Checklist

      Code is completed, reviewed, documented and checked in
      Unit and integration test automation have been delivered and running cleanly in continuous integration/staging/canary environment
      Continuous Delivery pipeline(s) is able to proceed with new code included
      Customer facing documentation, API docs, design docs etc. are produced/updated, reviewed and published
      Acceptance criteria are met
      If the Grafana dashboard is updated, ensure the corresponding SOP is updated as well

              rh-ee-jdubrick Jordan Dubrick
              yangcao Stephanie Cao
              RHIDP - AI
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: