Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-3296

RHDH pod CrashLoopBackOff on 1.2.x - Error: No extension point or service available

Prepare for Y ReleasePrepare for Z ReleaseRemove QuarterXMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • 1.2.2
    • None
    • Dynamic plugins
    • None
    • RHDH Dynamic Plugins 3260
    • Critical

      Description of problem:

      e2e test (PR check and Nightly) are failing on 1.2.x.
      Error seems to be related to dynamic plugins :

      {"level":"info","message":"Loading kubernetes config from config file","plugin":"catalog","service":"backstage","timestamp":"2024-07-23 08:19:12"} /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1672 throw new Error( ^ Error: No extension point or service available for the following ref(s): serviceRef{events.service} at BackendInitializer.getInitDeps_fn (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1672:11) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1792:32 at async processNode (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1309:22) at async Promise.all (index 3) at async processMoreNodes (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1304:7) at async _DependencyGraph.parallelTopologicalTraversal (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1315:5) at async /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1790:9 at async Promise.all (index 1) at async BackendInitializer.doStart_fn (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1766:3) at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1626:5) at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1894:5) Node.js v20.12.2

      1.2-118 was the last build it was working : https://gitlab.cee.redhat.com/rhidp/rhdh/-/pipelines/8858354 post that (1.2-119 onwards) its giving above error.
      QE haven't done any change in app-config or dynamic plugins config but somehow it stopped working and the same config is working in 1.3 with the same config. This issue is only with 1.2-119+
       

      More on issue : https://redhat-internal.slack.com/archives/C04CUSD4JSG/p1721731703199639 

      Prerequisites (if any, like setup, operators/versions):

      Steps to Reproduce

      1. Deploy RHDH 1.2-119+ 
      2. Configure bellow dynamic plugins : 
          plugins:
          - disabled: false
            package: ./dynamic-plugins/dist/backstage-plugin-catalog-backend-module-github-dynamic
            pluginConfig:
              catalog:
                providers:
                  github:
                    my-test-org:
                      catalogPath: /catalog-info.yaml
                      organization: janus-qe
                      schedule:
                        frequency:
                          minutes: 1
                        initialDelay:
                          seconds: 15
                        timeout:
                          minutes: 1
          - disabled: false
            package: ./dynamic-plugins/dist/backstage-plugin-catalog-backend-module-github-org-dynamic
          - disabled: false
            package: ./dynamic-plugins/dist/backstage-plugin-github-issues
          - disabled: false
            package: ./dynamic-plugins/dist/roadiehq-backstage-plugin-github-pull-requests
          - disabled: false
            package: ./dynamic-plugins/dist/backstage-plugin-github-actions 

      Actual results: CrashLoopBackOff Error: No extension point or service available for the following ref(s): serviceRef{events.service}

      Expected results: RHDH should be up and running

      Reproducibility (Always/Intermittent/Only Once): Always

      Build Details: 1.2-119+

      Additional info (Such as Logs, Screenshots, etc):

      {"level":"info","message":"Listening on :7007","service":"rootHttpRouter","timestamp":"2024-07-23 08:19:11"}
      {"level":"warn","message":"DEPRECATION WARNING: The backend.auth.keys config has been replaced by backend.auth.externalAccess, see https://backstage.io/docs/auth/service-to-service-auth","service":"backstage","timestamp":"2024-07-23 08:19:11"}
      {"level":"info","message":"Serving static app content from /opt/app-root/src/packages/app/dist","plugin":"app","service":"backstage","timestamp":"2024-07-23 08:19:12"}
      {"level":"warn","message":"DEPRECATION WARNING: The backend.auth.keys config has been replaced by backend.auth.externalAccess, see https://backstage.io/docs/auth/service-to-service-auth","service":"backstage","timestamp":"2024-07-23 08:19:12"}
      {"level":"info","message":"Loading kubernetes config from config file","plugin":"catalog","service":"backstage","timestamp":"2024-07-23 08:19:12"}
      /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1672
      throw new Error(
      ^
      Error: No extension point or service available for the following ref(s): serviceRef{events.service}
      at BackendInitializer.getInitDeps_fn (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1672:11)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
      at async /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1792:32
      at async processNode (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1309:22)
      at async Promise.all (index 3)
      at async processMoreNodes (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1304:7)
      at async _DependencyGraph.parallelTopologicalTraversal (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1315:5)
      at async /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1790:9
      at async Promise.all (index 1)
      at async BackendInitializer.doStart_fn (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1766:3)
      at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1626:5)
      at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1894:5)
      Node.js v20.12.2 

        1. screenshot-1.png
          screenshot-1.png
          158 kB
        2. screenshot-2.png
          screenshot-2.png
          132 kB
        3. rhdh-backstage-7d46974844-4fnwc-backstage-backend.log
          11 kB
        4. screenshot-3.png
          screenshot-3.png
          142 kB
        5. image-2024-07-23-13-48-40-702.png
          image-2024-07-23-13-48-40-702.png
          139 kB
        6. screenshot-4.png
          screenshot-4.png
          54 kB
        7. screenshot-5.png
          screenshot-5.png
          66 kB

              rh-ee-pknight Patrick Knight
              skhileri Subhash Khileri
              RHIDP - Dynamic Plugins
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: