Two major deliverables here:

• use generateCatalogIndex.sh in CI process
• enhance generateCatalogIndex to include pinned digests in https://gitlab.cee.redhat.com/rhidp/rhdh-plugin-catalog/-/blob/rhdh-1-rhel-9/catalog-index/index.json

Requires:

• Must fetch from workspaces/*/metadata and merge into catalog-index/catalog-entities
• Must generate all.yaml files to include content in the plugins/ and packages/ folders

• Must filter by support level to exclude devpreview/community content (as those go in another index image)
  • this filtering needs to be smart enough to key in on support level so we can reuse the script to create an index with ONLY community/DP content or everything but community content (TP/GA)
  • Moved to RHIDP-9840
    —

• When creating the catalog index image for the productized plugins, we should replace :1.9 with @sha256:... (pinned digests) so that airgapping is easier/better.
  • provide a comment in the file referring to the tag and build timestamp
  • Affected files: catalog entities (packages), dynamic-plugins.default.yaml
  • Moved to RHIDP-9839

• This should happen every time a new plugin is published.

This should happen via a GL pipeline like we have for operator-bundle and FBC rebuilds (see https://gitlab.cee.redhat.com/rhidp/rhdh/-/blob/rhdh-1-rhel-9/build/ci/update-bundle-and-FBCs.sh ) for each new hub/operator image, such that every time the GL pipeline runs to see if there's anything new to do, it can

• update the plugin_builds/ folder with metadata: dates and digests of plugins so we can easily see if the latest build in quay is the most current one (and therefore if the index needs a respin)
• facilitate building the index image with a WYSIWYG approach instead of generating content on the fly during the index build – thus https://gitlab.cee.redhat.com/rhidp/rhdh-plugin-catalog/-/blob/rhdh-1-rhel-9/build/containerfiles/index.Containerfile?ref_type=heads#L6-7 remains dirt-simple and instead it's the sync-midstream.sh script that handles the regular updates to the GL repo.

• Note that generateCatalogIndex.sh is not currently tied into any CI processes, so we would need to get that wired into https://gitlab.cee.redhat.com/rhidp/rhdh-plugin-catalog/-/tree/rhdh-1-rhel-9/build/ci so it can run regularly.

• Until we can move dynamic-plugins.default.yaml into the overlays repo and consume it from there, we need to pull the latest file from rhdh repo directly
  • See also RHIDP-9835 (move DPDY from RHDH to overlays) and RHIDP-9760 (consume DPDY from catalog index) which are prereqs / block this complete solution

• Also need process documentation about this: see https://gitlab.cee.redhat.com/rhidp/rhdh/-/blob/rhdh-1-rhel-9/docs/RELEASE_GUIDE_plugin_catalog.adoc#user-content-plugin-catalog-index
  • See RHIDP-9841