Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-11754

create upstream RFC for mapping model servers, models, into the catalog

    • RHDH AI Sprint 3287

      Background

      One of the motivators for upstreaming the connector was the spotify maintainer RFC https://github.com/backstage/backstage/issues/32062 aimed at aligning the community on how MCP Servers were modeled into the catalog

      The discussion details in many ways mirrored / paralleled the discussion RHDH AI had internally around modeling AI Models and AI Model Servers into the catalog.

      As such, although not exact matches per se, there is notable conceptual overlap between modeling MCP servers (and by extension, MCP registries and MCP tools) and AI models, model servers, and model registries.

      Recent SIG calls have some early feedback that were captured in the owning epic https://issues.redhat.com/browse/RHIDP-11685 

      Task particulars

      First, create a google doc for internal review of the RFC description content.

      Then, Open an analogous RFC for modeling AI models and model servers in the catalog, where we

      • cite the MCP server as reference, and as much as possible map the choices made for MCP to how we map AI models
        • NOTE:  option 3 from the MCP rfc appears to be the winner as of this writing
      • From an optional perspective, vet with upstream and the spotify maintainers our connector's use of Components and Resources, in addition to the API usage in the MCP RFC.  Let's make sure we understand WHY those won't considered for MCP, and if that same lack of consideration applies to AI models and models servers.
        • Or who knows, maybe our discussion influences updates to what is done for MCP
      • Additionally, given the lack of conformity wrt Model Registry APIs or Model Server APIs or Model APIs, as opposed to the single MCP Registry spec from Anthropic, introduce the notions of a normalization layer (ultimately expressed as the current connector's model/model server json schema) that can be consumed by an single ai model / model server entity provider.
      • After opening the RFC, next steps are captured in RHIDP-11755 

       

       

              gmontero@redhat.com Gabe Montero
              gmontero@redhat.com Gabe Montero
              RHDH AI
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: