Uploaded image for project: 'Red Hat Developer Hub Bugs'
  1. Red Hat Developer Hub Bugs
  2. RHDHBUGS-2517

Topic summary generated is too complex with large models

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • 1.9.0
    • AI
    • None
    • RHDH AI Sprint 3286

      with a simple query on "What is Red Hat Developer Hub's capabilities?"
      llama4:scout generated the topic_summary as: "RedHat Developer Hub Capabilities \n\nor \n\nRed Hat Developer Hub Functionality \n\nor \n\nRedHat Developer Tools \n\n\nHowever most fitting \n\nRedHat Developer Hub Capabilities"

      with large models (llama4:scout in this screenshot), they often interpret a list of "Steps" as a requirement to show their work of the thinking stage, before giving the final answer. it perform a complex analysis and even show the alternatives it considered.

      we will need to update the prompt with more instructions & constraints

              yangcao Stephanie Cao
              yangcao Stephanie Cao
              RHDH AI
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: