Problem

  The test triage agent is hallucinating (fabricating) JIRA issue IDs when analyzing CI/build failures. The agent would generate realistic-looking but fake issue IDs like "RHDHBUGS-2245" instead of calling the search_similar_jira_issues tool.

  This issue was specific to CI failure paths, while Playwright test failures worked correctly.

  Root Cause Analysis

  1. High temperature setting: The model was using the default temperature of 1.0, which encourages creative/hallucinatory behavior

  2. Less structured CI failure prompts: Playwright test failures had a multi-step workflow with mandatory intermediate tool calls, keeping the model in "tool-calling mode". CI failures had a simpler flow that allowed the model to skip tool calls.