• Icon: Sub-task Sub-task
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • None
    • Kiali
    • False
    • Hide

      None

      Show
      None
    • False

      We need visibility into cost and usage patterns.

      • Action: Implement middleware to capture token counts (prompt + completion) for every request.
      • Storage: Store metrics in the database tagged by: Provider (e.g., Google, OpenAI), Model, and User_ID.

              Unassigned Unassigned
              agutierr@redhat.com Alberto Jesus Gutierrez Juanes
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: