-
Sub-task
-
Resolution: Unresolved
-
Undefined
-
None
-
None
-
False
-
-
False
-
-
We need visibility into cost and usage patterns.
- Action: Implement middleware to capture token counts (prompt + completion) for every request.
- Storage: Store metrics in the database tagged by: Provider (e.g., Google, OpenAI), Model, and User_ID.