Uploaded image for project: 'Red Hat 3scale API Management'
  1. Red Hat 3scale API Management
  2. THREESCALE-11753

Add more decimals to unit costs

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Unresolved
    • Icon: Minor Minor
    • None
    • 2.14.0 GA
    • System
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Not Started
    • Not Started
    • Not Started
    • Not Started
    • Not Started
    • Not Started

      When working with some APIs like the ones for LLMs, "standard" rates are like 1-5 $/million tokens.

      We now have a custom policy (or maybe already builtin in newer versions) to count the tokens emitted in a particular request. However, we can not add any cost linked to those metrics because it seems that unit costs are limited to 4 decimals (0.0001 $/metric), whereas we would need at least 6 for 1$/million token.

      Ideally, we should be able to go down to at least 8 decimals (in case of 1 cent/million token), or even no specific lower limits (except the one on the parameter type)

              cbartlet Catherine Bartlett
              gmoutier@redhat.com Guillaume Moutier
              Andrew Mackenzie, An Tran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: