Uploaded image for project: 'Teiid'
  1. Teiid
  2. TEIID-159

Modify our handling of BigDecimal division to use MathContext.DECIMAL128 as our rounding mode to improve scale and precision of results

    XMLWordPrintable

Details

    • Feature Request
    • Resolution: Done
    • Major
    • 7.0
    • 6.0.0
    • Server
    • None
    • Documentation (Ref Guide, User Guide, etc.), Release Notes, Compatibility/Configuration
    • Low

    Description

      Using MathContext.DECIMAL128 should give a more usable scale and precision to the results.

      Current behavior

      254403453878 / 21870000000 returns 12
      and
      254403453878.0001 / 21870000000 returns 11.6325

      Improved behavior:

      254403453878 / 21870000000 returns 11.632531
      and
      254403453878.0001 / 21870000000 returns 11.632531

      We should also investigate what the impact of this change will be on users who may be relying on our current behavior.

      Reference: This enhancement was suggested by Issue Tracker Issue 175485, contributed by Greg Haber

      Attachments

        Issue Links

          relates to

          Bug - A problem that impairs or prevents the functions of the product. TEIID-7 Control of BigDecimal precision and scale

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              ghelblin Jerry Helbling (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: