Uploaded image for project: 'Red Hat Advanced Cluster Security'
  1. Red Hat Advanced Cluster Security
  2. ROX-31368

Incorrect data reported by Amplitude (Compliance Operator version and most used profiles)

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Normal Normal
    • None
    • 4.8.0, 4.9.0
    • Compliance Workflows
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Moderate

      USER PROBLEM

      The data that we recently incoorporated to Amplitude when we did Compliance 2.0 GA has the following issues  [ the last 2 graphs at the end of this dashboard https://app.amplitude.com/analytics/redhat/dashboard/h884vv5n?source=copy+url]:

      Issue 1: Compliance Operator Installation Status, which is supposed to report which CO version is installed in our clusters shows a lot of 'none' and many 'installed, version unknown' - 

       - Expectation: See only the counter of how many clusters don't have CO installed, or the specific version.

      Comment relevant for investigation: 
      Piotr - Sensor sends its package with metrics to Central periodically. When that package does not arrive, then the value in Central's memory is empty.
      There may be many reasons for that not being set - maybe sensor is pre 4.7 and does not include that field in the message?
      Maria - That could be some, yes, but as you can see more than 80% of the sensor clusters are 4.7+  and this is just too large to be the only reason.
      Is it ok I open a bug to look at how to get this data right? no need to look at it now, but we need to find the rootcause why the data is missing. Image provided

      Issue 2: The data which is supposed to point out which profiles are most used is also incorrect. Look at this
      CIS and BSI  almost report the same number of profiles used.

           

      If you look at the Dev Instances, you see the same 

       

      HOW TO REPRODUCE:

      Visit the last 2 graphs at the end of this dashboard https://app.amplitude.com/analytics/redhat/dashboard/h884vv5n?source=copy+url]

       

      HT

        1. image-2025-10-22-12-31-34-641.png
          134 kB
          Maria Simon Marcos
        2. image-2025-10-22-12-33-43-589.png
          509 kB
          Maria Simon Marcos
        3. image-2025-10-22-12-34-12-277.png
          502 kB
          Maria Simon Marcos
        4. image-2025-10-22-12-35-12-207.png
          496 kB
          Maria Simon Marcos
        5. image-2025-10-22-12-35-37-151.png
          496 kB
          Maria Simon Marcos
        6. Screenshot 2025-10-27 at 14.56.24.png
          61 kB
          Piotr Rygielski
        7. Screenshot 2025-10-27 at 14.56.29.png
          61 kB
          Piotr Rygielski
        8. Screenshot 2025-10-27 at 14.56.36.png
          60 kB
          Piotr Rygielski
        9. Screenshot 2025-10-27 at 14.56.58.png
          141 kB
          Piotr Rygielski

              prygiels@redhat.com Piotr Rygielski
              rh-ee-masimonm Maria Simon Marcos
              ACS Sensor & Ecosystem
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: