Uploaded image for project: 'Cost Management'
  1. Cost Management
  2. COST-3900

GCP customer filtered data writing over daily files during download

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • 2023Q2
    • None
    • API
    • None
    • False
    • None
    • False

      Currently in our GCP downloader flow we send a single file to the `download_file` method at a time. The problem with this is when you have a large customer with multiple files to be processed! (multiple files for a single day)

      when we call 'create_daily_archives' within the download method we overwrite previously create daily archives for each new download_file with additional SAME DAY daily data. What we really need to be doing is passing the full list of downloaded files to the 'create_daily_archives' method so we can process them all in iteration. NOT OVERWRITING THEM.

              Unassigned Unassigned
              rhn-support-lcouzens Luke Couzens
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: