Uploaded image for project: 'Cost Management'
  1. Cost Management
  2. COST-3900

GCP customer filtered data writing over daily files during download

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • 2023Q2
    • None
    • API
    • None
    • False
    • None
    • False

      Currently in our GCP downloader flow we send a single file to the `download_file` method at a time. The problem with this is when you have a large customer with multiple files to be processed! (multiple files for a single day)

      when we call 'create_daily_archives' within the download method we overwrite previously create daily archives for each new download_file with additional SAME DAY daily data. What we really need to be doing is passing the full list of downloaded files to the 'create_daily_archives' method so we can process them all in iteration. NOT OVERWRITING THEM.

            Unassigned Unassigned
            rhn-support-lcouzens Luke Couzens
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: