Uploaded image for project: 'Hybrid Cloud Console'
  1. Hybrid Cloud Console
  2. RHCLOUD-34983

[PDF-Gen] Allow S3 Client to handle more than 50 connections

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Unset
    • None
    • Plat-Ex Services Sprint 23, Plat-Ex Services Sprint 24

      When the PDF generator has more than 40 slices (essentially pagination calls), the download call fails with the error:
      "@smithy/node-http-handler:WARN socket usage at capacity=50 and 190 additional requests are enqueued. See https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/node-configuring-maxsockets.html or increase socketAcquisitionWarningTimeout=(millis) in the NodeHttpHandler config."

      The PDF generates correctly, but the download will fail since all the slices need to be pulled down from S3 to be merged. The fix here is to update our S3 client config to handle more than 50 connection. I think 300 is probably a good upper limit since this is already a massive amount of data.

      https://stackoverflow.com/a/77916255 is a good example of what needs to be updated in the object store file https://github.com/RedHatInsights/pdf-generator/blob/main/src/common/objectStore.ts#L41

              bholifie Blake Holifield
              bholifie Blake Holifield
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: