Uploaded image for project: 'Red Hat Decision Manager'
  1. Red Hat Decision Manager
  2. RHDM-1097

Download failures when using offliner manifest file

XMLWordPrintable

    • CR1
    • ?
    • Workaround Exists
    • Hide

      As a workaround for setting up offline repository for Central, you can try following procedure in this document - https://docs.google.com/document/d/1k0wHMJOgdKJlDWXM--2FRCWvLo05dznkXjN7rQTDPLg/edit# It might be even better solution to this problem.
      But keep in mind that customers use-case can be different and he might not want to run in offline env and needs whole content of our maven repository for different use-cases.

      Show
      As a workaround for setting up offline repository for Central, you can try following procedure in this document - https://docs.google.com/document/d/1k0wHMJOgdKJlDWXM--2FRCWvLo05dznkXjN7rQTDPLg/edit# It might be even better solution to this problem. But keep in mind that customers use-case can be different and he might not want to run in offline env and needs whole content of our maven repository for different use-cases.
    • Hide

      $ java -jar ~/Downloads/offliner-1.7.jar -r https://maven.repository.redhat.com/ga/ -r https://repo1.maven.org/maven2/ -d /tmp/offliner/ ~/Downloads/rhdm-7.4.1-offliner.txt

      Show
      $ java -jar ~/Downloads/offliner-1.7.jar -r https://maven.repository.redhat.com/ga/ -r https://repo1.maven.org/maven2/ -d /tmp/offliner/ ~/Downloads/rhdm-7.4.1-offliner.txt
    • 2019 Week 41-43 (from Okt 7), 2019 Week 44-46 (from Okt 28), 2019 Week 47-49 (from Nov 18), 2019 Week 50-52 (from Dec 9), 2020 Week 01-03 (from Dec 30), 2020 Week 04-06 (from Jan 20), 2020 Week 07-09 (from Feb 10)

      Following the steps from the documentation and running the offliner tool with the rhdm-7.4.1-offliner.txt file results in the following:

      16546 downloads succeeded.
0 downloads avoided.
37483 downloads failed.

      2nd run (using failed-downloads.txt as per the docs):

      17762 downloads succeeded.
14 downloads avoided.
19721 downloads failed.
      • A success rate of 1:2.3 does not look very good for an enterprise product - why are there so many failures?
      • Why does the product need to download >50k files?
      • The manifest file contains the versions for 7.4.0 as well as 7.4.1 - this is unnecessary
      • There are references to files which don't exist in the JBoss maven repo

      Examples for the last two points:

      org/kie/workbench/stunner/kie-wb-common-stunner-backend-common/7.23.0.Final-redhat-00002/kie-wb-common-stunner-backend-common-7.23.0.Final-redhat-00002.jar
org/kie/workbench/stunner/kie-wb-common-stunner-backend-common/7.23.0.Final-redhat-00003/kie-wb-common-stunner-backend-common-7.23.0.Final-redhat-00003.jar

      and no stunner artifacts in https://maven.repository.redhat.com/ga/org/kie/workbench/.

        1. failed-downloads.txt_offline-repo-group-7-6
          259 kB
          Alexandros Koufoudakis
        2. missing-artifacts.txt
          1.32 MB
          Alexandros Koufoudakis

              akoufoud@redhat.com Alexandros Koufoudakis
              rhn-support-mputz Martin Weiler (Inactive)
              Dominik Hanak Dominik Hanak
              Dominik Hanak Dominik Hanak
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated:
                Resolved: