Uploaded image for project: 'AppFormer'
  1. AppFormer
  2. AF-922

When repo cloned by rest, asset indexing is done for each repo branch

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • AppFormer Foundation
    • None
    • Hide

      Start the business-central and execute the following commands on command line (make sure to change the user credentials / business-central URL to something which exists in your setup).

      1. Create org unit:

      curl -H 'Content-Type: application/json' -u 'testadmin:admin1234;' -X POST -d '

      {"name":"MYOU","description":"","owner" : "janhrcek@redhat.com","defaultGroupId":"cz.janhrcek","repositories":[]}

      ' http://localhost:8080/decision-central/rest/organizationalunits

      2. Clone repo from github:

      curl -H 'Content-Type: application/json' -u 'testadmin:admin1234;' -X POST -d '

      {"name": "REPO_WITH_MANY_BRANCHES","organizationalUnitName":"MYOU","description":"","userName": "","password": "","requestType": "clone","gitURL": "https://github.com/kiegroup/kie-wb-playground/"}

      ' http://localhost:8080/decision-central/rest/repositories

      Expected results: assets are indexed once
      Actual results: Asset indexing is done separately many times, in this example:

      DM_7.0/DR1_eap7.1/bin]$grep 'Starting indexing\|Completed indexing' --color ../standalone/log/server.log 
      2017-12-06 14:24:51,556 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-112) Starting indexing of default://master@datasources/ ...
      2017-12-06 14:24:51,967 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-118) Starting indexing of default://master@datasets/ ...
      2017-12-06 14:24:52,695 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-118) Completed indexing of default://master@datasets/
      2017-12-06 14:24:52,796 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-112) Completed indexing of default://master@datasources/
      2017-12-06 14:24:53,246 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-115) Starting indexing of default://master@system_ou/plugins/ ...
      2017-12-06 14:24:53,375 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-115) Completed indexing of default://master@system_ou/plugins/
      2017-12-06 14:26:00,491 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://7.0.x@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:26:43,319 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://7.0.x@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:26:43,319 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://7.1.x@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:27:24,649 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://7.1.x@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:27:24,649 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://7.2.x@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:28:04,491 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://7.2.x@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:28:04,491 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://7.3.x@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:28:46,928 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://7.3.x@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:28:46,928 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://7.4.x@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:29:27,048 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://7.4.x@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:29:27,048 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://HEAD@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:30:07,153 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://HEAD@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:30:07,153 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://krisv-patch-1@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:30:47,421 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://krisv-patch-1@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:30:47,421 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://master@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:31:32,241 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://master@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:31:32,241 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.Beta7@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:31:49,622 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.Beta7@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:31:49,622 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.Beta8@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:32:22,284 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.Beta8@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:32:22,285 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.CR1@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:32:57,751 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.CR1@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:32:57,751 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.CR2@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:33:31,683 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.CR2@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:33:31,683 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.CR3@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:34:06,256 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.CR3@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:34:06,256 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.Final@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:34:41,467 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.Final@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:34:41,467 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.0.0.test@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:35:33,676 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.0.0.test@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:35:33,677 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.1.0.Beta1@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:36:35,763 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.1.0.Beta1@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:36:35,763 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.1.0.Beta2@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:37:49,311 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.1.0.Beta2@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:37:49,311 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.1.0.Beta3@REPO_WITH_MANY_BRANCHES/ ...
      2017-12-06 14:39:12,094 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Completed indexing of default://r7.1.0.Beta3@REPO_WITH_MANY_BRANCHES/
      2017-12-06 14:39:12,094 INFO  [org.uberfire.ext.metadata.io.BatchIndex] (Thread-144) Starting indexing of default://r7.1.0.Final@REPO_WITH_MANY_BRANCHES/ ...
      Show
      Start the business-central and execute the following commands on command line (make sure to change the user credentials / business-central URL to something which exists in your setup). 1. Create org unit: curl -H 'Content-Type: application/json' -u 'testadmin:admin1234;' -X POST -d ' {"name":"MYOU","description":"","owner" : "janhrcek@redhat.com","defaultGroupId":"cz.janhrcek","repositories":[]} ' http://localhost:8080/decision-central/rest/organizationalunits 2. Clone repo from github: curl -H 'Content-Type: application/json' -u 'testadmin:admin1234;' -X POST -d ' {"name": "REPO_WITH_MANY_BRANCHES","organizationalUnitName":"MYOU","description":"","userName": "","password": "","requestType": "clone","gitURL": "https://github.com/kiegroup/kie-wb-playground/"} ' http://localhost:8080/decision-central/rest/repositories Expected results: assets are indexed once Actual results: Asset indexing is done separately many times, in this example: DM_7.0/DR1_eap7.1/bin]$grep 'Starting indexing\|Completed indexing' --color ../standalone/log/server.log 2017-12-06 14:24:51,556 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -112) Starting indexing of default : //master@datasources/ ... 2017-12-06 14:24:51,967 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -118) Starting indexing of default : //master@datasets/ ... 2017-12-06 14:24:52,695 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -118) Completed indexing of default : //master@datasets/ 2017-12-06 14:24:52,796 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -112) Completed indexing of default : //master@datasources/ 2017-12-06 14:24:53,246 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -115) Starting indexing of default : //master@system_ou/plugins/ ... 2017-12-06 14:24:53,375 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -115) Completed indexing of default : //master@system_ou/plugins/ 2017-12-06 14:26:00,491 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //7.0.x@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:26:43,319 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //7.0.x@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:26:43,319 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //7.1.x@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:27:24,649 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //7.1.x@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:27:24,649 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //7.2.x@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:28:04,491 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //7.2.x@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:28:04,491 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //7.3.x@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:28:46,928 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //7.3.x@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:28:46,928 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //7.4.x@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:29:27,048 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //7.4.x@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:29:27,048 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //HEAD@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:30:07,153 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //HEAD@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:30:07,153 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //krisv-patch-1@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:30:47,421 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //krisv-patch-1@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:30:47,421 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //master@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:31:32,241 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //master@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:31:32,241 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.Beta7@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:31:49,622 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.Beta7@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:31:49,622 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.Beta8@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:32:22,284 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.Beta8@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:32:22,285 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.CR1@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:32:57,751 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.CR1@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:32:57,751 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.CR2@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:33:31,683 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.CR2@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:33:31,683 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.CR3@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:34:06,256 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.CR3@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:34:06,256 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.Final@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:34:41,467 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.Final@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:34:41,467 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.0.0.test@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:35:33,676 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.0.0.test@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:35:33,677 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.1.0.Beta1@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:36:35,763 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.1.0.Beta1@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:36:35,763 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.1.0.Beta2@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:37:49,311 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.1.0.Beta2@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:37:49,311 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.1.0.Beta3@REPO_WITH_MANY_BRANCHES/ ... 2017-12-06 14:39:12,094 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Completed indexing of default : //r7.1.0.Beta3@REPO_WITH_MANY_BRANCHES/ 2017-12-06 14:39:12,094 INFO [org.uberfire.ext.metadata.io.BatchIndex] ( Thread -144) Starting indexing of default : //r7.1.0.Final@REPO_WITH_MANY_BRANCHES/ ...
    • NEW
    • NEW

      When I clone a repo to kie-wb via REST, the assets are indexed for every branch from the origin repository (that is TWICE at minimum for every repo - master and HEAD - which corresponds to everything what you see when you run `git branch -a`).

              eignatow Eder Ignatowicz
              jhrcek Jan Hrcek (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: