Uploaded image for project: 'JBoss Transaction Manager'
  1. JBoss Transaction Manager
  2. JBTM-3369

ArjunaJTS/interop/glassfish hangs on AMS CI with no progress while the JBoss is started

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Minor
    • 5.11.0.Final
    • 5.10.6.Final
    • Quickstarts
    • None

    Description

      The `ArjunaJTS/interop/glassfish` quickstart hangs forever once per 5 runs - see the console log at time of the job is stuck[1].

      The JBoss is started while then there is no more processing in place.

      ++ awk '/wildfly-parent/ { while(!/<version>/) {getline;} print; }' pom.xml
      ++ cut -d '<' -f 2
      ++ cut -d '>' -f 2
      + WILDFLY_MASTER_VERSION=21.0.0.Final-SNAPSHOT
      + cp -rp build/target/wildfly-21.0.0.Final-SNAPSHOT/ /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/
      + cd /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish
      + rm -rf /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly/
      + WORKSPACE=/home/jenkins/workspace/narayana-quickstarts
      ++ timeout_adjust 3
      + sleep 3
      + echo '===== JTS interop quickstart: step 2 (start GlassFish):'
      + ./step2.sh
      ===== JTS interop quickstart: step 2 (start GlassFish):
      ++ '[' /home/jenkins/workspace/narayana-quickstarts ']'
      ++ '[' 5.10.7.Final-SNAPSHOT ']'
      ++ QS_DIR=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish
      ++ ls /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/
      ++ cd /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/
      +++ pwd
      ++ export JBOSS_HOME=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT
      ++ JBOSS_HOME=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT
      ++ cd -
      /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish
      ++ '[' -d /home/jenkins/glassfish4 ']'
      ++ GLASSFISH=/home/jenkins/glassfish4
      + set -ex
      + cd /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish
      + export PATH=/home/jenkins/glassfish4/bin:/home/jenkins/workspace/narayana-quickstarts/tools/maven/bin:/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/local/rvm/gems/ruby-2.4.9/bin:/usr/local/rvm/gems/ruby-2.4.9@global/bin:/usr/local/rvm/rubies/ruby-2.4.9/bin:/usr/local/bin:/usr/bin:/usr/local/rvm/bin
      + PATH=/home/jenkins/glassfish4/bin:/home/jenkins/workspace/narayana-quickstarts/tools/maven/bin:/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/local/rvm/gems/ruby-2.4.9/bin:/usr/local/rvm/gems/ruby-2.4.9@global/bin:/usr/local/rvm/rubies/ruby-2.4.9/bin:/usr/local/bin:/usr/bin:/usr/local/rvm/bin
      + asadmin start-domain domain1
      Waiting for domain1 to start .............................
      Successfully started the domain : domain1
      domain  Location: /home/jenkins/glassfish4/glassfish/domains/domain1
      Log File: /home/jenkins/glassfish4/glassfish/domains/domain1/logs/server.log
      Admin Port: 4848
      Command start-domain executed successfully.
      + asadmin set configs.config.server-config.network-config.network-listeners.network-listener.http-listener-1.port=7080
      configs.config.server-config.network-config.network-listeners.network-listener.http-listener-1.port=7080
      Command set executed successfully.
      ++ timeout_adjust 10
      + sleep 10
      + echo '===== JTS interop quickstart: step 3 (start WildFly):'
      + ./step3.sh
      ===== JTS interop quickstart: step 3 (start WildFly):
      ++ '[' /home/jenkins/workspace/narayana-quickstarts ']'
      ++ '[' 5.10.7.Final-SNAPSHOT ']'
      ++ QS_DIR=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish
      ++ ls /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/
      ++ cd /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/
      +++ pwd
      /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish
      ++ export JBOSS_HOME=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT
      ++ JBOSS_HOME=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT
      ++ cd -
      ++ '[' -d /home/jenkins/glassfish4 ']'
      ++ GLASSFISH=/home/jenkins/glassfish4
      + set -ex
      + '[' -d /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT ']'
      + cd /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT
      + ./bin/standalone.sh -c standalone-full.xml -Djboss.tx.node.id=1 -Dcom.arjuna.ats.jts.transactionServiceId=0
      ++ timeout_adjust 10
      + sleep 10
      =========================================================================
      
        JBoss Bootstrap Environment
      
        JBOSS_HOME: /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT
      
        JAVA: /usr/lib/jvm/java-1.8.0-openjdk/bin/java
      
        JAVA_OPTS:  -server -Xms64m -Xmx512m -XX:MetaspaceSize=96M -XX:MaxMetaspaceSize=256m -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true 
      
      =========================================================================
      
      09:37:45,421 INFO  [org.jboss.modules] (main) JBoss Modules version 1.10.2.Final
      09:37:45,667 INFO  [org.jboss.msc] (main) JBoss MSC version 1.4.12.Final
      09:37:45,675 INFO  [org.jboss.threads] (main) JBoss Threads version 2.4.0.Final
      09:37:45,785 INFO  [org.jboss.as] (MSC service thread 1-2) WFLYSRV0049: WildFly Full 21.0.0.Final-SNAPSHOT (WildFly Core 13.0.0.Beta6) starting
      09:37:46,421 INFO  [org.wildfly.security] (ServerService Thread Pool -- 16) ELY00001: WildFly Elytron version 1.13.0.Final
      09:37:46,860 INFO  [org.jboss.as.controller.management-deprecated] (Controller Boot Thread) WFLYCTL0028: Attribute 'security-realm' in the resource at address '/core-service=management/management-interface=http-interface' is deprecated, and may be removed in a future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation.
      09:37:46,877 INFO  [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 24) WFLYCTL0028: Attribute 'security-realm' in the resource at address '/subsystem=undertow/server=default-server/https-listener=https' is deprecated, and may be removed in a future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation.
      09:37:46,931 INFO  [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http)
      09:37:46,971 INFO  [org.xnio] (MSC service thread 1-4) XNIO version 3.8.2.Final
      09:37:46,986 INFO  [org.xnio.nio] (MSC service thread 1-4) XNIO NIO Implementation Version 3.8.2.Final
      09:37:47,020 INFO  [org.wildfly.extension.io] (ServerService Thread Pool -- 57) WFLYIO001: Worker 'default' has auto-configured to 48 IO threads with 384 max task threads based on your 24 available processors
      09:37:47,018 INFO  [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 56) WFLYCLINF0001: Activating Infinispan subsystem.
      09:37:47,055 WARN  [org.jboss.as.txn] (ServerService Thread Pool -- 80) WFLYTX0013: The node-identifier attribute on the /subsystem=transactions is set to the default value. This is a danger for environments running multiple servers. Please make sure the attribute value is unique.
      09:37:47,058 INFO  [org.jboss.as.jaxrs] (ServerService Thread Pool -- 58) WFLYRS0016: RESTEasy version 3.13.2.Final
      09:37:47,063 INFO  [org.jboss.as.webservices] (ServerService Thread Pool -- 82) WFLYWS0002: Activating WebServices Extension
      09:37:47,067 INFO  [org.wildfly.extension.microprofile.config.smallrye._private] (ServerService Thread Pool -- 67) WFLYCONF0001: Activating WildFly MicroProfile Config Subsystem
      09:37:47,069 INFO  [org.wildfly.extension.microprofile.jwt.smallrye._private] (ServerService Thread Pool -- 69) WFLYJWT0001: Activating WildFly MicroProfile JWT Subsystem
      09:37:47,077 INFO  [org.wildfly.extension.microprofile.opentracing] (ServerService Thread Pool -- 71) WFLYTRACEXT0001: Activating MicroProfile OpenTracing Subsystem
      09:37:47,075 INFO  [org.jboss.as.connector] (MSC service thread 1-5) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.4.23.Final)
      09:37:47,079 INFO  [org.wildfly.extension.microprofile.metrics.smallrye] (ServerService Thread Pool -- 70) WFLYMETRICS0001: Activating Eclipse MicroProfile Metrics Subsystem
      09:37:47,081 INFO  [org.jboss.as.jsf] (ServerService Thread Pool -- 63) WFLYJSF0007: Activated the following JSF Implementations: [main]
      09:37:47,086 INFO  [org.wildfly.extension.microprofile.health.smallrye] (ServerService Thread Pool -- 68) WFLYHEALTH0001: Activating Eclipse MicroProfile Health Subsystem
      09:37:47,095 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-7) WFLYUT0003: Undertow 2.2.0.Final starting
      09:37:47,805 INFO  [org.jboss.as.security] (ServerService Thread Pool -- 78) WFLYSEC0002: Activating Security Subsystem
      09:37:47,806 INFO  [org.jboss.as.naming] (ServerService Thread Pool -- 72) WFLYNAM0001: Activating Naming Subsystem
      09:37:47,808 INFO  [org.wildfly.iiop.openjdk] (ServerService Thread Pool -- 55) WFLYIIOP0001: Activating IIOP Subsystem
      09:37:47,821 INFO  [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 47) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.4)
      09:37:47,826 INFO  [org.jboss.as.security] (MSC service thread 1-2) WFLYSEC0001: Current PicketBox version=5.0.3.Final-redhat-00006
      09:37:47,828 INFO  [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-3) WFLYJCA0018: Started Driver service with driver-name = h2
      09:37:47,872 INFO  [org.jboss.as.naming] (MSC service thread 1-5) WFLYNAM0003: Starting Naming Service
      09:37:47,875 INFO  [org.jboss.as.mail.extension] (MSC service thread 1-3) WFLYMAIL0001: Bound mail session [java:jboss/mail/Default]
      09:37:47,942 INFO  [org.jboss.remoting] (MSC service thread 1-4) JBoss Remoting version 5.0.18.Final
      09:37:47,995 INFO  [org.wildfly.extension.undertow] (ServerService Thread Pool -- 81) WFLYUT0014: Creating file handler for path '/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/welcome-content' with options [directory-listing: 'false', follow-symlink: 'false', case-sensitive: 'true', safe-symlink-paths: '[]']
      09:37:48,032 INFO  [org.jboss.as.ejb3] (MSC service thread 1-4) WFLYEJB0482: Strict pool mdb-strict-max-pool is using a max instance size of 96 (per class), which is derived from the number of CPUs on this host.
      09:37:48,032 INFO  [org.jboss.as.ejb3] (MSC service thread 1-6) WFLYEJB0481: Strict pool slsb-strict-max-pool is using a max instance size of 384 (per class), which is derived from thread worker pool sizing.
      09:37:48,041 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-6) WFLYUT0012: Started server default-server.
      09:37:48,066 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-4) WFLYUT0018: Host default-host starting
      09:37:48,140 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-3) WFLYUT0006: Undertow HTTP listener default listening on 127.0.0.1:8080
      09:37:48,171 INFO  [org.jboss.as.patching] (MSC service thread 1-1) WFLYPAT0050: WildFly Full cumulative patch ID is: base, one-off patches include: none
      09:37:48,185 WARN  [org.jboss.as.domain.management.security] (MSC service thread 1-1) WFLYDM0111: Keystore /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/standalone/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost
      09:37:48,190 INFO  [org.jboss.as.server.deployment.scanner] (MSC service thread 1-6) WFLYDS0013: Started FileSystemDeploymentService for directory /home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/standalone/deployments
      09:37:48,200 INFO  [org.jboss.as.ejb3] (MSC service thread 1-2) WFLYEJB0493: EJB subsystem suspension complete
      09:37:48,400 INFO  [org.wildfly.extension.undertow] (MSC service thread 1-2) WFLYUT0006: Undertow HTTPS listener https listening on 127.0.0.1:8443
      09:37:48,428 INFO  [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS]
      09:37:48,431 INFO  [org.wildfly.iiop.openjdk] (MSC service thread 1-8) WFLYIIOP0009: CORBA ORB Service started
      09:37:48,482 INFO  [org.jboss.ws.common.management] (MSC service thread 1-6) JBWS022052: Starting JBossWS 5.4.2.Final (Apache CXF 3.3.7) 
      09:37:50,611 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221000: live Message Broker is starting with configuration Broker Configuration (clustered=false,journalDirectory=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/standalone/data/activemq/journal,bindingsDirectory=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/standalone/data/activemq/bindings,largeMessagesDirectory=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/standalone/data/activemq/largemessages,pagingDirectory=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/tmp/wildfly-21.0.0.Final-SNAPSHOT/standalone/data/activemq/paging)
      09:37:50,643 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221012: Using AIO Journal
      09:37:50,699 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE
      09:37:50,700 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP
      09:37:50,700 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ
      09:37:50,700 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP
      09:37:51,514 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221034: Waiting indefinitely to obtain live lock
      09:37:51,515 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221035: Live Server Obtained live lock
       ./bin/jboss-cli.sh --connect --file=/home/jenkins/workspace/narayana-quickstarts/ArjunaJTS/interop/glassfish/configure-jts-transactions.cli
      Failed to connect to the controller: Timeout waiting for the system to boot.
      09:38:01,080 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221003: Deploying ANYCAST queue jms.queue.ExpiryQueue on address jms.queue.ExpiryQueue
      09:38:01,309 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221003: Deploying ANYCAST queue jms.queue.DLQ on address jms.queue.DLQ
      09:38:01,392 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-4) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor acceptor
      09:38:01,392 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-3) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor-throughput acceptor
      09:38:01,392 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-1) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor acceptor
      09:38:01,394 INFO  [org.wildfly.extension.messaging-activemq] (MSC service thread 1-6) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor-throughput acceptor
      09:38:02,001 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221007: Server is now live
      09:38:02,001 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 84) AMQ221001: Apache ActiveMQ Artemis Message Broker version 2.10.1 [default, nodeID=995a3edc-07b7-11eb-8350-0242ac11000f] 
      09:38:02,026 INFO  [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 87) WFLYMSGAMQ0002: Bound messaging object to jndi name java:/ConnectionFactory
      09:38:02,028 INFO  [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 88) WFLYMSGAMQ0002: Bound messaging object to jndi name java:jboss/exported/jms/RemoteConnectionFactory
      09:38:02,082 INFO  [org.jboss.as.connector.deployment] (MSC service thread 1-4) WFLYJCA0007: Registered connection factory java:/JmsXA
      

      Attachments

        Activity

          People

            ochaloup@redhat.com Ondrej Chaloupka (Inactive)
            ochaloup@redhat.com Ondrej Chaloupka (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: