2025-03-27T14:42:32.1239902Z 14:42:31,934 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Iteration 29 start
2025-03-27T14:42:32.1241412Z 14:42:31,934 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Killing node
2025-03-27T14:42:32.1243086Z 14:42:31,934 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Simulating failure
2025-03-27T14:42:32.1244491Z 14:42:31,935 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Killing backend node: auth-server-quarkus-backend1
2025-03-27T14:42:32.1245523Z Log has ended
2025-03-27T14:42:32.1247023Z 2025-03-27 14:42:31,954 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 36 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster=ISPN]
2025-03-27T14:42:32.1248363Z 2025-03-27 14:42:31,954 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#74, conn_id=0)
2025-03-27T14:42:32.1249237Z Mar 27, 2025 2:42:31 PM org.jboss.arquillian.container.test.impl.client.container.ClientContainerController kill
2025-03-27T14:42:32.1249877Z INFO: Hard killing of a server instance
2025-03-27T14:42:32.1250391Z Mar 27, 2025 2:42:31 PM org.jboss.arquillian.container.impl.DefaultServerKillProcessor kill
2025-03-27T14:42:32.1251121Z WARNING: Triggering default implementation of a server kill() command => using stop() internally
2025-03-27T14:42:32.1251819Z 2025-03-27 14:42:31,954 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#74
2025-03-27T14:42:32.1252896Z 2025-03-27 14:42:31,954 INFO  [org.infinispan.CLUSTER] () [Context=authenticationSessions] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1254011Z 2025-03-27 14:42:31,954 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1897
2025-03-27T14:42:32.1254744Z 2025-03-27 14:42:31,954 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2223, headers are NAKACK2: [MSG, seqno=1897], TP: [cluster=ISPN]
2025-03-27T14:42:32.1255567Z 2025-03-27 14:42:31,954 TRACE [org.jgroups.protocols.MFC] () node2 used 2178 credits, 3236036 remaining
2025-03-27T14:42:32.1256103Z 2025-03-27 14:42:31,955 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1898
2025-03-27T14:42:32.1256815Z 2025-03-27 14:42:31,955 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2222, headers are NAKACK2: [MSG, seqno=1898], TP: [cluster=ISPN]
2025-03-27T14:42:32.1257544Z 2025-03-27 14:42:31,955 TRACE [org.jgroups.protocols.MFC] () node2 used 2177 credits, 3233859 remaining
2025-03-27T14:42:32.1258182Z 2025-03-27 14:42:31,955 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#46, conn_id=30)
2025-03-27T14:42:32.1259159Z 2025-03-27 14:42:31,955 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1260101Z 2025-03-27 14:42:31,955 TRACE [org.jgroups.protocols.UFC] () node1 used 36 credits, 3997464 remaining
2025-03-27T14:42:32.1261172Z 2025-03-27 14:42:31,965 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 22 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=75, TP: [cluster=ISPN]
2025-03-27T14:42:32.1262454Z 2025-03-27 14:42:31,965 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#75, conn_id=0)
2025-03-27T14:42:32.1263003Z 2025-03-27 14:42:31,965 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#75
2025-03-27T14:42:32.1263618Z 2025-03-27 14:42:31,965 WARN  [org.infinispan.CLUSTER] () [Context=sessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:32.1264358Z 2025-03-27 14:42:31,965 INFO  [org.infinispan.CLUSTER] () [Context=sessions] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1265007Z 2025-03-27 14:42:31,965 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1899
2025-03-27T14:42:32.1265725Z 2025-03-27 14:42:31,965 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2209, headers are NAKACK2: [MSG, seqno=1899], TP: [cluster=ISPN]
2025-03-27T14:42:32.1266445Z 2025-03-27 14:42:31,965 TRACE [org.jgroups.protocols.MFC] () node2 used 2164 credits, 3231695 remaining
2025-03-27T14:42:32.1266976Z 2025-03-27 14:42:31,966 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1900
2025-03-27T14:42:32.1267683Z 2025-03-27 14:42:31,966 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2208, headers are NAKACK2: [MSG, seqno=1900], TP: [cluster=ISPN]
2025-03-27T14:42:32.1268387Z 2025-03-27 14:42:31,966 TRACE [org.jgroups.protocols.MFC] () node2 used 2163 credits, 3229532 remaining
2025-03-27T14:42:32.1268947Z 2025-03-27 14:42:31,966 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#47, conn_id=30)
2025-03-27T14:42:32.1269888Z 2025-03-27 14:42:31,966 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1270815Z 2025-03-27 14:42:31,966 TRACE [org.jgroups.protocols.UFC] () node1 used 22 credits, 3997442 remaining
2025-03-27T14:42:32.1271805Z 2025-03-27 14:42:31,969 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 28 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=76, TP: [cluster=ISPN]
2025-03-27T14:42:32.1273009Z 2025-03-27 14:42:31,969 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#76, conn_id=0)
2025-03-27T14:42:32.1273549Z 2025-03-27 14:42:31,969 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#76
2025-03-27T14:42:32.1274184Z 2025-03-27 14:42:31,969 WARN  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:32.1275049Z 2025-03-27 14:42:31,970 INFO  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1275719Z 2025-03-27 14:42:31,970 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1901
2025-03-27T14:42:32.1276431Z 2025-03-27 14:42:31,970 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2215, headers are NAKACK2: [MSG, seqno=1901], TP: [cluster=ISPN]
2025-03-27T14:42:32.1277204Z 2025-03-27 14:42:31,970 TRACE [org.jgroups.protocols.MFC] () node2 used 2170 credits, 3227362 remaining
2025-03-27T14:42:32.1277743Z 2025-03-27 14:42:31,970 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1902
2025-03-27T14:42:32.1278446Z 2025-03-27 14:42:31,970 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2214, headers are NAKACK2: [MSG, seqno=1902], TP: [cluster=ISPN]
2025-03-27T14:42:32.1279159Z 2025-03-27 14:42:31,970 TRACE [org.jgroups.protocols.MFC] () node2 used 2169 credits, 3225193 remaining
2025-03-27T14:42:32.1279712Z 2025-03-27 14:42:31,971 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#48, conn_id=30)
2025-03-27T14:42:32.1280714Z 2025-03-27 14:42:31,971 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1281650Z 2025-03-27 14:42:31,971 TRACE [org.jgroups.protocols.UFC] () node1 used 28 credits, 3997414 remaining
2025-03-27T14:42:32.1282825Z 2025-03-27 14:42:31,975 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 18 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=77, TP: [cluster=ISPN]
2025-03-27T14:42:32.1283826Z 2025-03-27 14:42:31,975 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#77, conn_id=0)
2025-03-27T14:42:32.1284370Z 2025-03-27 14:42:31,975 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#77
2025-03-27T14:42:32.1285004Z 2025-03-27 14:42:31,975 INFO  [org.infinispan.CLUSTER] () [Context=work] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1285648Z 2025-03-27 14:42:31,975 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1903
2025-03-27T14:42:32.1286361Z 2025-03-27 14:42:31,975 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1187, headers are NAKACK2: [MSG, seqno=1903], TP: [cluster=ISPN]
2025-03-27T14:42:32.1287161Z 2025-03-27 14:42:31,975 TRACE [org.jgroups.protocols.MFC] () node2 used 1142 credits, 3224051 remaining
2025-03-27T14:42:32.1287809Z 2025-03-27 14:42:31,976 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1904
2025-03-27T14:42:32.1288528Z 2025-03-27 14:42:31,977 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1186, headers are NAKACK2: [MSG, seqno=1904], TP: [cluster=ISPN]
2025-03-27T14:42:32.1289254Z 2025-03-27 14:42:31,977 TRACE [org.jgroups.protocols.MFC] () node2 used 1141 credits, 3222910 remaining
2025-03-27T14:42:32.1289829Z 2025-03-27 14:42:31,977 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#49, conn_id=30)
2025-03-27T14:42:32.1290776Z 2025-03-27 14:42:31,978 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1291801Z 2025-03-27 14:42:31,978 TRACE [org.jgroups.protocols.UFC] () node1 used 18 credits, 3997396 remaining
2025-03-27T14:42:32.1292929Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 27 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=78, TP: [cluster=ISPN]
2025-03-27T14:42:32.1294010Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#78, conn_id=0)
2025-03-27T14:42:32.1294578Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#78
2025-03-27T14:42:32.1295490Z 2025-03-27 14:42:31,980 INFO  [org.infinispan.CLUSTER] () [Context=loginFailures] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1296176Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1905
2025-03-27T14:42:32.1296967Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2214, headers are NAKACK2: [MSG, seqno=1905], TP: [cluster=ISPN]
2025-03-27T14:42:32.1297723Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.MFC] () node2 used 2169 credits, 3220741 remaining
2025-03-27T14:42:32.1298269Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1906
2025-03-27T14:42:32.1298983Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2213, headers are NAKACK2: [MSG, seqno=1906], TP: [cluster=ISPN]
2025-03-27T14:42:32.1299755Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.MFC] () node2 used 2168 credits, 3218573 remaining
2025-03-27T14:42:32.1300318Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#50, conn_id=30)
2025-03-27T14:42:32.1301273Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1302310Z 2025-03-27 14:42:31,980 TRACE [org.jgroups.protocols.UFC] () node1 used 27 credits, 3997369 remaining
2025-03-27T14:42:32.1303298Z 2025-03-27 14:42:31,983 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 35 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=79, TP: [cluster=ISPN]
2025-03-27T14:42:32.1304294Z 2025-03-27 14:42:31,983 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#79, conn_id=0)
2025-03-27T14:42:32.1304836Z 2025-03-27 14:42:31,983 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#79
2025-03-27T14:42:32.1305500Z 2025-03-27 14:42:31,983 WARN  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:32.1306351Z 2025-03-27 14:42:31,984 INFO  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1307048Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1907
2025-03-27T14:42:32.1307768Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2222, headers are NAKACK2: [MSG, seqno=1907], TP: [cluster=ISPN]
2025-03-27T14:42:32.1308482Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.MFC] () node2 used 2177 credits, 3216396 remaining
2025-03-27T14:42:32.1309013Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1908
2025-03-27T14:42:32.1309713Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2221, headers are NAKACK2: [MSG, seqno=1908], TP: [cluster=ISPN]
2025-03-27T14:42:32.1310505Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.MFC] () node2 used 2176 credits, 3214220 remaining
2025-03-27T14:42:32.1311066Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#51, conn_id=30)
2025-03-27T14:42:32.1312010Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1313086Z 2025-03-27 14:42:31,984 TRACE [org.jgroups.protocols.UFC] () node1 used 35 credits, 3997334 remaining
2025-03-27T14:42:32.1314074Z 2025-03-27 14:42:31,987 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 35 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=80, TP: [cluster=ISPN]
2025-03-27T14:42:32.1315066Z 2025-03-27 14:42:31,987 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#80, conn_id=0)
2025-03-27T14:42:32.1315684Z 2025-03-27 14:42:31,987 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#80
2025-03-27T14:42:32.1316377Z 2025-03-27 14:42:31,987 INFO  [org.infinispan.CLUSTER] () [Context=org.infinispan.CONFIG] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1317067Z 2025-03-27 14:42:32,007 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1909
2025-03-27T14:42:32.1317775Z 2025-03-27 14:42:32,007 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1204, headers are NAKACK2: [MSG, seqno=1909], TP: [cluster=ISPN]
2025-03-27T14:42:32.1318548Z 2025-03-27 14:42:32,007 TRACE [org.jgroups.protocols.MFC] () node2 used 1159 credits, 3213061 remaining
2025-03-27T14:42:32.1319082Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1910
2025-03-27T14:42:32.1319783Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1203, headers are NAKACK2: [MSG, seqno=1910], TP: [cluster=ISPN]
2025-03-27T14:42:32.1320490Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.MFC] () node2 used 1158 credits, 3211903 remaining
2025-03-27T14:42:32.1321042Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#52, conn_id=30)
2025-03-27T14:42:32.1321982Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1323011Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.UFC] () node1 used 35 credits, 3997299 remaining
2025-03-27T14:42:32.1323535Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#80)
2025-03-27T14:42:32.1324249Z 2025-03-27 14:42:32,009 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=80, ts=168, TP: [cluster=ISPN]
2025-03-27T14:42:32.1325418Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 29 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=81, TP: [cluster=ISPN]
2025-03-27T14:42:32.1326406Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#81, conn_id=0)
2025-03-27T14:42:32.1326948Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#81
2025-03-27T14:42:32.1327593Z 2025-03-27 14:42:32,014 WARN  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:32.1328388Z 2025-03-27 14:42:32,014 INFO  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1329140Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1911
2025-03-27T14:42:32.1329848Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2216, headers are NAKACK2: [MSG, seqno=1911], TP: [cluster=ISPN]
2025-03-27T14:42:32.1330569Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.MFC] () node2 used 2171 credits, 3209732 remaining
2025-03-27T14:42:32.1331165Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1912
2025-03-27T14:42:32.1331872Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2215, headers are NAKACK2: [MSG, seqno=1912], TP: [cluster=ISPN]
2025-03-27T14:42:32.1332810Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.MFC] () node2 used 2170 credits, 3207562 remaining
2025-03-27T14:42:32.1333376Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#53, conn_id=30)
2025-03-27T14:42:32.1334409Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1335342Z 2025-03-27 14:42:32,014 TRACE [org.jgroups.protocols.UFC] () node1 used 29 credits, 3997270 remaining
2025-03-27T14:42:32.1336325Z 2025-03-27 14:42:32,017 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 26 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=82, TP: [cluster=ISPN]
2025-03-27T14:42:32.1337371Z 2025-03-27 14:42:32,017 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#82, conn_id=0)
2025-03-27T14:42:32.1337914Z 2025-03-27 14:42:32,017 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#82
2025-03-27T14:42:32.1338602Z 2025-03-27 14:42:32,018 INFO  [org.infinispan.CLUSTER] () [Context=actionTokens] ISPN100008: Updating cache members list [node2], topology id 152
2025-03-27T14:42:32.1345968Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1913
2025-03-27T14:42:32.1346770Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2213, headers are NAKACK2: [MSG, seqno=1913], TP: [cluster=ISPN]
2025-03-27T14:42:32.1347542Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.MFC] () node2 used 2168 credits, 3205394 remaining
2025-03-27T14:42:32.1348099Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1914
2025-03-27T14:42:32.1348833Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2212, headers are NAKACK2: [MSG, seqno=1914], TP: [cluster=ISPN]
2025-03-27T14:42:32.1349589Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.MFC] () node2 used 2167 credits, 3203227 remaining
2025-03-27T14:42:32.1350182Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#54, conn_id=30)
2025-03-27T14:42:32.1351152Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.1352081Z 2025-03-27 14:42:32,018 TRACE [org.jgroups.protocols.UFC] () node1 used 26 credits, 3997244 remaining
2025-03-27T14:42:32.1353186Z 2025-03-27 14:42:32,022 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=node1, UNICAST3: DATA, seqno=83, TP: [cluster=ISPN]
2025-03-27T14:42:32.1354028Z 2025-03-27 14:42:32,022 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#83, conn_id=0)
2025-03-27T14:42:32.1354574Z 2025-03-27 14:42:32,023 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#83
2025-03-27T14:42:32.1355327Z 2025-03-27 14:42:32,023 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: handleMembershipChange([LEAVE(node1)])
2025-03-27T14:42:32.1356063Z 2025-03-27 14:42:32,023 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: joiners=[], suspected=[], leaving=[node1], new view: [node2|60] (1) [node2]
2025-03-27T14:42:32.1356772Z 2025-03-27 14:42:32,023 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: sending LEAVE response to node1
2025-03-27T14:42:32.1357610Z 2025-03-27 14:42:32,023 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=58, headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster=ISPN]
2025-03-27T14:42:32.1358409Z 2025-03-27 14:42:32,023 DEBUG [org.jgroups.protocols.pbcast.GMS] () node2: installing view [node2|60] (1) [node2] (node1 left)
2025-03-27T14:42:32.1359087Z 2025-03-27 14:42:32,023 TRACE [org.jgroups.protocols.UNICAST3] () node2: closing connections of non members [node1]
2025-03-27T14:42:32.1359847Z 2025-03-27 14:42:32,024 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] () node2: removed node1 from xmit_table (not member anymore)
2025-03-27T14:42:32.1360623Z 2025-03-27 14:42:32,026 DEBUG [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57801]-4,node2) node2: connection to node1 closed
2025-03-27T14:42:32.1361410Z 2025-03-27 14:42:32,026 DEBUG [org.jgroups.protocols.FD_SOCK2] (ForkJoinPool.commonPool-worker-2) node2: broadcasting suspect([node1])
2025-03-27T14:42:32.1362719Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.TCP] (ForkJoinPool.commonPool-worker-2) node2: sending msg to null, src=node2, size=61, headers are FD_SOCK2: SUSPECT, mbrs=[node1], TP: [cluster=ISPN]
2025-03-27T14:42:32.1363992Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.TCP] (ForkJoinPool.commonPool-worker-2) node2: looping back message [node2 to <all>, 0 bytes], headers are FD_SOCK2: SUSPECT, mbrs=[node1], TP: [cluster=ISPN]
2025-03-27T14:42:32.1364930Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node2
2025-03-27T14:42:32.1365597Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.FD_SOCK2] () node2: received SUSPECT message from node2: suspects=[node1]
2025-03-27T14:42:32.1366195Z 2025-03-27 14:42:32,027 DEBUG [org.jgroups.protocols.FD_SOCK2] () node2: suspecting [node1]
2025-03-27T14:42:32.1366837Z 2025-03-27 14:42:32,027 DEBUG [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57801]-4,node2) node2: connection to node1 closed
2025-03-27T14:42:32.1367623Z 2025-03-27 14:42:32,027 DEBUG [org.jgroups.protocols.FD_SOCK2] (ForkJoinPool.commonPool-worker-2) node2: broadcasting suspect([node1])
2025-03-27T14:42:32.1368857Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.TCP] (ForkJoinPool.commonPool-worker-2) node2: sending msg to null, src=node2, size=61, headers are FD_SOCK2: SUSPECT, mbrs=[node1], TP: [cluster=ISPN]
2025-03-27T14:42:32.1370270Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.TCP] (ForkJoinPool.commonPool-worker-2) node2: looping back message [node2 to <all>, 0 bytes], headers are FD_SOCK2: SUSPECT, mbrs=[node1], TP: [cluster=ISPN]
2025-03-27T14:42:32.1371273Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.VERIFY_SUSPECT2] () verifying that [node1] is dead
2025-03-27T14:42:32.1372140Z 2025-03-27 14:42:32,027 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=73, headers are VERIFY_SUSPECT2: [ARE_YOU_DEAD], TP: [cluster=ISPN]
2025-03-27T14:42:32.1373180Z 2025-03-27 14:42:32,028 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:32.1374180Z 2025-03-27 14:42:32,028 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:32.1375143Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:32.1376016Z 2025-03-27 14:42:32,028 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: cleared table for cluster ISPN
2025-03-27T14:42:32.1376970Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf') ]
2025-03-27T14:42:32.1377931Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node2
2025-03-27T14:42:32.1378829Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.FD_SOCK2] () node2: received SUSPECT message from node2: suspects=[node1]
2025-03-27T14:42:32.1379549Z 2025-03-27 14:42:32,029 DEBUG [org.jgroups.protocols.FD_SOCK2] () node2: suspecting [node1]
2025-03-27T14:42:32.1380430Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=73, headers are VERIFY_SUSPECT2: [ARE_YOU_DEAD], TP: [cluster=ISPN]
2025-03-27T14:42:32.1381913Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (73 bytes): java.net.ConnectException: Connection refused, headers: VERIFY_SUSPECT2: [ARE_YOU_DEAD], TP: [cluster=ISPN]
2025-03-27T14:42:32.1383251Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:32.1383977Z 2025-03-27 14:42:32,029 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: removed node2 for cluster ISPN from database
2025-03-27T14:42:32.1385195Z 2025-03-27 14:42:32,029 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf'), ('node2'), ('ISPN'), ('172.17.0.1:7801'), ('TRUE'::boolean)) ]
2025-03-27T14:42:32.1386631Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:32.1387575Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:32.1388991Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (73 bytes): java.net.ConnectException: Connection refused, headers: VERIFY_SUSPECT2: [ARE_YOU_DEAD], TP: [cluster=ISPN]
2025-03-27T14:42:32.1390022Z 2025-03-27 14:42:32,030 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: inserted node2 for cluster ISPN
2025-03-27T14:42:32.1390610Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: wrote to backend store: [node2]
2025-03-27T14:42:32.1391129Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.UFC] () new membership: [node2]
2025-03-27T14:42:32.1391594Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.MFC] () new membership: [node2]
2025-03-27T14:42:32.1392118Z 2025-03-27 14:42:32,030 TRACE [org.jgroups.protocols.FRAG4] () node2: removed node1 from fragmentation table
2025-03-27T14:42:32.1392904Z 2025-03-27 14:42:32,030 INFO  [org.infinispan.CLUSTER] () ISPN000094: Received new cluster view for channel ISPN: [node2|60] (1) [node2]
2025-03-27T14:42:32.1393694Z 2025-03-27 14:42:32,030 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] () Reloading JGroups Certificate
2025-03-27T14:42:32.1394401Z 2025-03-27 14:42:32,033 INFO  [org.infinispan.CLUSTER] () ISPN100001: Node node1 left the cluster
2025-03-27T14:42:32.1394915Z 2025-03-27 14:42:32,033 INFO  [org.infinispan.CLUSTER] () ISPN100001: Node node1 left the cluster
2025-03-27T14:42:32.1395535Z 2025-03-27 14:42:32,033 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: mcasting view [node2|60], ref-view=[node2|59], left=[node1]
2025-03-27T14:42:32.1396168Z 2025-03-27 14:42:32,034 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1915
2025-03-27T14:42:32.1396939Z 2025-03-27 14:42:32,034 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=114, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1915], TP: [cluster=ISPN]
2025-03-27T14:42:32.2233541Z 2025-03-27 14:42:32,209 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#83)
2025-03-27T14:42:32.2235112Z 2025-03-27 14:42:32,210 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=83, ts=169, TP: [cluster=ISPN]
2025-03-27T14:42:32.2236261Z 2025-03-27 14:42:32,210 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:32.2237583Z 2025-03-27 14:42:32,210 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:32.2238705Z 2025-03-27 14:42:32,210 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:32.2240253Z 2025-03-27 14:42:32,210 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (61 bytes): java.net.ConnectException: Connection refused, headers: UNICAST3: ACK, seqno=83, ts=169, TP: [cluster=ISPN]
2025-03-27T14:42:32.3234862Z 2025-03-27 14:42:32,250 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=41, headers are NAKACK2: [HIGHEST_SEQNO, seqno=1915], TP: [cluster=ISPN]
2025-03-27T14:42:32.4235950Z 2025-03-27 14:42:32,328 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: updating the local digest with a stable message (coordinator): node2: [1915 (1915)]
2025-03-27T14:42:32.4237070Z 2025-03-27 14:42:32,328 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: handling digest from node2:
2025-03-27T14:42:32.4237651Z mine:   node2: [-1]
2025-03-27T14:42:32.4237916Z sender: node2: [1915]
2025-03-27T14:42:32.4238400Z result: node2: [1915]
2025-03-27T14:42:32.4238582Z 
2025-03-27T14:42:32.4239018Z 2025-03-27 14:42:32,328 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: sending stability msg node2: [1915]
2025-03-27T14:42:32.4240026Z 2025-03-27 14:42:32,328 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=84, headers are STABLE: [STABILITY] view-id= [node2|60], TP: [cluster=ISPN]
2025-03-27T14:42:32.4240962Z 2025-03-27 14:42:32,328 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: received stable digest node2: [1915 (1915)]
2025-03-27T14:42:32.4241705Z 2025-03-27 14:42:32,328 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: deleting msgs <= 1915 from node2
2025-03-27T14:42:32.4242670Z 14:42:32,403 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Node killed
2025-03-27T14:42:32.4243280Z 14:42:32,403 INFO  [org.keycloak.testsuite.util.WaitUtils] Wait: 100ms
2025-03-27T14:42:32.4243853Z 2025-03-27 14:42:32,410 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:32.4244929Z 2025-03-27 14:42:32,410 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.4246081Z 2025-03-27 14:42:32,410 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:32.4247011Z 2025-03-27 14:42:32,410 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:32.4247988Z 2025-03-27 14:42:32,410 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:32.4249454Z 2025-03-27 14:42:32,410 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.5236502Z Mar 27, 2025 2:42:32 PM org.jboss.arquillian.container.test.impl.client.container.ClientContainerController start
2025-03-27T14:42:32.5237378Z INFO: Manual starting of a server instance
2025-03-27T14:42:32.5237999Z 14:42:32,503 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Starting node
2025-03-27T14:42:32.5239292Z 14:42:32,503 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Bringing all backend nodes online
2025-03-27T14:42:32.5240400Z 14:42:32,503 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Starting backend node: auth-server-quarkus-backend1
2025-03-27T14:42:32.5241615Z 14:42:32,503 INFO  [org.keycloak.testsuite.arquillian.AuthServerTestEnricher] ************************auth-server-quarkus-backend1*****************************************************************************
2025-03-27T14:42:32.5243402Z 14:42:32,503 DEBUG [org.keycloak.testsuite.arquillian.containers.AbstractQuarkusDeployableContainer] FIPS Mode: disabled
2025-03-27T14:42:32.5244691Z 14:42:32,503 DEBUG [org.keycloak.testsuite.arquillian.containers.AbstractQuarkusDeployableContainer] Store 'JPA' is used.
2025-03-27T14:42:32.5247344Z 14:42:32,503 DEBUG [org.keycloak.testsuite.arquillian.containers.KeycloakQuarkusServerDeployableContainer] Quarkus process arguments: [./kc.sh, -v, start, --http-enabled=true, --http-port=8181, --https-port=8544, --http-relative-path=/auth, --health-enabled=true, --http-management-port=9000, -Djboss.node.name=node1, -Dauth.server.host=localhost, --cache=ispn, --cache-config-file=cluster-ha.xml, --log-level=org.jgroups.protocols:trace, --db=postgres, --db-username=keycloak, --db-*** --db-url=jdbc:postgresql://172.17.0.2:5432/keycloak]
2025-03-27T14:42:32.6237541Z JAVA_OPTS already set in environment; overriding default settings
2025-03-27T14:42:32.6243201Z 2025-03-27 14:42:32,611 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:32.6244930Z 2025-03-27 14:42:32,611 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.6246127Z 2025-03-27 14:42:32,611 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:32.6247012Z 2025-03-27 14:42:32,611 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:32.6247988Z 2025-03-27 14:42:32,611 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:32.6249877Z 2025-03-27 14:42:32,611 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.8264793Z 2025-03-27 14:42:32,811 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:32.8269037Z 2025-03-27 14:42:32,811 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:32.8271023Z 2025-03-27 14:42:32,811 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:32.8272837Z 2025-03-27 14:42:32,811 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:32.8274383Z 2025-03-27 14:42:32,811 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:32.8277124Z 2025-03-27 14:42:32,811 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.0284355Z 2025-03-27 14:42:33,011 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:33.0286548Z 2025-03-27 14:42:33,011 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.0288451Z 2025-03-27 14:42:33,011 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:33.0289989Z 2025-03-27 14:42:33,012 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:33.0291190Z 2025-03-27 14:42:33,012 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:33.0292863Z 2025-03-27 14:42:33,012 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.1275730Z 2025-03-27 14:42:33,027 DEBUG [org.jgroups.protocols.VERIFY_SUSPECT2] (VERIFY_SUSPECT2.Runner-20) node2: sending up SUSPECT([node1])
2025-03-27T14:42:33.1277641Z 2025-03-27 14:42:33,027 TRACE [org.jgroups.protocols.pbcast.GMS] (VERIFY_SUSPECT2.Runner-20) node2: handleMembershipChange([SUSPECT(node1)])
2025-03-27T14:42:33.1279256Z 2025-03-27 14:42:33,027 TRACE [org.jgroups.protocols.pbcast.GMS] (VERIFY_SUSPECT2.Runner-20) node2: found no members to add or remove, will not create new view
2025-03-27T14:42:33.2275834Z 2025-03-27 14:42:33,212 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:33.2277084Z 2025-03-27 14:42:33,212 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.2279001Z 2025-03-27 14:42:33,212 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:33.2280544Z 2025-03-27 14:42:33,213 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:33.2282065Z 2025-03-27 14:42:33,213 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:33.2284581Z 2025-03-27 14:42:33,213 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.4284217Z 2025-03-27 14:42:33,413 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:33.4290673Z 2025-03-27 14:42:33,413 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.4292843Z 2025-03-27 14:42:33,413 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:33.4294448Z 2025-03-27 14:42:33,413 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:33.4296287Z 2025-03-27 14:42:33,413 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:33.4298595Z 2025-03-27 14:42:33,413 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.6302190Z 2025-03-27 14:42:33,614 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:33.6304194Z 2025-03-27 14:42:33,617 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.6306470Z 2025-03-27 14:42:33,617 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:33.6307985Z 2025-03-27 14:42:33,617 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:33.6309539Z 2025-03-27 14:42:33,617 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:33.6312043Z 2025-03-27 14:42:33,617 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.8298052Z 2025-03-27 14:42:33,818 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:33.8324102Z 2025-03-27 14:42:33,818 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:33.8325970Z 2025-03-27 14:42:33,818 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:33.8327464Z 2025-03-27 14:42:33,818 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:33.8328968Z 2025-03-27 14:42:33,818 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:33.8331293Z 2025-03-27 14:42:33,818 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.0301878Z 2025-03-27 14:42:34,018 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:34.0303852Z 2025-03-27 14:42:34,018 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.0305723Z 2025-03-27 14:42:34,018 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:34.0307227Z 2025-03-27 14:42:34,019 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:34.0308765Z 2025-03-27 14:42:34,019 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:34.0311466Z 2025-03-27 14:42:34,019 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.2325176Z 2025-03-27 14:42:34,219 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:34.2327708Z 2025-03-27 14:42:34,219 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.2329788Z 2025-03-27 14:42:34,219 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:34.2331491Z 2025-03-27 14:42:34,220 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:34.2334155Z 2025-03-27 14:42:34,220 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:34.2336450Z 2025-03-27 14:42:34,220 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.4327138Z 2025-03-27 14:42:34,420 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:34.4333222Z 2025-03-27 14:42:34,420 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.4338806Z 2025-03-27 14:42:34,421 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:34.4349137Z 2025-03-27 14:42:34,421 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:34.4358069Z 2025-03-27 14:42:34,421 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:34.4364237Z 2025-03-27 14:42:34,421 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.6329225Z 2025-03-27 14:42:34,621 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:34.6331040Z 2025-03-27 14:42:34,621 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.6333070Z 2025-03-27 14:42:34,621 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:34.6334588Z 2025-03-27 14:42:34,622 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:34.6336126Z 2025-03-27 14:42:34,622 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:34.6338466Z 2025-03-27 14:42:34,622 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.8397911Z 2025-03-27 14:42:34,825 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:34.8399829Z 2025-03-27 14:42:34,825 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:34.8402007Z 2025-03-27 14:42:34,825 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:34.8403761Z 2025-03-27 14:42:34,825 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:34.8405409Z 2025-03-27 14:42:34,825 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:34.8407991Z 2025-03-27 14:42:34,825 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.1359391Z 2025-03-27 14:42:35,025 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:35.1394245Z 2025-03-27 14:42:35,025 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.1396779Z 2025-03-27 14:42:35,025 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:35.1398608Z 2025-03-27 14:42:35,026 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:35.1400399Z 2025-03-27 14:42:35,026 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:35.1403079Z 2025-03-27 14:42:35,026 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.2358994Z 2025-03-27 14:42:35,226 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:35.2365648Z 2025-03-27 14:42:35,226 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.2371938Z 2025-03-27 14:42:35,226 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:35.2377901Z 2025-03-27 14:42:35,227 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:35.2383927Z 2025-03-27 14:42:35,227 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:35.2391607Z 2025-03-27 14:42:35,227 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.4367760Z 2025-03-27 14:42:35,426 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:35.4386436Z 2025-03-27 14:42:35,426 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.4388275Z 2025-03-27 14:42:35,427 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:35.4389993Z 2025-03-27 14:42:35,427 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:35.4391617Z 2025-03-27 14:42:35,427 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:35.4394278Z 2025-03-27 14:42:35,427 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.6394062Z 2025-03-27 14:42:35,628 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:35.6396183Z 2025-03-27 14:42:35,628 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.6413647Z 2025-03-27 14:42:35,628 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:35.6415753Z 2025-03-27 14:42:35,628 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:35.6417478Z 2025-03-27 14:42:35,628 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:35.6419983Z 2025-03-27 14:42:35,628 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.8396536Z 2025-03-27 14:42:35,829 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:35.8398363Z 2025-03-27 14:42:35,829 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:35.8400199Z 2025-03-27 14:42:35,829 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:35.8401691Z 2025-03-27 14:42:35,829 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:35.8403440Z 2025-03-27 14:42:35,829 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:35.8405730Z 2025-03-27 14:42:35,829 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.0396599Z 2025-03-27 14:42:36,029 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:36.0397897Z 2025-03-27 14:42:36,029 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.0399411Z 2025-03-27 14:42:36,029 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:36.0400742Z 2025-03-27 14:42:36,030 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:36.0402931Z 2025-03-27 14:42:36,030 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:36.0405349Z 2025-03-27 14:42:36,030 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.2406868Z 2025-03-27 14:42:36,230 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:36.2409013Z 2025-03-27 14:42:36,230 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.2416631Z 2025-03-27 14:42:36,230 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:36.2418200Z 2025-03-27 14:42:36,231 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:36.2419898Z 2025-03-27 14:42:36,231 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:36.2422510Z 2025-03-27 14:42:36,231 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.4448088Z 2025-03-27 14:42:36,384 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: updating the local digest with a stable message (coordinator): node2: [1915 (1915)]
2025-03-27T14:42:36.4449540Z 2025-03-27 14:42:36,384 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: handling digest from node2:
2025-03-27T14:42:36.4450343Z mine:   node2: [-1]
2025-03-27T14:42:36.4450696Z sender: node2: [1915]
2025-03-27T14:42:36.4451048Z result: node2: [1915]
2025-03-27T14:42:36.4451278Z 
2025-03-27T14:42:36.4451803Z 2025-03-27 14:42:36,384 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: sending stability msg node2: [1915]
2025-03-27T14:42:36.4453491Z 2025-03-27 14:42:36,384 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=84, headers are STABLE: [STABILITY] view-id= [node2|60], TP: [cluster=ISPN]
2025-03-27T14:42:36.4455024Z 2025-03-27 14:42:36,384 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: received stable digest node2: [1915 (1915)]
2025-03-27T14:42:36.4456251Z 2025-03-27 14:42:36,384 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: deleting msgs <= 1915 from node2
2025-03-27T14:42:36.4457333Z 2025-03-27 14:42:36,430 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:36.4459044Z 2025-03-27 14:42:36,430 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.4460888Z 2025-03-27 14:42:36,431 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:36.4462556Z 2025-03-27 14:42:36,431 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:36.4464412Z 2025-03-27 14:42:36,431 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:36.4466695Z 2025-03-27 14:42:36,431 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.6448883Z 2025-03-27 14:42:36,631 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:36.6452025Z 2025-03-27 14:42:36,631 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.6456110Z 2025-03-27 14:42:36,631 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:36.6459291Z 2025-03-27 14:42:36,631 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:36.6462087Z 2025-03-27 14:42:36,632 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:36.6466079Z 2025-03-27 14:42:36,632 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=30, TP: [cluster=ISPN]
2025-03-27T14:42:36.6482395Z 2025-03-27 14:42:36,632 DEBUG [org.jgroups.protocols.UNICAST3] () node2: removing expired connection for node1 (5002 ms old) from send_table
2025-03-27T14:42:36.6483949Z 2025-03-27 14:42:36,632 DEBUG [org.jgroups.protocols.UNICAST3] () node2: removing expired connection for node1 (5002 ms old) from recv_table
2025-03-27T14:42:36.6486101Z 2025-03-27 14:42:34,940 INFO  [org.keycloak.protocol.oidc.OIDCWellKnownProviderFactory] (main) Overriding default OIDC well-known endpoint configuration with the options from file 'classpath:wellknown/oidc-well-known-config-override.json'
2025-03-27T14:42:36.6488635Z 2025-03-27 14:42:34,941 WARN  [org.keycloak.truststore.FileTruststoreProviderFactory] (main) Using deprecated 'spi-truststore-file-*' options. Consider using 'truststore-paths' option.
2025-03-27T14:42:36.8495600Z 2025-03-27 14:42:36,833 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf') ]
2025-03-27T14:42:36.8496809Z 2025-03-27 14:42:36,834 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: removed node2 for cluster ISPN from database
2025-03-27T14:42:36.8498148Z 2025-03-27 14:42:36,834 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf'), ('node2'), ('ISPN'), ('172.17.0.1:7801'), ('TRUE'::boolean)) ]
2025-03-27T14:42:36.8499385Z 2025-03-27 14:42:36,834 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: inserted node2 for cluster ISPN
2025-03-27T14:42:36.8500123Z 2025-03-27 14:42:36,835 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: wrote to backend store: [node2]
2025-03-27T14:42:38.0515431Z 2025-03-27 14:42:37,952 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Starting Infinispan embedded cache manager
2025-03-27T14:42:38.0517483Z 2025-03-27 14:42:37,956 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) JGroups JDBC_PING discovery enabled.
2025-03-27T14:42:38.1518217Z 2025-03-27 14:42:38,088 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) JGroups Encryption enabled (mTLS).
2025-03-27T14:42:38.1523063Z 2025-03-27 14:42:38,089 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for sessions to 10000 entries.
2025-03-27T14:42:38.1529854Z 2025-03-27 14:42:38,089 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for clientSessions to 10000 entries.
2025-03-27T14:42:38.1536052Z 2025-03-27 14:42:38,089 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for offlineSessions to 10000 entries.
2025-03-27T14:42:38.1540283Z 2025-03-27 14:42:38,089 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for offlineClientSessions to 10000 entries.
2025-03-27T14:42:38.2533057Z 2025-03-27 14:42:38,195 INFO  [org.infinispan.CONTAINER] (main) Virtual threads support enabled
2025-03-27T14:42:38.3534235Z 2025-03-27 14:42:38,323 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] (main) Starting JGroups certificate reload manager
2025-03-27T14:42:38.4535546Z 2025-03-27 14:42:38,393 INFO  [org.infinispan.CONTAINER] (main) ISPN000556: Starting user marshaller 'org.infinispan.commons.marshall.ImmutableProtoStreamMarshaller'
2025-03-27T14:42:38.5536079Z 2025-03-27 14:42:38,538 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] () [Boot] reloading certificate.
2025-03-27T14:42:38.6537557Z 2025-03-27 14:42:38,564 TRACE [org.jgroups.protocols.JDBC_PING2] (main) null: SQL for initializing schema: wrapped[  ]
2025-03-27T14:42:38.6538829Z 2025-03-27 14:42:38,565 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) null: table created for JDBC_PING discovery protocol
2025-03-27T14:42:38.6540037Z 2025-03-27 14:42:38,566 TRACE [org.jgroups.protocols.UNICAST3] (main) null: set max_xmit_req_size from 0 to 511600
2025-03-27T14:42:38.6541235Z 2025-03-27 14:42:38,568 INFO  [org.infinispan.CLUSTER] (main) ISPN000078: Starting JGroups channel `ISPN` with stack `jdbc-ping`
2025-03-27T14:42:38.6542539Z 2025-03-27 14:42:38,569 INFO  [org.jgroups.JChannel] (main) local_addr: 94d55dfc-6fd7-404f-a277-21f30225f0ac, name: node1
2025-03-27T14:42:38.6543169Z 2025-03-27 14:42:38,576 INFO  [org.jgroups.protocols.FD_SOCK2] (main) server listening on *:57800
2025-03-27T14:42:38.6543968Z 2025-03-27 14:42:38,577 TRACE [org.jgroups.protocols.pbcast.STABLE] (main) node1: stable task started
2025-03-27T14:42:38.6544645Z 2025-03-27 14:42:38,578 DEBUG [org.jgroups.protocols.pbcast.GMS] (main) address=node1, cluster=ISPN, physical address=172.17.0.1:7800
2025-03-27T14:42:38.6545802Z 2025-03-27 14:42:38,579 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: SQL for reading: wrapped[ SELECT address, name, ip, coord FROM JGROUPS_PING WHERE cluster_name=('ISPN') ]
2025-03-27T14:42:38.6546763Z 2025-03-27 14:42:38,581 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: received GET_MBRS_REQ from null, sending response node1, name=node1, addr=172.17.0.1:7800
2025-03-27T14:42:38.6548007Z 2025-03-27 14:42:38,581 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to null, src=node1, size=84, headers are JDBC_PING2: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=ISPN]
2025-03-27T14:42:38.6549241Z 2025-03-27 14:42:38,582 TRACE [org.jgroups.protocols.TCP] (main) node1: looping back message [node1 to <all>, 40 bytes, flags=OOB|DONT_BUNDLE], headers are JDBC_PING2: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=ISPN]
2025-03-27T14:42:38.6550898Z 2025-03-27 14:42:38,582 TRACE [org.jgroups.protocols.pbcast.GMS] (main) node1: discovery took 4 ms, members: 1 rsps (1 coords) [done]
2025-03-27T14:42:38.6552960Z 2025-03-27 14:42:38,582 TRACE [org.jgroups.protocols.TCP] () node1: received [node1 to <all>, 40 bytes, flags=OOB|DONT_BUNDLE], headers are JDBC_PING2: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=ISPN]
2025-03-27T14:42:38.6554451Z 2025-03-27 14:42:38,582 DEBUG [org.jgroups.protocols.pbcast.GMS] (main) node1: sending JOIN(node1) to node2
2025-03-27T14:42:38.6555590Z 2025-03-27 14:42:38,583 TRACE [org.jgroups.protocols.JDBC_PING2] () node1: received GET_MBRS_RSP from node1: node1, name=node1, addr=172.17.0.1:7800
2025-03-27T14:42:38.6556926Z 2025-03-27 14:42:38,584 TRACE [org.jgroups.protocols.UNICAST3] (main) node1: created sender window for node2 (conn-id=0)
2025-03-27T14:42:38.6557985Z 2025-03-27 14:42:38,584 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#1, conn_id=0, first)
2025-03-27T14:42:38.6559494Z 2025-03-27 14:42:38,584 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=88, headers are GMS: GmsHeader[JOIN_REQ]: mbr=node1, UNICAST3: DATA, seqno=1, first, TP: [cluster=ISPN]
2025-03-27T14:42:38.6561285Z 2025-03-27 14:42:38,593 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node1) 172.17.0.1:7800: connecting to 172.17.0.1:7801
2025-03-27T14:42:38.6562859Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.TCP] (TcpServer.Acceptor[7801]-1,node2) 172.17.0.1:7801: accepted connection from 172.17.0.1:7800
2025-03-27T14:42:38.6564708Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.TCP] () node2: received [94d55dfc-6fd7-404f-a277-21f30225f0ac to <all>, 40 bytes, flags=OOB|DONT_BUNDLE], headers are JDBC_PING2: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster=ISPN]
2025-03-27T14:42:38.6567058Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: received GET_MBRS_RSP from 94d55dfc-6fd7-404f-a277-21f30225f0ac: 94d55dfc-6fd7-404f-a277-21f30225f0ac, name=node1, addr=172.17.0.1:7800
2025-03-27T14:42:38.6569233Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.TCP] () node2: received [94d55dfc-6fd7-404f-a277-21f30225f0ac to node2, 0 bytes, flags=OOB], headers are GMS: GmsHeader[JOIN_REQ]: mbr=94d55dfc-6fd7-404f-a277-21f30225f0ac, UNICAST3: DATA, seqno=1, first, TP: [cluster=ISPN]
2025-03-27T14:42:38.6570329Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#1, conn_id=0, first)
2025-03-27T14:42:38.6571408Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.UNICAST3] () node2: created receiver window for node1 at seqno=#1 for conn-id=0
2025-03-27T14:42:38.6572048Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#1
2025-03-27T14:42:38.6572865Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: handleMembershipChange([JOIN(node1)])
2025-03-27T14:42:38.6573613Z 2025-03-27 14:42:38,647 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: joiners=[node1], suspected=[], leaving=[], new view: [node2|61] (2) [node2, node1]
2025-03-27T14:42:38.6574365Z 2025-03-27 14:42:38,647 DEBUG [org.jgroups.protocols.pbcast.STABLE] () node2: suspending message garbage collection
2025-03-27T14:42:38.6575039Z 2025-03-27 14:42:38,647 DEBUG [org.jgroups.protocols.pbcast.STABLE] () node2: resume task started, max_suspend_time=33000
2025-03-27T14:42:38.6575754Z 2025-03-27 14:42:38,648 DEBUG [org.jgroups.protocols.pbcast.GMS] () node2: installing view [node2|61] (2) [node2, node1] (node1 joined)
2025-03-27T14:42:38.6576418Z 2025-03-27 14:42:38,649 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: cleared table for cluster ISPN
2025-03-27T14:42:38.6577280Z 2025-03-27 14:42:38,649 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf') ]
2025-03-27T14:42:38.6578144Z 2025-03-27 14:42:38,649 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: removed node2 for cluster ISPN from database
2025-03-27T14:42:38.6579170Z 2025-03-27 14:42:38,650 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf'), ('node2'), ('ISPN'), ('172.17.0.1:7801'), ('TRUE'::boolean)) ]
2025-03-27T14:42:38.6580299Z 2025-03-27 14:42:38,650 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: inserted node2 for cluster ISPN
2025-03-27T14:42:38.6581123Z 2025-03-27 14:42:38,650 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://94d55dfc-6fd7-404f-a277-21f30225f0ac') ]
2025-03-27T14:42:38.6582046Z 2025-03-27 14:42:38,650 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: removed node1 for cluster ISPN from database
2025-03-27T14:42:38.6583261Z 2025-03-27 14:42:38,650 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://94d55dfc-6fd7-404f-a277-21f30225f0ac'), ('node1'), ('ISPN'), ('172.17.0.1:7800'), ('FALSE'::boolean)) ]
2025-03-27T14:42:38.6584238Z 2025-03-27 14:42:38,651 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: inserted node1 for cluster ISPN
2025-03-27T14:42:38.6584952Z 2025-03-27 14:42:38,651 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: wrote to backend store: [node2, node1]
2025-03-27T14:42:38.6585945Z 2025-03-27 14:42:38,651 DEBUG [org.jgroups.protocols.FD_SOCK2] () node2: trying to connect to node1
2025-03-27T14:42:38.6586635Z 2025-03-27 14:42:38,651 TRACE [org.jgroups.protocols.FD_SOCK2] () node2: CONNECT --> node1 (172.17.0.1:57800)
2025-03-27T14:42:38.6587456Z 2025-03-27 14:42:38,651 TRACE [org.jgroups.protocols.FD_SOCK2] () node2: created connection to 172.17.0.1:57800
2025-03-27T14:42:38.7539475Z 2025-03-27 14:42:38,654 TRACE [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57800]-4,node1) node1: CONNECT <-- node2
2025-03-27T14:42:38.7543233Z 2025-03-27 14:42:38,654 TRACE [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57800]-4,node1) node1: CONNECT-RSP[cluster=ISPN, srv=node1] --> node2
2025-03-27T14:42:38.7544968Z 2025-03-27 14:42:38,655 TRACE [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57801]-4,node2) node2: CONNECT-RSP <-- node1 [cluster=ISPN, srv=node1]
2025-03-27T14:42:38.7546452Z 2025-03-27 14:42:38,655 DEBUG [org.jgroups.protocols.FD_SOCK2] () node2: connected successfully to node1 (172.17.0.1:57800) in 4 ms
2025-03-27T14:42:38.7547493Z 2025-03-27 14:42:38,655 TRACE [org.jgroups.protocols.UFC] () new membership: [node2, node1]
2025-03-27T14:42:38.7548369Z 2025-03-27 14:42:38,655 TRACE [org.jgroups.protocols.MFC] () new membership: [node2, node1]
2025-03-27T14:42:38.7549524Z 2025-03-27 14:42:38,655 INFO  [org.infinispan.CLUSTER] () ISPN000094: Received new cluster view for channel ISPN: [node2|61] (2) [node2, node1]
2025-03-27T14:42:38.7551050Z 2025-03-27 14:42:38,655 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] () Reloading JGroups Certificate
2025-03-27T14:42:38.7552565Z 2025-03-27 14:42:38,658 INFO  [org.infinispan.CLUSTER] () ISPN100000: Node node1 joined the cluster
2025-03-27T14:42:38.7553579Z 2025-03-27 14:42:38,658 INFO  [org.infinispan.CLUSTER] () ISPN100000: Node node1 joined the cluster
2025-03-27T14:42:38.7554725Z 2025-03-27 14:42:38,658 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: mcasting view [node2|61], ref-view=[node2|60], joined=[node1]
2025-03-27T14:42:38.7555840Z 2025-03-27 14:42:38,658 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1916
2025-03-27T14:42:38.7557252Z 2025-03-27 14:42:38,658 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=114, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1916], TP: [cluster=ISPN]
2025-03-27T14:42:38.7558930Z 2025-03-27 14:42:38,658 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: sending JOIN-RSP to node1: view=[node2|61] (2) [node2, node1] (2 mbrs)
2025-03-27T14:42:38.7560294Z 2025-03-27 14:42:38,658 TRACE [org.jgroups.protocols.UNICAST3] () node2: created sender window for node1 (conn-id=31)
2025-03-27T14:42:38.7561492Z 2025-03-27 14:42:38,658 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#1, conn_id=31, first)
2025-03-27T14:42:38.7563583Z 2025-03-27 14:42:38,659 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=136, headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=31, first, TP: [cluster=ISPN]
2025-03-27T14:42:38.7565200Z 2025-03-27 14:42:38,661 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 1 messages from node2
2025-03-27T14:42:38.7566442Z 2025-03-27 14:42:38,662 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1: message node2#1916 was queued (not yet server)
2025-03-27T14:42:38.7567917Z 2025-03-27 14:42:38,662 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 1 messages from node2
2025-03-27T14:42:38.7569116Z 2025-03-27 14:42:38,664 TRACE [org.jgroups.protocols.UNICAST3] () node1: created receiver window for node2 at seqno=#1 for conn-id=31
2025-03-27T14:42:38.7570293Z 2025-03-27 14:42:38,665 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#1 - #1)
2025-03-27T14:42:38.7571340Z 2025-03-27 14:42:38,666 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering #1 - #1 (1 messages)
2025-03-27T14:42:38.7572624Z 2025-03-27 14:42:38,667 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (main) 
2025-03-27T14:42:38.7573311Z [node1 setDigest()]
2025-03-27T14:42:38.7573678Z existing digest:  []
2025-03-27T14:42:38.7574122Z new digest:       node2: [1915 (1915)], node1: [0 (0)]
2025-03-27T14:42:38.7574693Z resulting digest: node2: [1915 (1915)], node1: [0 (0)]
2025-03-27T14:42:38.7575683Z 2025-03-27 14:42:38,667 DEBUG [org.jgroups.protocols.pbcast.GMS] (main) node1: installing view [node2|61] (2) [node2, node1] ([node2, node1] joined)
2025-03-27T14:42:38.7576958Z 2025-03-27 14:42:38,680 DEBUG [org.jgroups.protocols.FD_SOCK2] (main) node1: trying to connect to node2
2025-03-27T14:42:38.7578240Z 2025-03-27 14:42:38,681 TRACE [org.jgroups.protocols.FD_SOCK2] (main) node1: CONNECT --> node2 (172.17.0.1:57801)
2025-03-27T14:42:38.7579512Z 2025-03-27 14:42:38,681 TRACE [org.jgroups.protocols.FD_SOCK2] (main) node1: created connection to 172.17.0.1:57801
2025-03-27T14:42:38.7580800Z 2025-03-27 14:42:38,681 TRACE [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57801]-4,node2) node2: CONNECT <-- node1
2025-03-27T14:42:38.7582526Z 2025-03-27 14:42:38,681 TRACE [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57801]-4,node2) node2: CONNECT-RSP[cluster=ISPN, srv=node2] --> node1
2025-03-27T14:42:38.7584178Z 2025-03-27 14:42:38,682 TRACE [org.jgroups.protocols.FD_SOCK2] (NioServer.Selector [/0.0.0.0:57800]-4,node1) node1: CONNECT-RSP <-- node2 [cluster=ISPN, srv=node2]
2025-03-27T14:42:38.7585788Z 2025-03-27 14:42:38,682 DEBUG [org.jgroups.protocols.FD_SOCK2] (main) node1: connected successfully to node2 (172.17.0.1:57801) in 2 ms
2025-03-27T14:42:38.7587281Z 2025-03-27 14:42:38,683 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to null, src=node1, size=37, headers are FD_ALL3: heartbeat, TP: [cluster=ISPN]
2025-03-27T14:42:38.7588537Z 2025-03-27 14:42:38,683 TRACE [org.jgroups.protocols.UFC] (main) new membership: [node2, node1]
2025-03-27T14:42:38.7589548Z 2025-03-27 14:42:38,683 TRACE [org.jgroups.protocols.FD_ALL3] () node1: sent heartbeat
2025-03-27T14:42:38.7590574Z 2025-03-27 14:42:38,683 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node1
2025-03-27T14:42:38.7591634Z 2025-03-27 14:42:38,683 TRACE [org.jgroups.protocols.FD_ALL3] () node2: received heartbeat from node1
2025-03-27T14:42:38.7592951Z 2025-03-27 14:42:38,683 TRACE [org.jgroups.protocols.MFC] (main) new membership: [node2, node1]
2025-03-27T14:42:38.7594146Z 2025-03-27 14:42:38,685 INFO  [org.infinispan.CLUSTER] (main) ISPN000094: Received new cluster view for channel ISPN: [node2|61] (2) [node2, node1]
2025-03-27T14:42:38.7595593Z 2025-03-27 14:42:38,686 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] (main) Reloading JGroups Certificate
2025-03-27T14:42:38.7597037Z 2025-03-27 14:42:38,690 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (main) node1: flushing become_server_queue (1 elements)
2025-03-27T14:42:38.7598366Z 2025-03-27 14:42:38,691 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#2, conn_id=0)
2025-03-27T14:42:38.7599871Z 2025-03-27 14:42:38,691 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=68, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster=ISPN]
2025-03-27T14:42:38.7601385Z 2025-03-27 14:42:38,691 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1916-1916 (1 messages)
2025-03-27T14:42:38.7603244Z 2025-03-27 14:42:38,691 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 0 bytes, flags=OOB|NO_FC], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster=ISPN]
2025-03-27T14:42:38.7604757Z 2025-03-27 14:42:38,691 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#2, conn_id=0)
2025-03-27T14:42:38.7605727Z 2025-03-27 14:42:38,691 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#2
2025-03-27T14:42:38.7606792Z 2025-03-27 14:42:38,692 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: got all ACKs (0) for view [node2|61] in 44 ms
2025-03-27T14:42:38.7607842Z 2025-03-27 14:42:38,692 DEBUG [org.jgroups.protocols.pbcast.STABLE] () node2: resuming message garbage collection
2025-03-27T14:42:38.7609191Z 2025-03-27 14:42:38,744 INFO  [org.infinispan.CLUSTER] (main) ISPN000079: Channel `ISPN` local address is `node1`, physical addresses are `[172.17.0.1:7800]`
2025-03-27T14:42:38.8551549Z 2025-03-27 14:42:38,762 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#3, conn_id=0)
2025-03-27T14:42:38.8555868Z 2025-03-27 14:42:38,762 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=79, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=1, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster=ISPN]
2025-03-27T14:42:38.8558311Z 2025-03-27 14:42:38,763 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 6 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=1, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster=ISPN]
2025-03-27T14:42:38.8559417Z 2025-03-27 14:42:38,763 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#3, conn_id=0)
2025-03-27T14:42:38.8559983Z 2025-03-27 14:42:38,763 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#3
2025-03-27T14:42:38.8560532Z 2025-03-27 14:42:38,763 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#2, conn_id=31)
2025-03-27T14:42:38.8561515Z 2025-03-27 14:42:38,763 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=135, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=1, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:38.8562781Z 2025-03-27 14:42:38,763 TRACE [org.jgroups.protocols.UFC] () node1 used 6 credits, 3999994 remaining
2025-03-27T14:42:38.8563820Z 2025-03-27 14:42:38,764 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 62 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=1, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:38.8564830Z 2025-03-27 14:42:38,764 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#2, conn_id=31)
2025-03-27T14:42:38.8565370Z 2025-03-27 14:42:38,764 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#2
2025-03-27T14:42:38.8566015Z 2025-03-27 14:42:38,778 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: ACK(#2)
2025-03-27T14:42:38.8567141Z 2025-03-27 14:42:38,778 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=61, headers are UNICAST3: ACK, seqno=2, conn_id=31, ts=1, TP: [cluster=ISPN]
2025-03-27T14:42:38.8568440Z 2025-03-27 14:42:38,778 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node1
2025-03-27T14:42:38.8569429Z 2025-03-27 14:42:38,778 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: ACK(#2, conn-id=31, ts=1)
2025-03-27T14:42:38.8570499Z 2025-03-27 14:42:38,837 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#3)
2025-03-27T14:42:38.8571651Z 2025-03-27 14:42:38,837 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=3, ts=170, TP: [cluster=ISPN]
2025-03-27T14:42:38.8573066Z 2025-03-27 14:42:38,840 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 1 messages from node2
2025-03-27T14:42:38.8574227Z 2025-03-27 14:42:38,840 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: ACK(#3, conn-id=0, ts=170)
2025-03-27T14:42:38.9552901Z 2025-03-27 14:42:38,861 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=41, headers are NAKACK2: [HIGHEST_SEQNO, seqno=1916], TP: [cluster=ISPN]
2025-03-27T14:42:38.9555811Z 2025-03-27 14:42:38,865 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 0 bytes, flags=OOB|NO_FC], headers are NAKACK2: [HIGHEST_SEQNO, seqno=1916], TP: [cluster=ISPN]
2025-03-27T14:42:38.9557715Z 2025-03-27 14:42:38,953 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#4, conn_id=0)
2025-03-27T14:42:38.9559804Z 2025-03-27 14:42:38,953 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=154, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=2, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster=ISPN]
2025-03-27T14:42:39.0751042Z 2025-03-27 14:42:38,954 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 81 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=2, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster=ISPN]
2025-03-27T14:42:39.0770073Z 2025-03-27 14:42:38,954 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#4, conn_id=0)
2025-03-27T14:42:39.0771109Z 2025-03-27 14:42:38,955 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#4
2025-03-27T14:42:39.0772783Z 2025-03-27 14:42:38,955 INFO  [org.infinispan.CLUSTER] () [Context=org.infinispan.CONFIG] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.0774322Z 2025-03-27 14:42:38,955 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1917
2025-03-27T14:42:39.0775653Z 2025-03-27 14:42:38,955 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2343, headers are NAKACK2: [MSG, seqno=1917], TP: [cluster=ISPN]
2025-03-27T14:42:39.0777013Z 2025-03-27 14:42:38,955 TRACE [org.jgroups.protocols.MFC] () node2 used 2298 credits, 3200929 remaining
2025-03-27T14:42:39.0778599Z 2025-03-27 14:42:38,957 INFO  [org.infinispan.LIFECYCLE] () [Context=org.infinispan.CONFIG] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.0780624Z 2025-03-27 14:42:38,956 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2298 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1917], TP: [cluster=ISPN]
2025-03-27T14:42:39.0782098Z 2025-03-27 14:42:38,956 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1917
2025-03-27T14:42:39.0783908Z 2025-03-27 14:42:38,959 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t5) [Context=org.infinispan.CONFIG] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.0785526Z 2025-03-27 14:42:38,959 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#3, conn_id=31)
2025-03-27T14:42:39.0787342Z 2025-03-27 14:42:38,959 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2356, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=2, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0789042Z 2025-03-27 14:42:38,960 TRACE [org.jgroups.protocols.UFC] () node1 used 81 credits, 3999913 remaining
2025-03-27T14:42:39.0790997Z 2025-03-27 14:42:38,960 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 2283 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=2, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0793254Z 2025-03-27 14:42:38,960 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#3, conn_id=31)
2025-03-27T14:42:39.0794401Z 2025-03-27 14:42:38,960 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#3
2025-03-27T14:42:39.0795879Z 2025-03-27 14:42:38,961 INFO  [org.infinispan.LIFECYCLE] () [Context=org.infinispan.CONFIG] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.0797389Z 2025-03-27 14:42:38,968 TRACE [org.jgroups.protocols.MFC] () node2 used 2298 credits, 3997702 remaining
2025-03-27T14:42:39.0799068Z 2025-03-27 14:42:38,979 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node1-p2-t6) [Context=org.infinispan.CONFIG] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.0800618Z 2025-03-27 14:42:38,979 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: ACK(#3)
2025-03-27T14:42:39.0801944Z 2025-03-27 14:42:38,979 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=61, headers are UNICAST3: ACK, seqno=3, conn_id=31, ts=2, TP: [cluster=ISPN]
2025-03-27T14:42:39.0803716Z 2025-03-27 14:42:38,980 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#5, conn_id=0)
2025-03-27T14:42:39.0805867Z 2025-03-27 14:42:38,980 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=138, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=3, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster=ISPN]
2025-03-27T14:42:39.0807798Z 2025-03-27 14:42:38,981 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node1
2025-03-27T14:42:39.0809647Z 2025-03-27 14:42:38,981 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 65 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=3, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster=ISPN]
2025-03-27T14:42:39.0811434Z 2025-03-27 14:42:38,981 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#5, conn_id=0)
2025-03-27T14:42:39.0812561Z 2025-03-27 14:42:38,981 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#5
2025-03-27T14:42:39.0813566Z 2025-03-27 14:42:38,981 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: ACK(#3, conn-id=31, ts=2)
2025-03-27T14:42:39.0814658Z 2025-03-27 14:42:38,982 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#4, conn_id=31)
2025-03-27T14:42:39.0816437Z 2025-03-27 14:42:38,982 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2668, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=362, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0818283Z 2025-03-27 14:42:38,982 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#5, conn_id=31)
2025-03-27T14:42:39.0820020Z 2025-03-27 14:42:38,982 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=3, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0821735Z 2025-03-27 14:42:38,982 TRACE [org.jgroups.protocols.UFC] () node1 used 65 credits, 3999848 remaining
2025-03-27T14:42:39.0823831Z 2025-03-27 14:42:38,983 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=3, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0825819Z 2025-03-27 14:42:38,983 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#5, conn_id=31)
2025-03-27T14:42:39.0826839Z 2025-03-27 14:42:38,984 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#5
2025-03-27T14:42:39.0828702Z 2025-03-27 14:42:38,983 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 2594 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=362, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0830792Z 2025-03-27 14:42:38,984 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#6, conn_id=0)
2025-03-27T14:42:39.0831824Z 2025-03-27 14:42:38,985 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#4, conn_id=31)
2025-03-27T14:42:39.0833653Z 2025-03-27 14:42:38,985 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=104, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=4, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster=ISPN]
2025-03-27T14:42:39.0835361Z 2025-03-27 14:42:38,985 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#4
2025-03-27T14:42:39.0837144Z 2025-03-27 14:42:38,985 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 31 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=4, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster=ISPN]
2025-03-27T14:42:39.0838969Z 2025-03-27 14:42:38,985 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#6, conn_id=0)
2025-03-27T14:42:39.0839931Z 2025-03-27 14:42:38,985 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#6
2025-03-27T14:42:39.0840896Z 2025-03-27 14:42:38,986 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#6, conn_id=31)
2025-03-27T14:42:39.0842922Z 2025-03-27 14:42:38,986 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=4, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0844640Z 2025-03-27 14:42:38,986 TRACE [org.jgroups.protocols.UFC] () node1 used 31 credits, 3999817 remaining
2025-03-27T14:42:39.0846433Z 2025-03-27 14:42:38,986 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=4, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0848241Z 2025-03-27 14:42:38,986 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#6, conn_id=31)
2025-03-27T14:42:39.0849201Z 2025-03-27 14:42:38,986 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#6
2025-03-27T14:42:39.0850156Z 2025-03-27 14:42:38,994 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#7, conn_id=0)
2025-03-27T14:42:39.0851446Z 2025-03-27 14:42:38,994 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=104, headers are UNICAST3: DATA, seqno=7, TP: [cluster=ISPN]
2025-03-27T14:42:39.0853336Z 2025-03-27 14:42:38,995 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 40 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=7, TP: [cluster=ISPN]
2025-03-27T14:42:39.0854772Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#7, conn_id=0)
2025-03-27T14:42:39.0855756Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#7
2025-03-27T14:42:39.0857470Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=362, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster=ISPN]
2025-03-27T14:42:39.0859640Z 2025-03-27 14:42:38,996 INFO  [org.infinispan.CLUSTER] () [Context=org.infinispan.CONFIG] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.0861107Z 2025-03-27 14:42:38,995 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#8, conn_id=0)
2025-03-27T14:42:39.0862923Z 2025-03-27 14:42:38,995 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=362, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster=ISPN]
2025-03-27T14:42:39.0864571Z 2025-03-27 14:42:38,995 TRACE [org.jgroups.protocols.UFC] () node2 used 2594 credits, 3997406 remaining
2025-03-27T14:42:39.0865672Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1918
2025-03-27T14:42:39.0866664Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#8, conn_id=0)
2025-03-27T14:42:39.0867622Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#8
2025-03-27T14:42:39.0868923Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2344, headers are NAKACK2: [MSG, seqno=1918], TP: [cluster=ISPN]
2025-03-27T14:42:39.0870318Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.MFC] () node2 used 2299 credits, 3198630 remaining
2025-03-27T14:42:39.0871295Z 2025-03-27 14:42:38,996 TRACE [org.jgroups.protocols.UFC] () node1 used 40 credits, 3999777 remaining
2025-03-27T14:42:39.0872938Z 2025-03-27 14:42:38,997 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2299 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1918], TP: [cluster=ISPN]
2025-03-27T14:42:39.0874568Z 2025-03-27 14:42:38,997 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1918
2025-03-27T14:42:39.0875659Z 2025-03-27 14:42:39,000 TRACE [org.jgroups.protocols.MFC] () node2 used 2299 credits, 3995403 remaining
2025-03-27T14:42:39.0876897Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#9, conn_id=0)
2025-03-27T14:42:39.0878623Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=104, headers are UNICAST3: DATA, seqno=9, TP: [cluster=ISPN]
2025-03-27T14:42:39.0880518Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 40 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=9, TP: [cluster=ISPN]
2025-03-27T14:42:39.0881929Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#9, conn_id=0)
2025-03-27T14:42:39.0883015Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#9
2025-03-27T14:42:39.0884350Z 2025-03-27 14:42:39,001 INFO  [org.infinispan.CLUSTER] () [Context=org.infinispan.CONFIG] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.0885676Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1919
2025-03-27T14:42:39.0886970Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2344, headers are NAKACK2: [MSG, seqno=1919], TP: [cluster=ISPN]
2025-03-27T14:42:39.0888289Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.MFC] () node2 used 2299 credits, 3196331 remaining
2025-03-27T14:42:39.0889289Z 2025-03-27 14:42:39,001 TRACE [org.jgroups.protocols.UFC] () node1 used 40 credits, 3999737 remaining
2025-03-27T14:42:39.0890738Z 2025-03-27 14:42:39,002 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2299 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1919], TP: [cluster=ISPN]
2025-03-27T14:42:39.0892175Z 2025-03-27 14:42:39,002 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1919
2025-03-27T14:42:39.0893339Z 2025-03-27 14:42:39,003 TRACE [org.jgroups.protocols.MFC] () node2 used 2299 credits, 3993104 remaining
2025-03-27T14:42:39.0894539Z 2025-03-27 14:42:39,003 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#10, conn_id=0)
2025-03-27T14:42:39.0896389Z 2025-03-27 14:42:39,003 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=104, headers are UNICAST3: DATA, seqno=10, TP: [cluster=ISPN]
2025-03-27T14:42:39.0898305Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 40 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=10, TP: [cluster=ISPN]
2025-03-27T14:42:39.0899841Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#10, conn_id=0)
2025-03-27T14:42:39.0900874Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#10
2025-03-27T14:42:39.0902527Z 2025-03-27 14:42:39,004 INFO  [org.infinispan.CLUSTER] () [Context=org.infinispan.CONFIG] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.0903898Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1920
2025-03-27T14:42:39.0905308Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1272, headers are NAKACK2: [MSG, seqno=1920], TP: [cluster=ISPN]
2025-03-27T14:42:39.0906632Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.MFC] () node2 used 1227 credits, 3195104 remaining
2025-03-27T14:42:39.0907603Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1921
2025-03-27T14:42:39.0908877Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1271, headers are NAKACK2: [MSG, seqno=1921], TP: [cluster=ISPN]
2025-03-27T14:42:39.0910237Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.MFC] () node2 used 1226 credits, 3193878 remaining
2025-03-27T14:42:39.0911226Z 2025-03-27 14:42:39,004 TRACE [org.jgroups.protocols.UFC] () node1 used 40 credits, 3999697 remaining
2025-03-27T14:42:39.0912792Z 2025-03-27 14:42:39,005 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 1227 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1920], TP: [cluster=ISPN]
2025-03-27T14:42:39.0914216Z 2025-03-27 14:42:39,005 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1920
2025-03-27T14:42:39.0915643Z 2025-03-27 14:42:39,005 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 1226 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1921], TP: [cluster=ISPN]
2025-03-27T14:42:39.0917058Z 2025-03-27 14:42:39,005 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1921
2025-03-27T14:42:39.0918040Z 2025-03-27 14:42:39,005 TRACE [org.jgroups.protocols.MFC] () node2 used 1227 credits, 3991877 remaining
2025-03-27T14:42:39.0919037Z 2025-03-27 14:42:39,006 TRACE [org.jgroups.protocols.MFC] () node2 used 1226 credits, 3990651 remaining
2025-03-27T14:42:39.0920240Z 2025-03-27 14:42:39,016 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#11, conn_id=0)
2025-03-27T14:42:39.0922517Z 2025-03-27 14:42:39,016 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=145, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=5, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster=ISPN]
2025-03-27T14:42:39.0925195Z 2025-03-27 14:42:39,016 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 72 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=5, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster=ISPN]
2025-03-27T14:42:39.0926994Z 2025-03-27 14:42:39,016 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#11, conn_id=0)
2025-03-27T14:42:39.0927959Z 2025-03-27 14:42:39,016 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#11
2025-03-27T14:42:39.0929364Z 2025-03-27 14:42:39,017 INFO  [org.infinispan.CLUSTER] () [Context=actionTokens] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.0930940Z 2025-03-27 14:42:39,017 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1922
2025-03-27T14:42:39.0932404Z 2025-03-27 14:42:39,017 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5388, headers are NAKACK2: [MSG, seqno=1922], TP: [cluster=ISPN]
2025-03-27T14:42:39.0933862Z 2025-03-27 14:42:39,017 TRACE [org.jgroups.protocols.MFC] () node2 used 5343 credits, 3188535 remaining
2025-03-27T14:42:39.0935312Z 2025-03-27 14:42:39,017 INFO  [org.infinispan.LIFECYCLE] () [Context=actionTokens] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.0936770Z 2025-03-27 14:42:39,017 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#7, conn_id=31)
2025-03-27T14:42:39.0938603Z 2025-03-27 14:42:39,017 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=5, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0940326Z 2025-03-27 14:42:39,017 TRACE [org.jgroups.protocols.UFC] () node1 used 72 credits, 3999625 remaining
2025-03-27T14:42:39.0941794Z 2025-03-27 14:42:39,019 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5343 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1922], TP: [cluster=ISPN]
2025-03-27T14:42:39.0943386Z 2025-03-27 14:42:39,019 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1922
2025-03-27T14:42:39.0945433Z 2025-03-27 14:42:39,019 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=5, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0947293Z 2025-03-27 14:42:39,019 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#7, conn_id=31)
2025-03-27T14:42:39.0948270Z 2025-03-27 14:42:39,019 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#7
2025-03-27T14:42:39.0949692Z 2025-03-27 14:42:39,020 INFO  [org.infinispan.LIFECYCLE] () [Context=actionTokens] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.0951162Z 2025-03-27 14:42:39,020 TRACE [org.jgroups.protocols.MFC] () node2 used 5343 credits, 3985308 remaining
2025-03-27T14:42:39.0952824Z 2025-03-27 14:42:39,021 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t3) [Context=actionTokens] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.0954382Z 2025-03-27 14:42:39,022 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#12, conn_id=0)
2025-03-27T14:42:39.0956068Z 2025-03-27 14:42:39,022 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=95, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=6, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster=ISPN]
2025-03-27T14:42:39.0957911Z 2025-03-27 14:42:39,023 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#13, conn_id=0)
2025-03-27T14:42:39.0959908Z 2025-03-27 14:42:39,023 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=95, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=7, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster=ISPN]
2025-03-27T14:42:39.0962839Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 22 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=6, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster=ISPN]
2025-03-27T14:42:39.0964646Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#12, conn_id=0)
2025-03-27T14:42:39.0965813Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#12
2025-03-27T14:42:39.0966811Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#8, conn_id=31)
2025-03-27T14:42:39.0968515Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=6, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0970304Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.UFC] () node1 used 22 credits, 3999603 remaining
2025-03-27T14:42:39.0972189Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=6, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0974298Z 2025-03-27 14:42:39,024 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#8, conn_id=31)
2025-03-27T14:42:39.0975379Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#8
2025-03-27T14:42:39.0977130Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 22 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=7, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster=ISPN]
2025-03-27T14:42:39.0978893Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#13, conn_id=0)
2025-03-27T14:42:39.0979826Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#13
2025-03-27T14:42:39.0980896Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#9, conn_id=31)
2025-03-27T14:42:39.0982709Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=7, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0984417Z 2025-03-27 14:42:39,025 TRACE [org.jgroups.protocols.UFC] () node1 used 22 credits, 3999581 remaining
2025-03-27T14:42:39.0986223Z 2025-03-27 14:42:39,026 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=7, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.0988009Z 2025-03-27 14:42:39,026 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#9, conn_id=31)
2025-03-27T14:42:39.0988971Z 2025-03-27 14:42:39,026 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#9
2025-03-27T14:42:39.0990500Z 2025-03-27 14:42:39,027 INFO  [org.infinispan.LIFECYCLE] () [Context=actionTokens] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.0991999Z 2025-03-27 14:42:39,027 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#14, conn_id=0)
2025-03-27T14:42:39.0994189Z 2025-03-27 14:42:39,027 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=129, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster=ISPN]
2025-03-27T14:42:39.0996782Z 2025-03-27 14:42:39,028 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 56 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster=ISPN]
2025-03-27T14:42:39.0998570Z 2025-03-27 14:42:39,028 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#14, conn_id=0)
2025-03-27T14:42:39.0999597Z 2025-03-27 14:42:39,028 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#14
2025-03-27T14:42:39.1000714Z 2025-03-27 14:42:39,028 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#10, conn_id=31)
2025-03-27T14:42:39.1002596Z 2025-03-27 14:42:39,028 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2702, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=363, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1004369Z 2025-03-27 14:42:39,029 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#11, conn_id=31)
2025-03-27T14:42:39.1006243Z 2025-03-27 14:42:39,029 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1007956Z 2025-03-27 14:42:39,029 TRACE [org.jgroups.protocols.UFC] () node1 used 56 credits, 3999525 remaining
2025-03-27T14:42:39.1009883Z 2025-03-27 14:42:39,029 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 2628 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=363, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1011716Z 2025-03-27 14:42:39,029 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#10, conn_id=31)
2025-03-27T14:42:39.1012835Z 2025-03-27 14:42:39,030 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#10
2025-03-27T14:42:39.1014587Z 2025-03-27 14:42:39,030 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1016496Z 2025-03-27 14:42:39,030 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#11, conn_id=31)
2025-03-27T14:42:39.1017491Z 2025-03-27 14:42:39,030 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#11
2025-03-27T14:42:39.1018410Z 2025-03-27 14:42:39,037 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#14)
2025-03-27T14:42:39.1019664Z 2025-03-27 14:42:39,037 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=14, ts=171, TP: [cluster=ISPN]
2025-03-27T14:42:39.1021021Z 2025-03-27 14:42:39,037 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 1 messages from node2
2025-03-27T14:42:39.1022103Z 2025-03-27 14:42:39,037 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: ACK(#14, conn-id=0, ts=171)
2025-03-27T14:42:39.1023294Z 2025-03-27 14:42:39,042 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#15, conn_id=0)
2025-03-27T14:42:39.1024657Z 2025-03-27 14:42:39,042 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=95, headers are UNICAST3: DATA, seqno=15, TP: [cluster=ISPN]
2025-03-27T14:42:39.1025929Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#16, conn_id=0)
2025-03-27T14:42:39.1027581Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=363, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster=ISPN]
2025-03-27T14:42:39.1029669Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 31 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, TP: [cluster=ISPN]
2025-03-27T14:42:39.1031095Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#15, conn_id=0)
2025-03-27T14:42:39.1032123Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.UFC] () node2 used 2628 credits, 3994778 remaining
2025-03-27T14:42:39.1033293Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#15
2025-03-27T14:42:39.1035052Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=363, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster=ISPN]
2025-03-27T14:42:39.1036965Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#16, conn_id=0)
2025-03-27T14:42:39.1037965Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#16
2025-03-27T14:42:39.1039340Z 2025-03-27 14:42:39,043 INFO  [org.infinispan.CLUSTER] () [Context=actionTokens] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.1040618Z 2025-03-27 14:42:39,043 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1923
2025-03-27T14:42:39.1042089Z 2025-03-27 14:42:39,044 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5389, headers are NAKACK2: [MSG, seqno=1923], TP: [cluster=ISPN]
2025-03-27T14:42:39.1043604Z 2025-03-27 14:42:39,044 TRACE [org.jgroups.protocols.MFC] () node2 used 5344 credits, 3183191 remaining
2025-03-27T14:42:39.1045183Z 2025-03-27 14:42:39,045 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5344 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1923], TP: [cluster=ISPN]
2025-03-27T14:42:39.1046632Z 2025-03-27 14:42:39,045 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1923
2025-03-27T14:42:39.1047605Z 2025-03-27 14:42:39,046 TRACE [org.jgroups.protocols.MFC] () node2 used 5344 credits, 3979964 remaining
2025-03-27T14:42:39.1048577Z 2025-03-27 14:42:39,044 TRACE [org.jgroups.protocols.UFC] () node1 used 31 credits, 3999494 remaining
2025-03-27T14:42:39.1049843Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#17, conn_id=0)
2025-03-27T14:42:39.1051508Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=95, headers are UNICAST3: DATA, seqno=17, TP: [cluster=ISPN]
2025-03-27T14:42:39.1053565Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 31 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=17, TP: [cluster=ISPN]
2025-03-27T14:42:39.1055008Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#17, conn_id=0)
2025-03-27T14:42:39.1055991Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#17
2025-03-27T14:42:39.1057255Z 2025-03-27 14:42:39,047 INFO  [org.infinispan.CLUSTER] () [Context=actionTokens] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.1058512Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1924
2025-03-27T14:42:39.1059772Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5389, headers are NAKACK2: [MSG, seqno=1924], TP: [cluster=ISPN]
2025-03-27T14:42:39.1061046Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.MFC] () node2 used 5344 credits, 3177847 remaining
2025-03-27T14:42:39.1062008Z 2025-03-27 14:42:39,047 TRACE [org.jgroups.protocols.UFC] () node1 used 31 credits, 3999463 remaining
2025-03-27T14:42:39.1063574Z 2025-03-27 14:42:39,048 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5344 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1924], TP: [cluster=ISPN]
2025-03-27T14:42:39.1064977Z 2025-03-27 14:42:39,048 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1924
2025-03-27T14:42:39.1065936Z 2025-03-27 14:42:39,049 TRACE [org.jgroups.protocols.MFC] () node2 used 5344 credits, 3974620 remaining
2025-03-27T14:42:39.1067135Z 2025-03-27 14:42:39,050 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#18, conn_id=0)
2025-03-27T14:42:39.1068839Z 2025-03-27 14:42:39,050 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=95, headers are UNICAST3: DATA, seqno=18, TP: [cluster=ISPN]
2025-03-27T14:42:39.1070958Z 2025-03-27 14:42:39,050 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 31 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=18, TP: [cluster=ISPN]
2025-03-27T14:42:39.1072641Z 2025-03-27 14:42:39,050 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#18, conn_id=0)
2025-03-27T14:42:39.1073758Z 2025-03-27 14:42:39,050 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#18
2025-03-27T14:42:39.1074999Z 2025-03-27 14:42:39,051 INFO  [org.infinispan.CLUSTER] () [Context=actionTokens] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.1076317Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1925
2025-03-27T14:42:39.1077731Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=3299, headers are NAKACK2: [MSG, seqno=1925], TP: [cluster=ISPN]
2025-03-27T14:42:39.1079040Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.MFC] () node2 used 3254 credits, 3174593 remaining
2025-03-27T14:42:39.1080208Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1926
2025-03-27T14:42:39.1081526Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=3298, headers are NAKACK2: [MSG, seqno=1926], TP: [cluster=ISPN]
2025-03-27T14:42:39.1083026Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.MFC] () node2 used 3253 credits, 3171340 remaining
2025-03-27T14:42:39.1084203Z 2025-03-27 14:42:39,051 TRACE [org.jgroups.protocols.UFC] () node1 used 31 credits, 3999432 remaining
2025-03-27T14:42:39.1085275Z 2025-03-27 14:42:39,052 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 2 messages from node2
2025-03-27T14:42:39.1086393Z 2025-03-27 14:42:39,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1925-1926 (2 messages)
2025-03-27T14:42:39.1087439Z 2025-03-27 14:42:39,053 TRACE [org.jgroups.protocols.MFC] () node2 used 6507 credits, 3968113 remaining
2025-03-27T14:42:39.1088613Z 2025-03-27 14:42:39,058 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#19, conn_id=0)
2025-03-27T14:42:39.1090612Z 2025-03-27 14:42:39,058 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=155, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster=ISPN]
2025-03-27T14:42:39.1093331Z 2025-03-27 14:42:39,058 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 82 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster=ISPN]
2025-03-27T14:42:39.1095132Z 2025-03-27 14:42:39,058 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#19, conn_id=0)
2025-03-27T14:42:39.1096113Z 2025-03-27 14:42:39,058 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#19
2025-03-27T14:42:39.1097580Z 2025-03-27 14:42:39,059 INFO  [org.infinispan.CLUSTER] () [Context=authenticationSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.1099040Z 2025-03-27 14:42:39,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1927
2025-03-27T14:42:39.1100306Z 2025-03-27 14:42:39,059 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5398, headers are NAKACK2: [MSG, seqno=1927], TP: [cluster=ISPN]
2025-03-27T14:42:39.1110493Z 2025-03-27 14:42:39,059 TRACE [org.jgroups.protocols.MFC] () node2 used 5353 credits, 3165987 remaining
2025-03-27T14:42:39.1112115Z 2025-03-27 14:42:39,059 INFO  [org.infinispan.LIFECYCLE] () [Context=authenticationSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.1114047Z 2025-03-27 14:42:39,059 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#12, conn_id=31)
2025-03-27T14:42:39.1115753Z 2025-03-27 14:42:39,059 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1117686Z 2025-03-27 14:42:39,059 TRACE [org.jgroups.protocols.UFC] () node1 used 82 credits, 3999350 remaining
2025-03-27T14:42:39.1119319Z 2025-03-27 14:42:39,059 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t4) [Context=authenticationSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.1121402Z 2025-03-27 14:42:39,060 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5353 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1927], TP: [cluster=ISPN]
2025-03-27T14:42:39.1123202Z 2025-03-27 14:42:39,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1927
2025-03-27T14:42:39.1125015Z 2025-03-27 14:42:39,060 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1126828Z 2025-03-27 14:42:39,060 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#12, conn_id=31)
2025-03-27T14:42:39.1127796Z 2025-03-27 14:42:39,061 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#12
2025-03-27T14:42:39.1129391Z 2025-03-27 14:42:39,061 INFO  [org.infinispan.LIFECYCLE] () [Context=authenticationSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.1130929Z 2025-03-27 14:42:39,061 TRACE [org.jgroups.protocols.MFC] () node2 used 5353 credits, 3962760 remaining
2025-03-27T14:42:39.1131966Z 2025-03-27 14:42:39,062 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#20, conn_id=0)
2025-03-27T14:42:39.1133799Z 2025-03-27 14:42:39,062 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=105, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster=ISPN]
2025-03-27T14:42:39.1135645Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#21, conn_id=0)
2025-03-27T14:42:39.1137593Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 32 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster=ISPN]
2025-03-27T14:42:39.1139360Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#20, conn_id=0)
2025-03-27T14:42:39.1140326Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#20
2025-03-27T14:42:39.1141296Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#13, conn_id=31)
2025-03-27T14:42:39.1143230Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1144962Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.UFC] () node1 used 32 credits, 3999318 remaining
2025-03-27T14:42:39.1146809Z 2025-03-27 14:42:39,063 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=105, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster=ISPN]
2025-03-27T14:42:39.1149672Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1163021Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 32 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster=ISPN]
2025-03-27T14:42:39.1165022Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#21, conn_id=0)
2025-03-27T14:42:39.1165999Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#21
2025-03-27T14:42:39.1166971Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#14, conn_id=31)
2025-03-27T14:42:39.1167986Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#13, conn_id=31)
2025-03-27T14:42:39.1169032Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#13
2025-03-27T14:42:39.1170673Z 2025-03-27 14:42:39,064 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1175565Z 2025-03-27 14:42:39,065 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1184656Z 2025-03-27 14:42:39,065 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#14, conn_id=31)
2025-03-27T14:42:39.1185646Z 2025-03-27 14:42:39,065 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#14
2025-03-27T14:42:39.1187000Z 2025-03-27 14:42:39,066 INFO  [org.infinispan.LIFECYCLE] () [Context=authenticationSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.1188362Z 2025-03-27 14:42:39,066 TRACE [org.jgroups.protocols.UFC] () node1 used 32 credits, 3999286 remaining
2025-03-27T14:42:39.1189525Z 2025-03-27 14:42:39,066 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#22, conn_id=0)
2025-03-27T14:42:39.1191512Z 2025-03-27 14:42:39,066 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=139, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster=ISPN]
2025-03-27T14:42:39.1194196Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 66 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster=ISPN]
2025-03-27T14:42:39.1195976Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#22, conn_id=0)
2025-03-27T14:42:39.1196935Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#22
2025-03-27T14:42:39.1197890Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#15, conn_id=31)
2025-03-27T14:42:39.1199557Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2669, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=364, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1201190Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#16, conn_id=31)
2025-03-27T14:42:39.1202948Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1204665Z 2025-03-27 14:42:39,067 TRACE [org.jgroups.protocols.UFC] () node1 used 66 credits, 3999220 remaining
2025-03-27T14:42:39.1206485Z 2025-03-27 14:42:39,068 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 2595 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=364, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1208450Z 2025-03-27 14:42:39,068 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#15, conn_id=31)
2025-03-27T14:42:39.1210211Z 2025-03-27 14:42:39,068 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1212074Z 2025-03-27 14:42:39,068 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#15
2025-03-27T14:42:39.1213242Z 2025-03-27 14:42:39,068 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#16, conn_id=31)
2025-03-27T14:42:39.1214200Z 2025-03-27 14:42:39,068 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#16
2025-03-27T14:42:39.1215180Z 2025-03-27 14:42:39,070 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#23, conn_id=0)
2025-03-27T14:42:39.1216599Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 41 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=23, TP: [cluster=ISPN]
2025-03-27T14:42:39.1218149Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#23, conn_id=0)
2025-03-27T14:42:39.1219128Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#23
2025-03-27T14:42:39.1220476Z 2025-03-27 14:42:39,071 INFO  [org.infinispan.CLUSTER] () [Context=authenticationSessions] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.1221832Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1928
2025-03-27T14:42:39.1223350Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5399, headers are NAKACK2: [MSG, seqno=1928], TP: [cluster=ISPN]
2025-03-27T14:42:39.1224657Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.MFC] () node2 used 5354 credits, 3160633 remaining
2025-03-27T14:42:39.1225621Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.UFC] () node1 used 41 credits, 3999179 remaining
2025-03-27T14:42:39.1227344Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=364, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster=ISPN]
2025-03-27T14:42:39.1229080Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#24, conn_id=0)
2025-03-27T14:42:39.1230025Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#24
2025-03-27T14:42:39.1231264Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=105, headers are UNICAST3: DATA, seqno=23, TP: [cluster=ISPN]
2025-03-27T14:42:39.1243094Z 2025-03-27 14:42:39,071 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#24, conn_id=0)
2025-03-27T14:42:39.1244839Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=364, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster=ISPN]
2025-03-27T14:42:39.1246473Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.UFC] () node2 used 2595 credits, 3992183 remaining
2025-03-27T14:42:39.1920975Z 2025-03-27 14:42:39,072 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5354 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1928], TP: [cluster=ISPN]
2025-03-27T14:42:39.1926176Z 2025-03-27 14:42:39,073 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1928
2025-03-27T14:42:39.1927453Z 2025-03-27 14:42:39,073 TRACE [org.jgroups.protocols.MFC] () node2 used 5354 credits, 3957406 remaining
2025-03-27T14:42:39.1930668Z 2025-03-27 14:42:39,074 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#25, conn_id=0)
2025-03-27T14:42:39.1932632Z 2025-03-27 14:42:39,076 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=105, headers are UNICAST3: DATA, seqno=25, TP: [cluster=ISPN]
2025-03-27T14:42:39.1934578Z 2025-03-27 14:42:39,076 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 41 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=25, TP: [cluster=ISPN]
2025-03-27T14:42:39.1936270Z 2025-03-27 14:42:39,076 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#25, conn_id=0)
2025-03-27T14:42:39.1937308Z 2025-03-27 14:42:39,077 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#25
2025-03-27T14:42:39.1938731Z 2025-03-27 14:42:39,077 INFO  [org.infinispan.CLUSTER] () [Context=authenticationSessions] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.1940157Z 2025-03-27 14:42:39,077 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1929
2025-03-27T14:42:39.1941614Z 2025-03-27 14:42:39,077 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5399, headers are NAKACK2: [MSG, seqno=1929], TP: [cluster=ISPN]
2025-03-27T14:42:39.1943629Z 2025-03-27 14:42:39,077 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5354 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1929], TP: [cluster=ISPN]
2025-03-27T14:42:39.1945148Z 2025-03-27 14:42:39,077 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1929
2025-03-27T14:42:39.1948389Z 2025-03-27 14:42:39,078 TRACE [org.jgroups.protocols.MFC] () node2 used 5354 credits, 3952052 remaining
2025-03-27T14:42:39.1949473Z 2025-03-27 14:42:39,077 TRACE [org.jgroups.protocols.MFC] () node2 used 5354 credits, 3155279 remaining
2025-03-27T14:42:39.1950714Z 2025-03-27 14:42:39,079 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#26, conn_id=0)
2025-03-27T14:42:39.1951953Z 2025-03-27 14:42:39,079 TRACE [org.jgroups.protocols.UFC] () node1 used 41 credits, 3999138 remaining
2025-03-27T14:42:39.1953860Z 2025-03-27 14:42:39,079 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=105, headers are UNICAST3: DATA, seqno=26, TP: [cluster=ISPN]
2025-03-27T14:42:39.1955814Z 2025-03-27 14:42:39,080 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 41 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=26, TP: [cluster=ISPN]
2025-03-27T14:42:39.1957808Z 2025-03-27 14:42:39,080 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#26, conn_id=0)
2025-03-27T14:42:39.1958790Z 2025-03-27 14:42:39,080 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#26
2025-03-27T14:42:39.1960156Z 2025-03-27 14:42:39,080 INFO  [org.infinispan.CLUSTER] () [Context=authenticationSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.1961548Z 2025-03-27 14:42:39,080 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1930
2025-03-27T14:42:39.1963181Z 2025-03-27 14:42:39,080 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=3309, headers are NAKACK2: [MSG, seqno=1930], TP: [cluster=ISPN]
2025-03-27T14:42:39.1964702Z 2025-03-27 14:42:39,080 TRACE [org.jgroups.protocols.MFC] () node2 used 3264 credits, 3152015 remaining
2025-03-27T14:42:39.1965765Z 2025-03-27 14:42:39,081 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1931
2025-03-27T14:42:39.1967096Z 2025-03-27 14:42:39,081 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=3308, headers are NAKACK2: [MSG, seqno=1931], TP: [cluster=ISPN]
2025-03-27T14:42:39.1968391Z 2025-03-27 14:42:39,081 TRACE [org.jgroups.protocols.MFC] () node2 used 3263 credits, 3148752 remaining
2025-03-27T14:42:39.1969545Z 2025-03-27 14:42:39,081 TRACE [org.jgroups.protocols.UFC] () node1 used 41 credits, 3999097 remaining
2025-03-27T14:42:39.1971007Z 2025-03-27 14:42:39,081 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 3264 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1930], TP: [cluster=ISPN]
2025-03-27T14:42:39.1972786Z 2025-03-27 14:42:39,081 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1930
2025-03-27T14:42:39.1973905Z 2025-03-27 14:42:39,082 TRACE [org.jgroups.protocols.MFC] () node2 used 3264 credits, 3948788 remaining
2025-03-27T14:42:39.1975384Z 2025-03-27 14:42:39,082 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 3263 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1931], TP: [cluster=ISPN]
2025-03-27T14:42:39.1976765Z 2025-03-27 14:42:39,082 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1931
2025-03-27T14:42:39.1977778Z 2025-03-27 14:42:39,083 TRACE [org.jgroups.protocols.MFC] () node2 used 3263 credits, 3945525 remaining
2025-03-27T14:42:39.1979029Z 2025-03-27 14:42:39,115 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#27, conn_id=0)
2025-03-27T14:42:39.1981318Z 2025-03-27 14:42:39,115 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=147, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster=ISPN]
2025-03-27T14:42:39.1984654Z 2025-03-27 14:42:39,116 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 74 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster=ISPN]
2025-03-27T14:42:39.1986479Z 2025-03-27 14:42:39,116 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#27, conn_id=0)
2025-03-27T14:42:39.1987501Z 2025-03-27 14:42:39,116 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#27
2025-03-27T14:42:39.1988952Z 2025-03-27 14:42:39,116 INFO  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.1990371Z 2025-03-27 14:42:39,116 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1932
2025-03-27T14:42:39.1991723Z 2025-03-27 14:42:39,116 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4366, headers are NAKACK2: [MSG, seqno=1932], TP: [cluster=ISPN]
2025-03-27T14:42:39.1993266Z 2025-03-27 14:42:39,117 TRACE [org.jgroups.protocols.MFC] () node2 used 4321 credits, 3144431 remaining
2025-03-27T14:42:39.1994761Z 2025-03-27 14:42:39,117 INFO  [org.infinispan.LIFECYCLE] () [Context=clientSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.1996273Z 2025-03-27 14:42:39,117 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#17, conn_id=31)
2025-03-27T14:42:39.1998003Z 2025-03-27 14:42:39,117 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.1999746Z 2025-03-27 14:42:39,117 TRACE [org.jgroups.protocols.UFC] () node1 used 74 credits, 3999023 remaining
2025-03-27T14:42:39.2001360Z 2025-03-27 14:42:39,117 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t1) [Context=clientSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2003731Z 2025-03-27 14:42:39,118 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4321 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1932], TP: [cluster=ISPN]
2025-03-27T14:42:39.2005404Z 2025-03-27 14:42:39,118 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1932
2025-03-27T14:42:39.2006901Z 2025-03-27 14:42:39,119 INFO  [org.infinispan.LIFECYCLE] () [Context=clientSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2008443Z 2025-03-27 14:42:39,119 TRACE [org.jgroups.protocols.MFC] () node2 used 4321 credits, 3941204 remaining
2025-03-27T14:42:39.2010551Z 2025-03-27 14:42:39,119 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2012670Z 2025-03-27 14:42:39,119 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#17, conn_id=31)
2025-03-27T14:42:39.2013693Z 2025-03-27 14:42:39,119 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#17
2025-03-27T14:42:39.2014909Z 2025-03-27 14:42:39,123 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#28, conn_id=0)
2025-03-27T14:42:39.2017148Z 2025-03-27 14:42:39,123 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=97, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster=ISPN]
2025-03-27T14:42:39.2019080Z 2025-03-27 14:42:39,123 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#29, conn_id=0)
2025-03-27T14:42:39.2020809Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=97, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster=ISPN]
2025-03-27T14:42:39.2023407Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 24 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster=ISPN]
2025-03-27T14:42:39.2025244Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#28, conn_id=0)
2025-03-27T14:42:39.2026234Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#28
2025-03-27T14:42:39.2027243Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#18, conn_id=31)
2025-03-27T14:42:39.2028971Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2030699Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.UFC] () node1 used 24 credits, 3998999 remaining
2025-03-27T14:42:39.2032808Z 2025-03-27 14:42:39,124 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 24 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster=ISPN]
2025-03-27T14:42:39.2034599Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#29, conn_id=0)
2025-03-27T14:42:39.2035583Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#29
2025-03-27T14:42:39.2036555Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#19, conn_id=31)
2025-03-27T14:42:39.2038444Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2040123Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UFC] () node1 used 24 credits, 3998975 remaining
2025-03-27T14:42:39.2042057Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2044104Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#18, conn_id=31)
2025-03-27T14:42:39.2045102Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#18
2025-03-27T14:42:39.2047298Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2049183Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#19, conn_id=31)
2025-03-27T14:42:39.2050190Z 2025-03-27 14:42:39,125 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#19
2025-03-27T14:42:39.2051506Z 2025-03-27 14:42:39,126 INFO  [org.infinispan.LIFECYCLE] () [Context=clientSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2053339Z 2025-03-27 14:42:39,126 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#30, conn_id=0)
2025-03-27T14:42:39.2055446Z 2025-03-27 14:42:39,126 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=127, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster=ISPN]
2025-03-27T14:42:39.2058116Z 2025-03-27 14:42:39,126 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 54 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster=ISPN]
2025-03-27T14:42:39.2059950Z 2025-03-27 14:42:39,126 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#30, conn_id=0)
2025-03-27T14:42:39.2060922Z 2025-03-27 14:42:39,126 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#30
2025-03-27T14:42:39.2061918Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#20, conn_id=31)
2025-03-27T14:42:39.2063842Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=1411, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=365, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2065572Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#21, conn_id=31)
2025-03-27T14:42:39.2067504Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 1337 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=365, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2070075Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2072789Z 2025-03-27 14:42:39,128 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2074748Z 2025-03-27 14:42:39,128 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#21, conn_id=31)
2025-03-27T14:42:39.2075730Z 2025-03-27 14:42:39,128 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#21
2025-03-27T14:42:39.2076703Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.UFC] () node1 used 54 credits, 3998921 remaining
2025-03-27T14:42:39.2077844Z 2025-03-27 14:42:39,127 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#20, conn_id=31)
2025-03-27T14:42:39.2078831Z 2025-03-27 14:42:39,128 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#20
2025-03-27T14:42:39.2079865Z 2025-03-27 14:42:39,129 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#31, conn_id=0)
2025-03-27T14:42:39.2081205Z 2025-03-27 14:42:39,129 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=97, headers are UNICAST3: DATA, seqno=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2083353Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 33 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2084917Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#31, conn_id=0)
2025-03-27T14:42:39.2085914Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#31
2025-03-27T14:42:39.2087223Z 2025-03-27 14:42:39,130 INFO  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.2088704Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1933
2025-03-27T14:42:39.2090090Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4367, headers are NAKACK2: [MSG, seqno=1933], TP: [cluster=ISPN]
2025-03-27T14:42:39.2091476Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.MFC] () node2 used 4322 credits, 3140109 remaining
2025-03-27T14:42:39.2092726Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UFC] () node1 used 33 credits, 3998888 remaining
2025-03-27T14:42:39.2094544Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=365, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster=ISPN]
2025-03-27T14:42:39.2096405Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#32, conn_id=0)
2025-03-27T14:42:39.2097416Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#32
2025-03-27T14:42:39.2098451Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#32, conn_id=0)
2025-03-27T14:42:39.2100188Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=365, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster=ISPN]
2025-03-27T14:42:39.2101901Z 2025-03-27 14:42:39,130 TRACE [org.jgroups.protocols.UFC] () node2 used 1337 credits, 3990846 remaining
2025-03-27T14:42:39.2103557Z 2025-03-27 14:42:39,131 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4322 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1933], TP: [cluster=ISPN]
2025-03-27T14:42:39.2105025Z 2025-03-27 14:42:39,131 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1933
2025-03-27T14:42:39.2106041Z 2025-03-27 14:42:39,132 TRACE [org.jgroups.protocols.MFC] () node2 used 4322 credits, 3936882 remaining
2025-03-27T14:42:39.2107259Z 2025-03-27 14:42:39,133 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#33, conn_id=0)
2025-03-27T14:42:39.2109151Z 2025-03-27 14:42:39,133 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=97, headers are UNICAST3: DATA, seqno=33, TP: [cluster=ISPN]
2025-03-27T14:42:39.2111100Z 2025-03-27 14:42:39,133 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 33 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=33, TP: [cluster=ISPN]
2025-03-27T14:42:39.2112833Z 2025-03-27 14:42:39,133 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#33, conn_id=0)
2025-03-27T14:42:39.2113993Z 2025-03-27 14:42:39,133 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#33
2025-03-27T14:42:39.2115311Z 2025-03-27 14:42:39,133 INFO  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.2116610Z 2025-03-27 14:42:39,134 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1934
2025-03-27T14:42:39.2118097Z 2025-03-27 14:42:39,134 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4367, headers are NAKACK2: [MSG, seqno=1934], TP: [cluster=ISPN]
2025-03-27T14:42:39.2119419Z 2025-03-27 14:42:39,134 TRACE [org.jgroups.protocols.MFC] () node2 used 4322 credits, 3135787 remaining
2025-03-27T14:42:39.2120411Z 2025-03-27 14:42:39,134 TRACE [org.jgroups.protocols.UFC] () node1 used 33 credits, 3998855 remaining
2025-03-27T14:42:39.2121881Z 2025-03-27 14:42:39,134 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4322 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1934], TP: [cluster=ISPN]
2025-03-27T14:42:39.2123519Z 2025-03-27 14:42:39,134 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1934
2025-03-27T14:42:39.2124647Z 2025-03-27 14:42:39,135 TRACE [org.jgroups.protocols.MFC] () node2 used 4322 credits, 3932560 remaining
2025-03-27T14:42:39.2125867Z 2025-03-27 14:42:39,135 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#34, conn_id=0)
2025-03-27T14:42:39.2127559Z 2025-03-27 14:42:39,135 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=97, headers are UNICAST3: DATA, seqno=34, TP: [cluster=ISPN]
2025-03-27T14:42:39.2129537Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 33 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=34, TP: [cluster=ISPN]
2025-03-27T14:42:39.2131009Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#34, conn_id=0)
2025-03-27T14:42:39.2131991Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#34
2025-03-27T14:42:39.2133488Z 2025-03-27 14:42:39,136 INFO  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.2134802Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1935
2025-03-27T14:42:39.2136122Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2277, headers are NAKACK2: [MSG, seqno=1935], TP: [cluster=ISPN]
2025-03-27T14:42:39.2137459Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.MFC] () node2 used 2232 credits, 3133555 remaining
2025-03-27T14:42:39.2138936Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2232 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1935], TP: [cluster=ISPN]
2025-03-27T14:42:39.2140394Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1935
2025-03-27T14:42:39.2141372Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.MFC] () node2 used 2232 credits, 3930328 remaining
2025-03-27T14:42:39.2142531Z 2025-03-27 14:42:39,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1936
2025-03-27T14:42:39.2144119Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2276, headers are NAKACK2: [MSG, seqno=1936], TP: [cluster=ISPN]
2025-03-27T14:42:39.2145413Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.MFC] () node2 used 2231 credits, 3131324 remaining
2025-03-27T14:42:39.2146384Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.UFC] () node1 used 33 credits, 3998822 remaining
2025-03-27T14:42:39.2148269Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2231 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1936], TP: [cluster=ISPN]
2025-03-27T14:42:39.2149700Z 2025-03-27 14:42:39,137 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1936
2025-03-27T14:42:39.2150693Z 2025-03-27 14:42:39,138 TRACE [org.jgroups.protocols.MFC] () node2 used 2231 credits, 3928097 remaining
2025-03-27T14:42:39.2151879Z 2025-03-27 14:42:39,160 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#35, conn_id=0)
2025-03-27T14:42:39.2154265Z 2025-03-27 14:42:39,161 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=146, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster=ISPN]
2025-03-27T14:42:39.2156932Z 2025-03-27 14:42:39,161 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 73 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster=ISPN]
2025-03-27T14:42:39.2158764Z 2025-03-27 14:42:39,161 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#35, conn_id=0)
2025-03-27T14:42:39.2159902Z 2025-03-27 14:42:39,161 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#35
2025-03-27T14:42:39.2161369Z 2025-03-27 14:42:39,162 INFO  [org.infinispan.CLUSTER] () [Context=loginFailures] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2163041Z 2025-03-27 14:42:39,162 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1937
2025-03-27T14:42:39.2164375Z 2025-03-27 14:42:39,162 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5389, headers are NAKACK2: [MSG, seqno=1937], TP: [cluster=ISPN]
2025-03-27T14:42:39.2165688Z 2025-03-27 14:42:39,162 TRACE [org.jgroups.protocols.MFC] () node2 used 5344 credits, 3125980 remaining
2025-03-27T14:42:39.2167208Z 2025-03-27 14:42:39,162 INFO  [org.infinispan.LIFECYCLE] () [Context=loginFailures] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2168715Z 2025-03-27 14:42:39,162 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#22, conn_id=31)
2025-03-27T14:42:39.2170454Z 2025-03-27 14:42:39,162 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2172178Z 2025-03-27 14:42:39,162 TRACE [org.jgroups.protocols.UFC] () node1 used 73 credits, 3998749 remaining
2025-03-27T14:42:39.2173928Z 2025-03-27 14:42:39,162 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t6) [Context=loginFailures] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2175912Z 2025-03-27 14:42:39,163 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5344 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1937], TP: [cluster=ISPN]
2025-03-27T14:42:39.2177427Z 2025-03-27 14:42:39,163 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1937
2025-03-27T14:42:39.2178903Z 2025-03-27 14:42:39,163 INFO  [org.infinispan.LIFECYCLE] () [Context=loginFailures] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2180583Z 2025-03-27 14:42:39,163 TRACE [org.jgroups.protocols.MFC] () node2 used 5344 credits, 3922753 remaining
2025-03-27T14:42:39.2182696Z 2025-03-27 14:42:39,164 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2184636Z 2025-03-27 14:42:39,164 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#22, conn_id=31)
2025-03-27T14:42:39.2185215Z 2025-03-27 14:42:39,165 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#22
2025-03-27T14:42:39.2185889Z 2025-03-27 14:42:39,166 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#36, conn_id=0)
2025-03-27T14:42:39.2186591Z 2025-03-27 14:42:39,166 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#37, conn_id=0)
2025-03-27T14:42:39.2188075Z 2025-03-27 14:42:39,166 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=96, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster=ISPN]
2025-03-27T14:42:39.2190624Z 2025-03-27 14:42:39,166 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=96, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster=ISPN]
2025-03-27T14:42:39.2192540Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 2 messages from node1
2025-03-27T14:42:39.2193778Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#36 - #37)
2025-03-27T14:42:39.2194841Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering #36 - #37 (2 messages)
2025-03-27T14:42:39.2195874Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#23, conn_id=31)
2025-03-27T14:42:39.2197110Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2198423Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#24, conn_id=31)
2025-03-27T14:42:39.2200203Z 2025-03-27 14:42:39,167 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2201939Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.UFC] () node1 used 46 credits, 3998703 remaining
2025-03-27T14:42:39.2203959Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2205866Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#23, conn_id=31)
2025-03-27T14:42:39.2206890Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#23
2025-03-27T14:42:39.2208702Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2210557Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#24, conn_id=31)
2025-03-27T14:42:39.2211516Z 2025-03-27 14:42:39,168 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#24
2025-03-27T14:42:39.2213216Z 2025-03-27 14:42:39,169 INFO  [org.infinispan.LIFECYCLE] () [Context=loginFailures] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2214601Z 2025-03-27 14:42:39,169 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#38, conn_id=0)
2025-03-27T14:42:39.2215933Z 2025-03-27 14:42:39,169 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=130, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster=ISPN]
2025-03-27T14:42:39.2217719Z 2025-03-27 14:42:39,169 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 57 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster=ISPN]
2025-03-27T14:42:39.2218743Z 2025-03-27 14:42:39,169 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#38, conn_id=0)
2025-03-27T14:42:39.2219649Z 2025-03-27 14:42:39,169 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#38
2025-03-27T14:42:39.2220695Z 2025-03-27 14:42:39,170 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#25, conn_id=31)
2025-03-27T14:42:39.2222613Z 2025-03-27 14:42:39,170 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2660, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=366, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2224368Z 2025-03-27 14:42:39,170 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#26, conn_id=31)
2025-03-27T14:42:39.2226356Z 2025-03-27 14:42:39,170 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2228100Z 2025-03-27 14:42:39,170 TRACE [org.jgroups.protocols.UFC] () node1 used 57 credits, 3998646 remaining
2025-03-27T14:42:39.2229285Z 2025-03-27 14:42:39,170 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 2586 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=366, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2230364Z 2025-03-27 14:42:39,171 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#25, conn_id=31)
2025-03-27T14:42:39.2231710Z 2025-03-27 14:42:39,171 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2233315Z 2025-03-27 14:42:39,171 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#25
2025-03-27T14:42:39.2234283Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#39, conn_id=0)
2025-03-27T14:42:39.2235750Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=366, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster=ISPN]
2025-03-27T14:42:39.2237460Z 2025-03-27 14:42:39,171 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#26, conn_id=31)
2025-03-27T14:42:39.2238468Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#26
2025-03-27T14:42:39.2239425Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.UFC] () node2 used 2586 credits, 3988260 remaining
2025-03-27T14:42:39.2240438Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#40, conn_id=0)
2025-03-27T14:42:39.2241774Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=96, headers are UNICAST3: DATA, seqno=40, TP: [cluster=ISPN]
2025-03-27T14:42:39.2243613Z 2025-03-27 14:42:39,172 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=366, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster=ISPN]
2025-03-27T14:42:39.2245430Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#39, conn_id=0)
2025-03-27T14:42:39.2246607Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#39
2025-03-27T14:42:39.2248039Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 32 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=40, TP: [cluster=ISPN]
2025-03-27T14:42:39.2249705Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#40, conn_id=0)
2025-03-27T14:42:39.2250720Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#40
2025-03-27T14:42:39.2252123Z 2025-03-27 14:42:39,173 INFO  [org.infinispan.CLUSTER] () [Context=loginFailures] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.2253670Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1938
2025-03-27T14:42:39.2254497Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5390, headers are NAKACK2: [MSG, seqno=1938], TP: [cluster=ISPN]
2025-03-27T14:42:39.2255262Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.MFC] () node2 used 5345 credits, 3120635 remaining
2025-03-27T14:42:39.2255952Z 2025-03-27 14:42:39,173 TRACE [org.jgroups.protocols.UFC] () node1 used 32 credits, 3998614 remaining
2025-03-27T14:42:39.2256845Z 2025-03-27 14:42:39,174 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5345 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1938], TP: [cluster=ISPN]
2025-03-27T14:42:39.2258309Z 2025-03-27 14:42:39,174 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1938
2025-03-27T14:42:39.2259322Z 2025-03-27 14:42:39,174 TRACE [org.jgroups.protocols.MFC] () node2 used 5345 credits, 3917408 remaining
2025-03-27T14:42:39.2260535Z 2025-03-27 14:42:39,175 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#41, conn_id=0)
2025-03-27T14:42:39.2262438Z 2025-03-27 14:42:39,175 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=96, headers are UNICAST3: DATA, seqno=41, TP: [cluster=ISPN]
2025-03-27T14:42:39.2264418Z 2025-03-27 14:42:39,176 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 32 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=41, TP: [cluster=ISPN]
2025-03-27T14:42:39.2265865Z 2025-03-27 14:42:39,176 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#41, conn_id=0)
2025-03-27T14:42:39.2266903Z 2025-03-27 14:42:39,176 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#41
2025-03-27T14:42:39.2268200Z 2025-03-27 14:42:39,176 INFO  [org.infinispan.CLUSTER] () [Context=loginFailures] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.2269485Z 2025-03-27 14:42:39,176 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1939
2025-03-27T14:42:39.2270768Z 2025-03-27 14:42:39,176 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=5390, headers are NAKACK2: [MSG, seqno=1939], TP: [cluster=ISPN]
2025-03-27T14:42:39.2272032Z 2025-03-27 14:42:39,176 TRACE [org.jgroups.protocols.MFC] () node2 used 5345 credits, 3115290 remaining
2025-03-27T14:42:39.2273687Z 2025-03-27 14:42:39,177 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 5345 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1939], TP: [cluster=ISPN]
2025-03-27T14:42:39.2275370Z 2025-03-27 14:42:39,177 TRACE [org.jgroups.protocols.UFC] () node1 used 32 credits, 3998582 remaining
2025-03-27T14:42:39.2276374Z 2025-03-27 14:42:39,177 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1939
2025-03-27T14:42:39.2277372Z 2025-03-27 14:42:39,177 TRACE [org.jgroups.protocols.MFC] () node2 used 5345 credits, 3912063 remaining
2025-03-27T14:42:39.2278593Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#42, conn_id=0)
2025-03-27T14:42:39.2280482Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=96, headers are UNICAST3: DATA, seqno=42, TP: [cluster=ISPN]
2025-03-27T14:42:39.2282637Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 32 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=42, TP: [cluster=ISPN]
2025-03-27T14:42:39.2284164Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#42, conn_id=0)
2025-03-27T14:42:39.2285290Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#42
2025-03-27T14:42:39.2286567Z 2025-03-27 14:42:39,178 INFO  [org.infinispan.CLUSTER] () [Context=loginFailures] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.2287755Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1940
2025-03-27T14:42:39.2288504Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=3300, headers are NAKACK2: [MSG, seqno=1940], TP: [cluster=ISPN]
2025-03-27T14:42:39.2289368Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.MFC] () node2 used 3255 credits, 3112035 remaining
2025-03-27T14:42:39.2289932Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1941
2025-03-27T14:42:39.2290661Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=3299, headers are NAKACK2: [MSG, seqno=1941], TP: [cluster=ISPN]
2025-03-27T14:42:39.2291382Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.MFC] () node2 used 3254 credits, 3108781 remaining
2025-03-27T14:42:39.2291920Z 2025-03-27 14:42:39,178 TRACE [org.jgroups.protocols.UFC] () node1 used 32 credits, 3998550 remaining
2025-03-27T14:42:39.2292931Z 2025-03-27 14:42:39,179 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 3255 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1940], TP: [cluster=ISPN]
2025-03-27T14:42:39.2293857Z 2025-03-27 14:42:39,179 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1940
2025-03-27T14:42:39.2294772Z 2025-03-27 14:42:39,179 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 3254 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1941], TP: [cluster=ISPN]
2025-03-27T14:42:39.2295556Z 2025-03-27 14:42:39,179 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1941
2025-03-27T14:42:39.2296084Z 2025-03-27 14:42:39,179 TRACE [org.jgroups.protocols.MFC] () node2 used 3255 credits, 3908808 remaining
2025-03-27T14:42:39.2296672Z 2025-03-27 14:42:39,179 TRACE [org.jgroups.protocols.MFC] () node2 used 3254 credits, 3905554 remaining
2025-03-27T14:42:39.2297197Z 2025-03-27 14:42:39,180 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: ACK(#26)
2025-03-27T14:42:39.2297943Z 2025-03-27 14:42:39,180 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=61, headers are UNICAST3: ACK, seqno=26, conn_id=31, ts=3, TP: [cluster=ISPN]
2025-03-27T14:42:39.2298735Z 2025-03-27 14:42:39,181 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node1
2025-03-27T14:42:39.2299345Z 2025-03-27 14:42:39,181 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: ACK(#26, conn-id=31, ts=3)
2025-03-27T14:42:39.2300161Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#43, conn_id=0)
2025-03-27T14:42:39.2301301Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=154, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster=ISPN]
2025-03-27T14:42:39.2303089Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 81 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster=ISPN]
2025-03-27T14:42:39.2304916Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#43, conn_id=0)
2025-03-27T14:42:39.2305941Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#43
2025-03-27T14:42:39.2307656Z 2025-03-27 14:42:39,185 INFO  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2309254Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1942
2025-03-27T14:42:39.2310628Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4373, headers are NAKACK2: [MSG, seqno=1942], TP: [cluster=ISPN]
2025-03-27T14:42:39.2312022Z 2025-03-27 14:42:39,185 TRACE [org.jgroups.protocols.MFC] () node2 used 4328 credits, 3104453 remaining
2025-03-27T14:42:39.2313923Z 2025-03-27 14:42:39,185 INFO  [org.infinispan.LIFECYCLE] () [Context=offlineClientSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2315509Z 2025-03-27 14:42:39,186 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#27, conn_id=31)
2025-03-27T14:42:39.2317273Z 2025-03-27 14:42:39,186 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2318991Z 2025-03-27 14:42:39,186 TRACE [org.jgroups.protocols.UFC] () node1 used 81 credits, 3998469 remaining
2025-03-27T14:42:39.2320573Z 2025-03-27 14:42:39,186 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t8) [Context=offlineClientSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2322809Z 2025-03-27 14:42:39,186 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4328 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1942], TP: [cluster=ISPN]
2025-03-27T14:42:39.2324267Z 2025-03-27 14:42:39,186 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1942
2025-03-27T14:42:39.2325801Z 2025-03-27 14:42:39,186 INFO  [org.infinispan.LIFECYCLE] () [Context=offlineClientSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2327295Z 2025-03-27 14:42:39,186 TRACE [org.jgroups.protocols.MFC] () node2 used 4328 credits, 3901226 remaining
2025-03-27T14:42:39.2329191Z 2025-03-27 14:42:39,187 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2331096Z 2025-03-27 14:42:39,187 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#27, conn_id=31)
2025-03-27T14:42:39.2332105Z 2025-03-27 14:42:39,187 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#27
2025-03-27T14:42:39.2333447Z 2025-03-27 14:42:39,188 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#44, conn_id=0)
2025-03-27T14:42:39.2335709Z 2025-03-27 14:42:39,188 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=104, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster=ISPN]
2025-03-27T14:42:39.2338353Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 31 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster=ISPN]
2025-03-27T14:42:39.2340405Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#44, conn_id=0)
2025-03-27T14:42:39.2341437Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#44
2025-03-27T14:42:39.2342679Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#28, conn_id=31)
2025-03-27T14:42:39.2344600Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2346366Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.UFC] () node1 used 31 credits, 3998438 remaining
2025-03-27T14:42:39.2347426Z 2025-03-27 14:42:39,189 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#45, conn_id=0)
2025-03-27T14:42:39.2349333Z 2025-03-27 14:42:39,190 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2351305Z 2025-03-27 14:42:39,190 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#28, conn_id=31)
2025-03-27T14:42:39.2352549Z 2025-03-27 14:42:39,190 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#28
2025-03-27T14:42:39.2353945Z 2025-03-27 14:42:39,190 INFO  [org.infinispan.LIFECYCLE] () [Context=offlineClientSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2356020Z 2025-03-27 14:42:39,190 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=104, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster=ISPN]
2025-03-27T14:42:39.2515237Z 2025-03-27 14:42:39,190 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#46, conn_id=0)
2025-03-27T14:42:39.2518919Z 2025-03-27 14:42:39,190 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=134, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster=ISPN]
2025-03-27T14:42:39.2520809Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 2 messages from node1
2025-03-27T14:42:39.2521937Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#45 - #46)
2025-03-27T14:42:39.2523249Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering #45 - #46 (2 messages)
2025-03-27T14:42:39.2524292Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#29, conn_id=31)
2025-03-27T14:42:39.2530061Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2531846Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#30, conn_id=31)
2025-03-27T14:42:39.2533691Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=1418, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=367, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2535549Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#31, conn_id=31)
2025-03-27T14:42:39.2537162Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2539026Z 2025-03-27 14:42:39,191 TRACE [org.jgroups.protocols.UFC] () node1 used 92 credits, 3998346 remaining
2025-03-27T14:42:39.2540910Z 2025-03-27 14:42:39,192 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2543505Z 2025-03-27 14:42:39,192 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#29, conn_id=31)
2025-03-27T14:42:39.2552770Z 2025-03-27 14:42:39,192 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#29
2025-03-27T14:42:39.2553870Z 2025-03-27 14:42:39,193 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 2 messages from node2
2025-03-27T14:42:39.2554956Z 2025-03-27 14:42:39,193 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#30 - #31)
2025-03-27T14:42:39.2556006Z 2025-03-27 14:42:39,193 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering #30 - #31 (2 messages)
2025-03-27T14:42:39.2557078Z 2025-03-27 14:42:39,193 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#47, conn_id=0)
2025-03-27T14:42:39.2558937Z 2025-03-27 14:42:39,193 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=367, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster=ISPN]
2025-03-27T14:42:39.2560658Z 2025-03-27 14:42:39,194 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#48, conn_id=0)
2025-03-27T14:42:39.2561988Z 2025-03-27 14:42:39,194 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=104, headers are UNICAST3: DATA, seqno=48, TP: [cluster=ISPN]
2025-03-27T14:42:39.2564222Z 2025-03-27 14:42:39,194 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=367, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster=ISPN]
2025-03-27T14:42:39.2566036Z 2025-03-27 14:42:39,194 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#47, conn_id=0)
2025-03-27T14:42:39.2567029Z 2025-03-27 14:42:39,194 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#47
2025-03-27T14:42:39.2568460Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 40 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=48, TP: [cluster=ISPN]
2025-03-27T14:42:39.2569947Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#48, conn_id=0)
2025-03-27T14:42:39.2570957Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#48
2025-03-27T14:42:39.2572476Z 2025-03-27 14:42:39,195 INFO  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.2573847Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1943
2025-03-27T14:42:39.2575129Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4374, headers are NAKACK2: [MSG, seqno=1943], TP: [cluster=ISPN]
2025-03-27T14:42:39.2576494Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.MFC] () node2 used 4329 credits, 3100124 remaining
2025-03-27T14:42:39.2577781Z 2025-03-27 14:42:39,195 TRACE [org.jgroups.protocols.UFC] () node1 used 40 credits, 3998306 remaining
2025-03-27T14:42:39.2578831Z 2025-03-27 14:42:39,194 TRACE [org.jgroups.protocols.UFC] () node2 used 1344 credits, 3986916 remaining
2025-03-27T14:42:39.2580339Z 2025-03-27 14:42:39,196 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4329 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1943], TP: [cluster=ISPN]
2025-03-27T14:42:39.2581985Z 2025-03-27 14:42:39,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1943
2025-03-27T14:42:39.2588640Z 2025-03-27 14:42:39,197 TRACE [org.jgroups.protocols.MFC] () node2 used 4329 credits, 3896897 remaining
2025-03-27T14:42:39.2589922Z 2025-03-27 14:42:39,197 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#49, conn_id=0)
2025-03-27T14:42:39.2591662Z 2025-03-27 14:42:39,197 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=104, headers are UNICAST3: DATA, seqno=49, TP: [cluster=ISPN]
2025-03-27T14:42:39.2594071Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 40 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=49, TP: [cluster=ISPN]
2025-03-27T14:42:39.2595554Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#49, conn_id=0)
2025-03-27T14:42:39.2596548Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#49
2025-03-27T14:42:39.2597889Z 2025-03-27 14:42:39,198 INFO  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.2599390Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1944
2025-03-27T14:42:39.2600720Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4374, headers are NAKACK2: [MSG, seqno=1944], TP: [cluster=ISPN]
2025-03-27T14:42:39.2602116Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.MFC] () node2 used 4329 credits, 3095795 remaining
2025-03-27T14:42:39.2603271Z 2025-03-27 14:42:39,198 TRACE [org.jgroups.protocols.UFC] () node1 used 40 credits, 3998266 remaining
2025-03-27T14:42:39.2604758Z 2025-03-27 14:42:39,199 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4329 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1944], TP: [cluster=ISPN]
2025-03-27T14:42:39.2611223Z 2025-03-27 14:42:39,199 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1944
2025-03-27T14:42:39.2612441Z 2025-03-27 14:42:39,199 TRACE [org.jgroups.protocols.MFC] () node2 used 4329 credits, 3892568 remaining
2025-03-27T14:42:39.2613691Z 2025-03-27 14:42:39,200 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#50, conn_id=0)
2025-03-27T14:42:39.2615388Z 2025-03-27 14:42:39,200 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=104, headers are UNICAST3: DATA, seqno=50, TP: [cluster=ISPN]
2025-03-27T14:42:39.2617312Z 2025-03-27 14:42:39,200 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 40 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=50, TP: [cluster=ISPN]
2025-03-27T14:42:39.2618862Z 2025-03-27 14:42:39,200 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#50, conn_id=0)
2025-03-27T14:42:39.2619839Z 2025-03-27 14:42:39,200 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#50
2025-03-27T14:42:39.2621175Z 2025-03-27 14:42:39,200 INFO  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.2622685Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1945
2025-03-27T14:42:39.2624181Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2284, headers are NAKACK2: [MSG, seqno=1945], TP: [cluster=ISPN]
2025-03-27T14:42:39.2625483Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.MFC] () node2 used 2239 credits, 3093556 remaining
2025-03-27T14:42:39.2631660Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1946
2025-03-27T14:42:39.2633408Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2283, headers are NAKACK2: [MSG, seqno=1946], TP: [cluster=ISPN]
2025-03-27T14:42:39.2634763Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.MFC] () node2 used 2238 credits, 3091318 remaining
2025-03-27T14:42:39.2635786Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.UFC] () node1 used 40 credits, 3998226 remaining
2025-03-27T14:42:39.2637229Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2239 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1945], TP: [cluster=ISPN]
2025-03-27T14:42:39.2638771Z 2025-03-27 14:42:39,201 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1945
2025-03-27T14:42:39.2639749Z 2025-03-27 14:42:39,202 TRACE [org.jgroups.protocols.MFC] () node2 used 2239 credits, 3890329 remaining
2025-03-27T14:42:39.2641206Z 2025-03-27 14:42:39,202 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2238 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1946], TP: [cluster=ISPN]
2025-03-27T14:42:39.2642783Z 2025-03-27 14:42:39,202 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1946
2025-03-27T14:42:39.2643874Z 2025-03-27 14:42:39,202 TRACE [org.jgroups.protocols.MFC] () node2 used 2238 credits, 3888091 remaining
2025-03-27T14:42:39.2645126Z 2025-03-27 14:42:39,208 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#51, conn_id=0)
2025-03-27T14:42:39.2647204Z 2025-03-27 14:42:39,208 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=148, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster=ISPN]
2025-03-27T14:42:39.2649874Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 75 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster=ISPN]
2025-03-27T14:42:39.2651713Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#51, conn_id=0)
2025-03-27T14:42:39.2653256Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#51
2025-03-27T14:42:39.2654695Z 2025-03-27 14:42:39,209 INFO  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2656151Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1947
2025-03-27T14:42:39.2657432Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4367, headers are NAKACK2: [MSG, seqno=1947], TP: [cluster=ISPN]
2025-03-27T14:42:39.2658761Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.MFC] () node2 used 4322 credits, 3086996 remaining
2025-03-27T14:42:39.2660287Z 2025-03-27 14:42:39,209 INFO  [org.infinispan.LIFECYCLE] () [Context=offlineSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2661821Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#32, conn_id=31)
2025-03-27T14:42:39.2663720Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2665642Z 2025-03-27 14:42:39,209 TRACE [org.jgroups.protocols.UFC] () node1 used 75 credits, 3998151 remaining
2025-03-27T14:42:39.2667191Z 2025-03-27 14:42:39,209 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t7) [Context=offlineSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2669343Z 2025-03-27 14:42:39,210 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4322 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1947], TP: [cluster=ISPN]
2025-03-27T14:42:39.2670790Z 2025-03-27 14:42:39,210 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1947
2025-03-27T14:42:39.2672452Z 2025-03-27 14:42:39,210 INFO  [org.infinispan.LIFECYCLE] () [Context=offlineSessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2674085Z 2025-03-27 14:42:39,211 TRACE [org.jgroups.protocols.MFC] () node2 used 4322 credits, 3883769 remaining
2025-03-27T14:42:39.2675968Z 2025-03-27 14:42:39,211 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2677870Z 2025-03-27 14:42:39,211 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#32, conn_id=31)
2025-03-27T14:42:39.2678863Z 2025-03-27 14:42:39,211 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#32
2025-03-27T14:42:39.2680132Z 2025-03-27 14:42:39,212 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#52, conn_id=0)
2025-03-27T14:42:39.2682407Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=98, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster=ISPN]
2025-03-27T14:42:39.2684328Z 2025-03-27 14:42:39,213 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#53, conn_id=0)
2025-03-27T14:42:39.2686188Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 25 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster=ISPN]
2025-03-27T14:42:39.2687995Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#52, conn_id=0)
2025-03-27T14:42:39.2688956Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#52
2025-03-27T14:42:39.2689911Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#33, conn_id=31)
2025-03-27T14:42:39.2691595Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2693385Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.UFC] () node1 used 25 credits, 3998126 remaining
2025-03-27T14:42:39.2695000Z 2025-03-27 14:42:39,214 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=98, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster=ISPN]
2025-03-27T14:42:39.2697414Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 25 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster=ISPN]
2025-03-27T14:42:39.2699164Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#53, conn_id=0)
2025-03-27T14:42:39.2700244Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#53
2025-03-27T14:42:39.2702109Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2704261Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#33, conn_id=31)
2025-03-27T14:42:39.2705311Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#34, conn_id=31)
2025-03-27T14:42:39.2707082Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2708767Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#33
2025-03-27T14:42:39.2709813Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UFC] () node1 used 25 credits, 3998101 remaining
2025-03-27T14:42:39.2710789Z 2025-03-27 14:42:39,215 INFO  [org.infinispan.LIFECYCLE] () [Context=offlineSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2711671Z 2025-03-27 14:42:39,215 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#54, conn_id=0)
2025-03-27T14:42:39.2713256Z 2025-03-27 14:42:39,216 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=128, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster=ISPN]
2025-03-27T14:42:39.2714796Z 2025-03-27 14:42:39,216 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2715811Z 2025-03-27 14:42:39,216 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#34, conn_id=31)
2025-03-27T14:42:39.2716353Z 2025-03-27 14:42:39,216 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#34
2025-03-27T14:42:39.2717321Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster=ISPN]
2025-03-27T14:42:39.2718308Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#54, conn_id=0)
2025-03-27T14:42:39.2718846Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#54
2025-03-27T14:42:39.2719383Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#35, conn_id=31)
2025-03-27T14:42:39.2720342Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=1412, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=368, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2721289Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#36, conn_id=31)
2025-03-27T14:42:39.2722384Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2723347Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.UFC] () node1 used 55 credits, 3998046 remaining
2025-03-27T14:42:39.2724386Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 1338 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=368, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2725994Z 2025-03-27 14:42:39,218 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2727059Z 2025-03-27 14:42:39,219 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#35, conn_id=31)
2025-03-27T14:42:39.2727620Z 2025-03-27 14:42:39,219 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#36, conn_id=31)
2025-03-27T14:42:39.2728163Z 2025-03-27 14:42:39,219 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#35
2025-03-27T14:42:39.2728670Z 2025-03-27 14:42:39,219 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#36
2025-03-27T14:42:39.2729205Z 2025-03-27 14:42:39,219 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#55, conn_id=0)
2025-03-27T14:42:39.2729997Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=98, headers are UNICAST3: DATA, seqno=55, TP: [cluster=ISPN]
2025-03-27T14:42:39.2730722Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#56, conn_id=0)
2025-03-27T14:42:39.2731648Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=368, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster=ISPN]
2025-03-27T14:42:39.2732736Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UFC] () node2 used 1338 credits, 3985578 remaining
2025-03-27T14:42:39.2733540Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 34 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=55, TP: [cluster=ISPN]
2025-03-27T14:42:39.2734344Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#55, conn_id=0)
2025-03-27T14:42:39.2734879Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#55
2025-03-27T14:42:39.2735590Z 2025-03-27 14:42:39,220 INFO  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.2736556Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1948
2025-03-27T14:42:39.2737283Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4368, headers are NAKACK2: [MSG, seqno=1948], TP: [cluster=ISPN]
2025-03-27T14:42:39.2738004Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.MFC] () node2 used 4323 credits, 3082673 remaining
2025-03-27T14:42:39.2738544Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UFC] () node1 used 34 credits, 3998012 remaining
2025-03-27T14:42:39.2739528Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=368, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster=ISPN]
2025-03-27T14:42:39.2740520Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#56, conn_id=0)
2025-03-27T14:42:39.2741059Z 2025-03-27 14:42:39,220 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#56
2025-03-27T14:42:39.2741858Z 2025-03-27 14:42:39,221 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4323 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1948], TP: [cluster=ISPN]
2025-03-27T14:42:39.2742781Z 2025-03-27 14:42:39,221 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1948
2025-03-27T14:42:39.2743316Z 2025-03-27 14:42:39,221 TRACE [org.jgroups.protocols.MFC] () node2 used 4323 credits, 3879446 remaining
2025-03-27T14:42:39.2744091Z 2025-03-27 14:42:39,222 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#57, conn_id=0)
2025-03-27T14:42:39.2745037Z 2025-03-27 14:42:39,222 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=98, headers are UNICAST3: DATA, seqno=57, TP: [cluster=ISPN]
2025-03-27T14:42:39.2746169Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 34 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=57, TP: [cluster=ISPN]
2025-03-27T14:42:39.2746966Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#57, conn_id=0)
2025-03-27T14:42:39.2747505Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#57
2025-03-27T14:42:39.2748224Z 2025-03-27 14:42:39,223 INFO  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.2749005Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1949
2025-03-27T14:42:39.2749729Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4368, headers are NAKACK2: [MSG, seqno=1949], TP: [cluster=ISPN]
2025-03-27T14:42:39.2750445Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.MFC] () node2 used 4323 credits, 3078350 remaining
2025-03-27T14:42:39.2750991Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.UFC] () node1 used 34 credits, 3997978 remaining
2025-03-27T14:42:39.2751845Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4323 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1949], TP: [cluster=ISPN]
2025-03-27T14:42:39.2752901Z 2025-03-27 14:42:39,223 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1949
2025-03-27T14:42:39.2753452Z 2025-03-27 14:42:39,224 TRACE [org.jgroups.protocols.MFC] () node2 used 4323 credits, 3875123 remaining
2025-03-27T14:42:39.2754116Z 2025-03-27 14:42:39,224 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#58, conn_id=0)
2025-03-27T14:42:39.2755058Z 2025-03-27 14:42:39,224 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=98, headers are UNICAST3: DATA, seqno=58, TP: [cluster=ISPN]
2025-03-27T14:42:39.2756291Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 34 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=58, TP: [cluster=ISPN]
2025-03-27T14:42:39.2757097Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#58, conn_id=0)
2025-03-27T14:42:39.2757633Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#58
2025-03-27T14:42:39.2758355Z 2025-03-27 14:42:39,225 INFO  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.2759077Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1950
2025-03-27T14:42:39.2759796Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2278, headers are NAKACK2: [MSG, seqno=1950], TP: [cluster=ISPN]
2025-03-27T14:42:39.2760523Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.MFC] () node2 used 2233 credits, 3076117 remaining
2025-03-27T14:42:39.2761068Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1951
2025-03-27T14:42:39.2761777Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2277, headers are NAKACK2: [MSG, seqno=1951], TP: [cluster=ISPN]
2025-03-27T14:42:39.2762815Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.MFC] () node2 used 2232 credits, 3073885 remaining
2025-03-27T14:42:39.2763366Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.UFC] () node1 used 34 credits, 3997944 remaining
2025-03-27T14:42:39.2764166Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2233 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1950], TP: [cluster=ISPN]
2025-03-27T14:42:39.2765029Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1950
2025-03-27T14:42:39.2765811Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2232 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1951], TP: [cluster=ISPN]
2025-03-27T14:42:39.2766585Z 2025-03-27 14:42:39,225 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1951
2025-03-27T14:42:39.2767114Z 2025-03-27 14:42:39,226 TRACE [org.jgroups.protocols.MFC] () node2 used 2232 credits, 3872891 remaining
2025-03-27T14:42:39.2767718Z 2025-03-27 14:42:39,226 TRACE [org.jgroups.protocols.MFC] () node2 used 2233 credits, 3870658 remaining
2025-03-27T14:42:39.2768382Z 2025-03-27 14:42:39,231 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#59, conn_id=0)
2025-03-27T14:42:39.2769527Z 2025-03-27 14:42:39,231 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=141, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster=ISPN]
2025-03-27T14:42:39.2771037Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 68 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster=ISPN]
2025-03-27T14:42:39.2772027Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#59, conn_id=0)
2025-03-27T14:42:39.2772684Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#59
2025-03-27T14:42:39.2773456Z 2025-03-27 14:42:39,232 INFO  [org.infinispan.CLUSTER] () [Context=sessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2774216Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1952
2025-03-27T14:42:39.2774930Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4360, headers are NAKACK2: [MSG, seqno=1952], TP: [cluster=ISPN]
2025-03-27T14:42:39.2775643Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.MFC] () node2 used 4315 credits, 3069570 remaining
2025-03-27T14:42:39.2776422Z 2025-03-27 14:42:39,232 INFO  [org.infinispan.LIFECYCLE] () [Context=sessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2777221Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#37, conn_id=31)
2025-03-27T14:42:39.2778175Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=4392, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2779377Z 2025-03-27 14:42:39,232 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t2) [Context=sessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2780187Z 2025-03-27 14:42:39,232 TRACE [org.jgroups.protocols.UFC] () node1 used 68 credits, 3997876 remaining
2025-03-27T14:42:39.2780984Z 2025-03-27 14:42:39,233 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4315 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1952], TP: [cluster=ISPN]
2025-03-27T14:42:39.2781843Z 2025-03-27 14:42:39,233 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1952
2025-03-27T14:42:39.2782954Z 2025-03-27 14:42:39,233 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 4319 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2783969Z 2025-03-27 14:42:39,233 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#37, conn_id=31)
2025-03-27T14:42:39.2784576Z 2025-03-27 14:42:39,233 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#37
2025-03-27T14:42:39.2785341Z 2025-03-27 14:42:39,233 INFO  [org.infinispan.LIFECYCLE] () [Context=sessions] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.2786121Z 2025-03-27 14:42:39,233 TRACE [org.jgroups.protocols.MFC] () node2 used 4315 credits, 3866343 remaining
2025-03-27T14:42:39.2786843Z 2025-03-27 14:42:39,234 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t6) node1 --> node2: DATA(#60, conn_id=0)
2025-03-27T14:42:39.2787984Z 2025-03-27 14:42:39,234 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to node2, src=node1, size=91, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=60, TP: [cluster=ISPN]
2025-03-27T14:42:39.2789023Z 2025-03-27 14:42:39,234 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#61, conn_id=0)
2025-03-27T14:42:39.2789968Z 2025-03-27 14:42:39,234 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=91, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=61, TP: [cluster=ISPN]
2025-03-27T14:42:39.2791396Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 18 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=60, TP: [cluster=ISPN]
2025-03-27T14:42:39.2793101Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 18 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=61, TP: [cluster=ISPN]
2025-03-27T14:42:39.2794109Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#61, conn_id=0)
2025-03-27T14:42:39.2794650Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#61
2025-03-27T14:42:39.2795185Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#60, conn_id=0)
2025-03-27T14:42:39.2795746Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#38, conn_id=31)
2025-03-27T14:42:39.2796285Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#60
2025-03-27T14:42:39.2797213Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2798149Z 2025-03-27 14:42:39,235 TRACE [org.jgroups.protocols.UFC] () node1 used 18 credits, 3997858 remaining
2025-03-27T14:42:39.2798705Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#39, conn_id=31)
2025-03-27T14:42:39.2799848Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=79, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2800802Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.UFC] () node1 used 18 credits, 3997840 remaining
2025-03-27T14:42:39.2802102Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2803428Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#38, conn_id=31)
2025-03-27T14:42:39.2803970Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#38
2025-03-27T14:42:39.2805190Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2806287Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#39, conn_id=31)
2025-03-27T14:42:39.2806857Z 2025-03-27 14:42:39,236 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#39
2025-03-27T14:42:39.2807583Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#62, conn_id=0)
2025-03-27T14:42:39.2808889Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=121, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=62, TP: [cluster=ISPN]
2025-03-27T14:42:39.2810096Z 2025-03-27 14:42:39,237 INFO  [org.infinispan.LIFECYCLE] () [Context=sessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.2811311Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 48 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=62, TP: [cluster=ISPN]
2025-03-27T14:42:39.2812436Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#62, conn_id=0)
2025-03-27T14:42:39.2812978Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#62
2025-03-27T14:42:39.2813491Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#62)
2025-03-27T14:42:39.2814198Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=62, ts=172, TP: [cluster=ISPN]
2025-03-27T14:42:39.2814953Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#40, conn_id=31)
2025-03-27T14:42:39.2815912Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=1405, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=369, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2816867Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#41, conn_id=31)
2025-03-27T14:42:39.2817810Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.2818737Z 2025-03-27 14:42:39,237 TRACE [org.jgroups.protocols.UFC] () node1 used 48 credits, 3997792 remaining
2025-03-27T14:42:39.2819319Z 2025-03-27 14:42:39,238 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 1 messages from node2
2025-03-27T14:42:39.2819934Z 2025-03-27 14:42:39,238 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: ACK(#62, conn-id=0, ts=172)
2025-03-27T14:42:39.2820543Z 2025-03-27 14:42:39,238 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 2 messages from node2
2025-03-27T14:42:39.2821126Z 2025-03-27 14:42:39,238 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#40 - #41)
2025-03-27T14:42:39.2821772Z 2025-03-27 14:42:39,238 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering #40 - #41 (2 messages)
2025-03-27T14:42:39.2822440Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#63, conn_id=0)
2025-03-27T14:42:39.2823364Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=369, rsp_expected=true, UNICAST3: DATA, seqno=63, TP: [cluster=ISPN]
2025-03-27T14:42:39.2824768Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=369, rsp_expected=true, UNICAST3: DATA, seqno=63, TP: [cluster=ISPN]
2025-03-27T14:42:39.2825757Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#63, conn_id=0)
2025-03-27T14:42:39.2826317Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#63
2025-03-27T14:42:39.2826917Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#64, conn_id=0)
2025-03-27T14:42:39.2827661Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=91, headers are UNICAST3: DATA, seqno=64, TP: [cluster=ISPN]
2025-03-27T14:42:39.2828370Z 2025-03-27 14:42:39,239 TRACE [org.jgroups.protocols.UFC] () node2 used 1331 credits, 3984247 remaining
2025-03-27T14:42:39.2829169Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 27 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=64, TP: [cluster=ISPN]
2025-03-27T14:42:39.2830030Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#64, conn_id=0)
2025-03-27T14:42:39.2830568Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#64
2025-03-27T14:42:39.2831262Z 2025-03-27 14:42:39,240 INFO  [org.infinispan.CLUSTER] () [Context=sessions] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.2831956Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1953
2025-03-27T14:42:39.2832904Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4361, headers are NAKACK2: [MSG, seqno=1953], TP: [cluster=ISPN]
2025-03-27T14:42:39.2833625Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.MFC] () node2 used 4316 credits, 3065254 remaining
2025-03-27T14:42:39.2834170Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.UFC] () node1 used 27 credits, 3997765 remaining
2025-03-27T14:42:39.2834972Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4316 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1953], TP: [cluster=ISPN]
2025-03-27T14:42:39.2835765Z 2025-03-27 14:42:39,240 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1953
2025-03-27T14:42:39.2836302Z 2025-03-27 14:42:39,241 TRACE [org.jgroups.protocols.MFC] () node2 used 4316 credits, 3862027 remaining
2025-03-27T14:42:39.2836968Z 2025-03-27 14:42:39,241 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#65, conn_id=0)
2025-03-27T14:42:39.2837917Z 2025-03-27 14:42:39,241 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=91, headers are UNICAST3: DATA, seqno=65, TP: [cluster=ISPN]
2025-03-27T14:42:39.2838994Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 27 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=65, TP: [cluster=ISPN]
2025-03-27T14:42:39.2839803Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#65, conn_id=0)
2025-03-27T14:42:39.2840422Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#65
2025-03-27T14:42:39.2841109Z 2025-03-27 14:42:39,242 INFO  [org.infinispan.CLUSTER] () [Context=sessions] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.2841807Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1954
2025-03-27T14:42:39.2842739Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=4361, headers are NAKACK2: [MSG, seqno=1954], TP: [cluster=ISPN]
2025-03-27T14:42:39.2843551Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.MFC] () node2 used 4316 credits, 3060938 remaining
2025-03-27T14:42:39.2852040Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.UFC] () node1 used 27 credits, 3997738 remaining
2025-03-27T14:42:39.2853158Z 2025-03-27 14:42:39,242 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 4316 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1954], TP: [cluster=ISPN]
2025-03-27T14:42:39.2854094Z 2025-03-27 14:42:39,243 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1954
2025-03-27T14:42:39.2854676Z 2025-03-27 14:42:39,243 TRACE [org.jgroups.protocols.MFC] () node2 used 4316 credits, 3857711 remaining
2025-03-27T14:42:39.2855360Z 2025-03-27 14:42:39,243 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#66, conn_id=0)
2025-03-27T14:42:39.2856413Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=91, headers are UNICAST3: DATA, seqno=66, TP: [cluster=ISPN]
2025-03-27T14:42:39.2857692Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 27 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=66, TP: [cluster=ISPN]
2025-03-27T14:42:39.2858535Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#66, conn_id=0)
2025-03-27T14:42:39.2859107Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#66
2025-03-27T14:42:39.2859792Z 2025-03-27 14:42:39,244 INFO  [org.infinispan.CLUSTER] () [Context=sessions] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.2860480Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1955
2025-03-27T14:42:39.2861196Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2271, headers are NAKACK2: [MSG, seqno=1955], TP: [cluster=ISPN]
2025-03-27T14:42:39.2861915Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.MFC] () node2 used 2226 credits, 3058712 remaining
2025-03-27T14:42:39.2862579Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1956
2025-03-27T14:42:39.2863286Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2270, headers are NAKACK2: [MSG, seqno=1956], TP: [cluster=ISPN]
2025-03-27T14:42:39.2864003Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.MFC] () node2 used 2225 credits, 3056487 remaining
2025-03-27T14:42:39.2864544Z 2025-03-27 14:42:39,244 TRACE [org.jgroups.protocols.UFC] () node1 used 27 credits, 3997711 remaining
2025-03-27T14:42:39.2865341Z 2025-03-27 14:42:39,245 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2226 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1955], TP: [cluster=ISPN]
2025-03-27T14:42:39.2866379Z 2025-03-27 14:42:39,245 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2225 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1956], TP: [cluster=ISPN]
2025-03-27T14:42:39.2867158Z 2025-03-27 14:42:39,245 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1955
2025-03-27T14:42:39.2867671Z 2025-03-27 14:42:39,245 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1956
2025-03-27T14:42:39.2868300Z 2025-03-27 14:42:39,245 TRACE [org.jgroups.protocols.MFC] () node2 used 2226 credits, 3855485 remaining
2025-03-27T14:42:39.2868838Z 2025-03-27 14:42:39,245 TRACE [org.jgroups.protocols.MFC] () node2 used 2225 credits, 3855486 remaining
2025-03-27T14:42:39.2869505Z 2025-03-27 14:42:39,250 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t5) node1 --> node2: DATA(#67, conn_id=0)
2025-03-27T14:42:39.2870715Z 2025-03-27 14:42:39,250 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to node2, src=node1, size=137, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster=ISPN]
2025-03-27T14:42:39.4564879Z 2025-03-27 14:42:39,250 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 64 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster=ISPN]
2025-03-27T14:42:39.4567076Z 2025-03-27 14:42:39,250 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#67, conn_id=0)
2025-03-27T14:42:39.4568056Z 2025-03-27 14:42:39,250 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#67
2025-03-27T14:42:39.4569347Z 2025-03-27 14:42:39,251 INFO  [org.infinispan.CLUSTER] () [Context=work] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.4570663Z 2025-03-27 14:42:39,251 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1957
2025-03-27T14:42:39.4571888Z 2025-03-27 14:42:39,251 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2326, headers are NAKACK2: [MSG, seqno=1957], TP: [cluster=ISPN]
2025-03-27T14:42:39.4573425Z 2025-03-27 14:42:39,251 TRACE [org.jgroups.protocols.MFC] () node2 used 2281 credits, 3054206 remaining
2025-03-27T14:42:39.4574782Z 2025-03-27 14:42:39,251 INFO  [org.infinispan.LIFECYCLE] () [Context=work] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.4576182Z 2025-03-27 14:42:39,251 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2281 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1957], TP: [cluster=ISPN]
2025-03-27T14:42:39.4577008Z 2025-03-27 14:42:39,251 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1957
2025-03-27T14:42:39.4577774Z 2025-03-27 14:42:39,252 INFO  [org.infinispan.LIFECYCLE] () [Context=work] ISPN100002: Starting rebalance with members [node2, node1], phase READ_OLD_WRITE_ALL, topology id 153
2025-03-27T14:42:39.4578570Z 2025-03-27 14:42:39,252 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#42, conn_id=31)
2025-03-27T14:42:39.4579142Z 2025-03-27 14:42:39,252 TRACE [org.jgroups.protocols.MFC] () node2 used 2281 credits, 3850979 remaining
2025-03-27T14:42:39.4580257Z 2025-03-27 14:42:39,252 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2356, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.4581571Z 2025-03-27 14:42:39,252 TRACE [org.jgroups.protocols.UFC] () node1 used 64 credits, 3997647 remaining
2025-03-27T14:42:39.4582583Z 2025-03-27 14:42:39,252 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node2-p2-t5) [Context=work] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.4584115Z 2025-03-27 14:42:39,253 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 2283 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.4585138Z 2025-03-27 14:42:39,253 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#42, conn_id=31)
2025-03-27T14:42:39.4585808Z 2025-03-27 14:42:39,253 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#42
2025-03-27T14:42:39.4586516Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.UNICAST3] (main) node1 --> node2: DATA(#68, conn_id=0)
2025-03-27T14:42:39.4587471Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.TCP] (main) node1: sending msg to node2, src=node1, size=87, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster=ISPN]
2025-03-27T14:42:39.4589117Z 2025-03-27 14:42:39,254 INFO  [org.infinispan.LIFECYCLE] (non-blocking-thread-node1-p2-t6) [Context=work] ISPN100010: Finished rebalance with members [node2, node1], topology id 153
2025-03-27T14:42:39.4590048Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t7) node1 --> node2: DATA(#69, conn_id=0)
2025-03-27T14:42:39.4591518Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to node2, src=node1, size=121, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster=ISPN]
2025-03-27T14:42:39.4593211Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 14 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster=ISPN]
2025-03-27T14:42:39.4594363Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#68, conn_id=0)
2025-03-27T14:42:39.4594912Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#68
2025-03-27T14:42:39.4595542Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#43, conn_id=31)
2025-03-27T14:42:39.4596630Z 2025-03-27 14:42:39,254 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=139, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.4597590Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UFC] () node1 used 14 credits, 3997633 remaining
2025-03-27T14:42:39.4598572Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 48 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster=ISPN]
2025-03-27T14:42:39.4599553Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#69, conn_id=0)
2025-03-27T14:42:39.4600382Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#69
2025-03-27T14:42:39.4600933Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#44, conn_id=31)
2025-03-27T14:42:39.4601900Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=2683, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=370, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.4602965Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#45, conn_id=31)
2025-03-27T14:42:39.4603899Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=76, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.4604829Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UFC] () node1 used 48 credits, 3997585 remaining
2025-03-27T14:42:39.4605825Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to node1, 66 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:39.4606931Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#43, conn_id=31)
2025-03-27T14:42:39.4607469Z 2025-03-27 14:42:39,255 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering node2#43
2025-03-27T14:42:39.4608034Z 2025-03-27 14:42:39,256 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 2 messages from node2
2025-03-27T14:42:39.4609125Z 2025-03-27 14:42:39,256 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: DATA(#44 - #45)
2025-03-27T14:42:39.4610419Z 2025-03-27 14:42:39,256 TRACE [org.jgroups.protocols.UNICAST3] () node1: delivering #44 - #45 (2 messages)
2025-03-27T14:42:39.4611504Z 2025-03-27 14:42:39,257 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#70, conn_id=0)
2025-03-27T14:42:39.4613203Z 2025-03-27 14:42:39,257 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=75, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=370, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster=ISPN]
2025-03-27T14:42:39.4614346Z 2025-03-27 14:42:39,257 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: DATA(#71, conn_id=0)
2025-03-27T14:42:39.4615106Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=87, headers are UNICAST3: DATA, seqno=71, TP: [cluster=ISPN]
2025-03-27T14:42:39.4616140Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.UFC] () node2 used 2609 credits, 3981638 remaining
2025-03-27T14:42:39.4618000Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=370, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster=ISPN]
2025-03-27T14:42:39.4619276Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#70, conn_id=0)
2025-03-27T14:42:39.4620022Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#70
2025-03-27T14:42:39.4621322Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 23 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=71, TP: [cluster=ISPN]
2025-03-27T14:42:39.4622985Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#71, conn_id=0)
2025-03-27T14:42:39.4624006Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#71
2025-03-27T14:42:39.4625263Z 2025-03-27 14:42:39,258 INFO  [org.infinispan.CLUSTER] () [Context=work] ISPN100009: Advancing to rebalance phase READ_ALL_WRITE_ALL, topology id 154
2025-03-27T14:42:39.4626502Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1958
2025-03-27T14:42:39.4627824Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2327, headers are NAKACK2: [MSG, seqno=1958], TP: [cluster=ISPN]
2025-03-27T14:42:39.4629162Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.MFC] () node2 used 2282 credits, 3051924 remaining
2025-03-27T14:42:39.4630169Z 2025-03-27 14:42:39,258 TRACE [org.jgroups.protocols.UFC] () node1 used 23 credits, 3997562 remaining
2025-03-27T14:42:39.4631629Z 2025-03-27 14:42:39,259 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2282 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1958], TP: [cluster=ISPN]
2025-03-27T14:42:39.4633250Z 2025-03-27 14:42:39,259 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1958
2025-03-27T14:42:39.4634243Z 2025-03-27 14:42:39,259 TRACE [org.jgroups.protocols.MFC] () node2 used 2282 credits, 3848697 remaining
2025-03-27T14:42:39.4635479Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t2) node1 --> node2: DATA(#72, conn_id=0)
2025-03-27T14:42:39.4637197Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to node2, src=node1, size=87, headers are UNICAST3: DATA, seqno=72, TP: [cluster=ISPN]
2025-03-27T14:42:39.4639347Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 23 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=72, TP: [cluster=ISPN]
2025-03-27T14:42:39.4640828Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#72, conn_id=0)
2025-03-27T14:42:39.4641994Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#72
2025-03-27T14:42:39.4643397Z 2025-03-27 14:42:39,260 INFO  [org.infinispan.CLUSTER] () [Context=work] ISPN100009: Advancing to rebalance phase READ_NEW_WRITE_ALL, topology id 155
2025-03-27T14:42:39.4644647Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1959
2025-03-27T14:42:39.4645969Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2327, headers are NAKACK2: [MSG, seqno=1959], TP: [cluster=ISPN]
2025-03-27T14:42:39.4647857Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.MFC] () node2 used 2282 credits, 3049642 remaining
2025-03-27T14:42:39.4648915Z 2025-03-27 14:42:39,260 TRACE [org.jgroups.protocols.UFC] () node1 used 23 credits, 3997539 remaining
2025-03-27T14:42:39.4650388Z 2025-03-27 14:42:39,261 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 2282 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=1959], TP: [cluster=ISPN]
2025-03-27T14:42:39.4651858Z 2025-03-27 14:42:39,261 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1959
2025-03-27T14:42:39.4653038Z 2025-03-27 14:42:39,261 TRACE [org.jgroups.protocols.MFC] () node2 used 2282 credits, 3846415 remaining
2025-03-27T14:42:39.4654367Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.UNICAST3] (non-blocking-thread-node1-p2-t1) node1 --> node2: DATA(#73, conn_id=0)
2025-03-27T14:42:39.4655991Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to node2, src=node1, size=87, headers are UNICAST3: DATA, seqno=73, TP: [cluster=ISPN]
2025-03-27T14:42:39.4657965Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 23 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=73, TP: [cluster=ISPN]
2025-03-27T14:42:39.4659440Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#73, conn_id=0)
2025-03-27T14:42:39.4660447Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#73
2025-03-27T14:42:39.4661684Z 2025-03-27 14:42:39,262 INFO  [org.infinispan.CLUSTER] () [Context=work] ISPN100010: Finished rebalance with members [node2, node1], topology id 156
2025-03-27T14:42:39.4663216Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1960
2025-03-27T14:42:39.4664555Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1255, headers are NAKACK2: [MSG, seqno=1960], TP: [cluster=ISPN]
2025-03-27T14:42:39.4665882Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.MFC] () node2 used 1210 credits, 3048432 remaining
2025-03-27T14:42:39.4666895Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1961
2025-03-27T14:42:39.4668215Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1254, headers are NAKACK2: [MSG, seqno=1961], TP: [cluster=ISPN]
2025-03-27T14:42:39.4669548Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.MFC] () node2 used 1209 credits, 3047223 remaining
2025-03-27T14:42:39.4670555Z 2025-03-27 14:42:39,262 TRACE [org.jgroups.protocols.UFC] () node1 used 23 credits, 3997516 remaining
2025-03-27T14:42:39.4671638Z 2025-03-27 14:42:39,265 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 2 messages from node2
2025-03-27T14:42:39.4673047Z 2025-03-27 14:42:39,265 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node1 <-- node2: #1960-1961 (2 messages)
2025-03-27T14:42:39.4674137Z 2025-03-27 14:42:39,265 TRACE [org.jgroups.protocols.MFC] () node2 used 2419 credits, 3843996 remaining
2025-03-27T14:42:39.4675583Z 2025-03-27 14:42:39,312 INFO  [org.keycloak.connections.infinispan.DefaultInfinispanConnectionProviderFactory] (main) Node name: node1, Site name: null
2025-03-27T14:42:39.4677148Z 2025-03-27 14:42:39,380 TRACE [org.jgroups.protocols.UNICAST3] () node1 --> node2: ACK(#45)
2025-03-27T14:42:39.4678508Z 2025-03-27 14:42:39,381 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to node2, src=node1, size=61, headers are UNICAST3: ACK, seqno=45, conn_id=31, ts=4, TP: [cluster=ISPN]
2025-03-27T14:42:39.4680609Z 2025-03-27 14:42:39,381 TRACE [org.jgroups.protocols.TCP] () node2: received message batch of 1 messages from node1
2025-03-27T14:42:39.4681732Z 2025-03-27 14:42:39,381 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: ACK(#45, conn-id=31, ts=4)
2025-03-27T14:42:39.4683049Z 2025-03-27 14:42:39,438 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#73)
2025-03-27T14:42:39.4684351Z 2025-03-27 14:42:39,438 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=73, ts=173, TP: [cluster=ISPN]
2025-03-27T14:42:39.4685762Z 2025-03-27 14:42:39,438 TRACE [org.jgroups.protocols.TCP] () node1: received message batch of 1 messages from node2
2025-03-27T14:42:39.4686905Z 2025-03-27 14:42:39,438 TRACE [org.jgroups.protocols.UNICAST3] () node1 <-- node2: ACK(#73, conn-id=0, ts=173)
2025-03-27T14:42:39.5569500Z 2025-03-27 14:42:39,464 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=41, headers are NAKACK2: [HIGHEST_SEQNO, seqno=1961], TP: [cluster=ISPN]
2025-03-27T14:42:39.5573638Z 2025-03-27 14:42:39,464 TRACE [org.jgroups.protocols.TCP] () node1: received [node2 to <all>, 0 bytes, flags=OOB|NO_FC], headers are NAKACK2: [HIGHEST_SEQNO, seqno=1961], TP: [cluster=ISPN]
2025-03-27T14:42:40.1570706Z 2025-03-27 14:42:40,136 INFO  [io.quarkus] (main) Keycloak 999.0.0-SNAPSHOT on JVM (powered by Quarkus 3.20.0.CR1) started in 6.709s. Listening on: http://0.0.0.0:8181 and https://0.0.0.0:8544. Management interface listening on https://0.0.0.0:9000.
2025-03-27T14:42:40.1572549Z 2025-03-27 14:42:40,136 INFO  [io.quarkus] (main) Profile prod activated. 
2025-03-27T14:42:40.1574242Z 2025-03-27 14:42:40,136 INFO  [io.quarkus] (main) Installed features: [agroal, cdi, hibernate-orm, jdbc-postgresql, keycloak, narayana-jta, opentelemetry, reactive-routes, rest, rest-jackson, smallrye-context-propagation, smallrye-health, vertx]
2025-03-27T14:42:40.8576770Z 14:42:40,787 INFO  [org.keycloak.testsuite.arquillian.containers.AbstractQuarkusDeployableContainer] Keycloak is ready at https://localhost:8544/auth/realms/master/
2025-03-27T14:42:40.8578609Z 14:42:40,787 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Backend node auth-server-quarkus-backend1 is started
2025-03-27T14:42:40.8580175Z 14:42:40,787 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Initializing admin client for https://localhost:8544/auth
2025-03-27T14:42:40.8581774Z 14:42:40,795 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Initializing testing client for https://localhost:8544/auth
2025-03-27T14:42:40.8583539Z 14:42:40,799 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Backend node auth-server-quarkus-backend2 is started
2025-03-27T14:42:40.8584860Z 14:42:40,799 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Node started
2025-03-27T14:42:40.8585804Z 14:42:40,799 INFO  [org.keycloak.testsuite.util.WaitUtils] Wait: 100ms
2025-03-27T14:42:40.9593733Z 14:42:40,947 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/RoleInvalidationClusterTest.class
2025-03-27T14:42:40.9596133Z 14:42:40,955 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/AbstractInvalidationClusterTestWithTestRealm.class
2025-03-27T14:42:41.0621596Z Mar 27, 2025 2:42:41 PM org.jboss.arquillian.container.test.impl.client.container.ClientContainerController kill
2025-03-27T14:42:41.0623419Z 14:42:40,958 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/AbstractInvalidationClusterTest.class
2025-03-27T14:42:41.0631145Z INFO: Hard killing of a server instance
2025-03-27T14:42:41.0632654Z 14:42:40,960 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/AbstractClusterTest.class
2025-03-27T14:42:41.0634331Z 14:42:40,962 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/AbstractKeycloakTest.class
2025-03-27T14:42:41.0635908Z 14:42:40,964 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/runners/model/TestTimedOutException.class
2025-03-27T14:42:41.0637598Z 14:42:40,966 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/arquillian/ContainerInfo.class
2025-03-27T14:42:41.0639197Z 14:42:40,967 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/admin/client/resource/RoleResource.class
2025-03-27T14:42:41.0640787Z 14:42:40,968 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/admin/client/resource/RoleByIdResource.class
2025-03-27T14:42:41.0672934Z 14:42:40,969 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/admin/client/resource/RolesResource.class
2025-03-27T14:42:41.0674558Z 14:42:40,970 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/util/CryptoInitRule.class
2025-03-27T14:42:41.0676228Z 14:42:40,971 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/rules/ExternalResource.class
2025-03-27T14:42:41.0677658Z 14:42:40,972 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/rules/TestRule.class
2025-03-27T14:42:41.0679033Z 14:42:40,972 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/runners/model/Statement.class
2025-03-27T14:42:41.0680470Z 14:42:40,974 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/rules/ExternalResource$1.class
2025-03-27T14:42:41.0681982Z 14:42:40,975 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/CheckClusterSize.class
2025-03-27T14:42:41.0683215Z Member set size: 2 [[node2, node1]]
2025-03-27T14:42:41.0684026Z 14:42:40,977 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/Assert.class
2025-03-27T14:42:41.0685310Z 14:42:40,978 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/ComparisonFailure.class
2025-03-27T14:42:41.0686217Z Member set size: 2 [[node2, node1]]
2025-03-27T14:42:41.0686977Z 14:42:41,002 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Iteration 29 end
2025-03-27T14:42:41.0688090Z 14:42:41,002 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Iteration 30 start
2025-03-27T14:42:41.0689247Z 14:42:41,002 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Killing node
2025-03-27T14:42:41.0690407Z 14:42:41,002 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Simulating failure
2025-03-27T14:42:41.0691756Z 14:42:41,002 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Killing backend node: auth-server-quarkus-backend1
2025-03-27T14:42:41.0733214Z Log has ended
2025-03-27T14:42:41.0734692Z 2025-03-27 14:42:41,014 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 36 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster=ISPN]
2025-03-27T14:42:41.0736576Z 2025-03-27 14:42:41,014 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#74, conn_id=0)
2025-03-27T14:42:41.0737767Z 2025-03-27 14:42:41,014 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#74
2025-03-27T14:42:41.0739023Z 2025-03-27 14:42:41,015 INFO  [org.infinispan.CLUSTER] () [Context=authenticationSessions] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0740342Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1962
2025-03-27T14:42:41.0741829Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2223, headers are NAKACK2: [MSG, seqno=1962], TP: [cluster=ISPN]
2025-03-27T14:42:41.0743378Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.MFC] () node2 used 2178 credits, 3045045 remaining
2025-03-27T14:42:41.0744378Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1963
2025-03-27T14:42:41.0745683Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2222, headers are NAKACK2: [MSG, seqno=1963], TP: [cluster=ISPN]
2025-03-27T14:42:41.0747159Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.MFC] () node2 used 2177 credits, 3042868 remaining
2025-03-27T14:42:41.0748216Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#46, conn_id=31)
2025-03-27T14:42:41.0749936Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.0751660Z 2025-03-27 14:42:41,015 TRACE [org.jgroups.protocols.UFC] () node1 used 36 credits, 3997480 remaining
2025-03-27T14:42:41.0753767Z 2025-03-27 14:42:41,022 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 22 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=75, TP: [cluster=ISPN]
2025-03-27T14:42:41.0755597Z 2025-03-27 14:42:41,022 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#75, conn_id=0)
2025-03-27T14:42:41.0756576Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#75
2025-03-27T14:42:41.0757690Z 2025-03-27 14:42:41,023 WARN  [org.infinispan.CLUSTER] () [Context=sessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:41.0759045Z 2025-03-27 14:42:41,023 INFO  [org.infinispan.CLUSTER] () [Context=sessions] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0760233Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1964
2025-03-27T14:42:41.0761525Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2209, headers are NAKACK2: [MSG, seqno=1964], TP: [cluster=ISPN]
2025-03-27T14:42:41.0803173Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.MFC] () node2 used 2164 credits, 3040704 remaining
2025-03-27T14:42:41.0804209Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1965
2025-03-27T14:42:41.0805552Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2208, headers are NAKACK2: [MSG, seqno=1965], TP: [cluster=ISPN]
2025-03-27T14:42:41.0806880Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.MFC] () node2 used 2163 credits, 3038541 remaining
2025-03-27T14:42:41.0807910Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#47, conn_id=31)
2025-03-27T14:42:41.0809637Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.0811324Z 2025-03-27 14:42:41,023 TRACE [org.jgroups.protocols.UFC] () node1 used 22 credits, 3997458 remaining
2025-03-27T14:42:41.0813469Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 28 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=76, TP: [cluster=ISPN]
2025-03-27T14:42:41.0815276Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#76, conn_id=0)
2025-03-27T14:42:41.0816376Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#76
2025-03-27T14:42:41.0817522Z 2025-03-27 14:42:41,027 WARN  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:41.0818938Z 2025-03-27 14:42:41,027 INFO  [org.infinispan.CLUSTER] () [Context=clientSessions] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0820171Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1966
2025-03-27T14:42:41.0821534Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2215, headers are NAKACK2: [MSG, seqno=1966], TP: [cluster=ISPN]
2025-03-27T14:42:41.0823089Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.MFC] () node2 used 2170 credits, 3036371 remaining
2025-03-27T14:42:41.0824098Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1967
2025-03-27T14:42:41.0825455Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2214, headers are NAKACK2: [MSG, seqno=1967], TP: [cluster=ISPN]
2025-03-27T14:42:41.0826818Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.MFC] () node2 used 2169 credits, 3034202 remaining
2025-03-27T14:42:41.0828015Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#48, conn_id=31)
2025-03-27T14:42:41.0853168Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.0854940Z 2025-03-27 14:42:41,027 TRACE [org.jgroups.protocols.UFC] () node1 used 28 credits, 3997430 remaining
2025-03-27T14:42:41.0856790Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 18 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=77, TP: [cluster=ISPN]
2025-03-27T14:42:41.0858609Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#77, conn_id=0)
2025-03-27T14:42:41.0859612Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#77
2025-03-27T14:42:41.0860789Z 2025-03-27 14:42:41,031 INFO  [org.infinispan.CLUSTER] () [Context=work] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0861979Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1968
2025-03-27T14:42:41.0863446Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1187, headers are NAKACK2: [MSG, seqno=1968], TP: [cluster=ISPN]
2025-03-27T14:42:41.0864639Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.MFC] () node2 used 1142 credits, 3033060 remaining
2025-03-27T14:42:41.0865568Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1969
2025-03-27T14:42:41.0866844Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1186, headers are NAKACK2: [MSG, seqno=1969], TP: [cluster=ISPN]
2025-03-27T14:42:41.0868182Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.MFC] () node2 used 1141 credits, 3031919 remaining
2025-03-27T14:42:41.0869399Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#49, conn_id=31)
2025-03-27T14:42:41.0871146Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.0873070Z 2025-03-27 14:42:41,031 TRACE [org.jgroups.protocols.UFC] () node1 used 18 credits, 3997412 remaining
2025-03-27T14:42:41.0875012Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 27 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=78, TP: [cluster=ISPN]
2025-03-27T14:42:41.0876841Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#78, conn_id=0)
2025-03-27T14:42:41.0877839Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#78
2025-03-27T14:42:41.0879196Z 2025-03-27 14:42:41,034 INFO  [org.infinispan.CLUSTER] () [Context=loginFailures] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0880472Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1970
2025-03-27T14:42:41.0881761Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2214, headers are NAKACK2: [MSG, seqno=1970], TP: [cluster=ISPN]
2025-03-27T14:42:41.0913454Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.MFC] () node2 used 2169 credits, 3029750 remaining
2025-03-27T14:42:41.0914459Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1971
2025-03-27T14:42:41.0915931Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2213, headers are NAKACK2: [MSG, seqno=1971], TP: [cluster=ISPN]
2025-03-27T14:42:41.0917288Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.MFC] () node2 used 2168 credits, 3027582 remaining
2025-03-27T14:42:41.0918325Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#50, conn_id=31)
2025-03-27T14:42:41.0920087Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.0921802Z 2025-03-27 14:42:41,034 TRACE [org.jgroups.protocols.UFC] () node1 used 27 credits, 3997385 remaining
2025-03-27T14:42:41.0923785Z 2025-03-27 14:42:41,038 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 35 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=79, TP: [cluster=ISPN]
2025-03-27T14:42:41.0925588Z 2025-03-27 14:42:41,038 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#79, conn_id=0)
2025-03-27T14:42:41.0926555Z 2025-03-27 14:42:41,038 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#79
2025-03-27T14:42:41.0927782Z 2025-03-27 14:42:41,038 WARN  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:41.0929333Z 2025-03-27 14:42:41,038 INFO  [org.infinispan.CLUSTER] () [Context=offlineClientSessions] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0930668Z 2025-03-27 14:42:41,038 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1972
2025-03-27T14:42:41.0931945Z 2025-03-27 14:42:41,038 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2222, headers are NAKACK2: [MSG, seqno=1972], TP: [cluster=ISPN]
2025-03-27T14:42:41.0933455Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.MFC] () node2 used 2177 credits, 3025405 remaining
2025-03-27T14:42:41.0934392Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#79)
2025-03-27T14:42:41.0935483Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1973
2025-03-27T14:42:41.0936802Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=79, ts=174, TP: [cluster=ISPN]
2025-03-27T14:42:41.0938455Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2221, headers are NAKACK2: [MSG, seqno=1973], TP: [cluster=ISPN]
2025-03-27T14:42:41.0939882Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.MFC] () node2 used 2176 credits, 3023229 remaining
2025-03-27T14:42:41.0940899Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#51, conn_id=31)
2025-03-27T14:42:41.0954938Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.0956903Z 2025-03-27 14:42:41,039 TRACE [org.jgroups.protocols.UFC] () node1 used 35 credits, 3997350 remaining
2025-03-27T14:42:41.0958760Z 2025-03-27 14:42:41,042 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 35 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=80, TP: [cluster=ISPN]
2025-03-27T14:42:41.0960600Z 2025-03-27 14:42:41,042 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#80, conn_id=0)
2025-03-27T14:42:41.0961594Z 2025-03-27 14:42:41,042 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#80
2025-03-27T14:42:41.0974867Z 2025-03-27 14:42:41,043 INFO  [org.infinispan.CLUSTER] () [Context=org.infinispan.CONFIG] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.0976311Z 2025-03-27 14:42:41,043 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1974
2025-03-27T14:42:41.0977631Z 2025-03-27 14:42:41,043 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1204, headers are NAKACK2: [MSG, seqno=1974], TP: [cluster=ISPN]
2025-03-27T14:42:41.0978978Z 2025-03-27 14:42:41,043 TRACE [org.jgroups.protocols.MFC] () node2 used 1159 credits, 3022070 remaining
2025-03-27T14:42:41.0979986Z 2025-03-27 14:42:41,044 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1975
2025-03-27T14:42:41.0981328Z 2025-03-27 14:42:41,044 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=1203, headers are NAKACK2: [MSG, seqno=1975], TP: [cluster=ISPN]
2025-03-27T14:42:41.1012922Z 2025-03-27 14:42:41,044 TRACE [org.jgroups.protocols.MFC] () node2 used 1158 credits, 3020912 remaining
2025-03-27T14:42:41.1014037Z 2025-03-27 14:42:41,044 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#52, conn_id=31)
2025-03-27T14:42:41.1015795Z 2025-03-27 14:42:41,045 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.1017513Z 2025-03-27 14:42:41,045 TRACE [org.jgroups.protocols.UFC] () node1 used 35 credits, 3997315 remaining
2025-03-27T14:42:41.1019269Z 2025-03-27 14:42:41,047 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 29 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=81, TP: [cluster=ISPN]
2025-03-27T14:42:41.1021040Z 2025-03-27 14:42:41,047 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#81, conn_id=0)
2025-03-27T14:42:41.1022030Z 2025-03-27 14:42:41,047 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#81
2025-03-27T14:42:41.1023493Z 2025-03-27 14:42:41,047 WARN  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN000312: Lost data because of graceful leaver node1
2025-03-27T14:42:41.1025164Z 2025-03-27 14:42:41,047 INFO  [org.infinispan.CLUSTER] () [Context=offlineSessions] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.1026387Z 2025-03-27 14:42:41,047 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1976
2025-03-27T14:42:41.1027736Z 2025-03-27 14:42:41,047 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2216, headers are NAKACK2: [MSG, seqno=1976], TP: [cluster=ISPN]
2025-03-27T14:42:41.1029276Z 2025-03-27 14:42:41,047 TRACE [org.jgroups.protocols.MFC] () node2 used 2171 credits, 3018741 remaining
2025-03-27T14:42:41.1030307Z 2025-03-27 14:42:41,048 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1977
2025-03-27T14:42:41.1031670Z 2025-03-27 14:42:41,048 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2215, headers are NAKACK2: [MSG, seqno=1977], TP: [cluster=ISPN]
2025-03-27T14:42:41.1033404Z 2025-03-27 14:42:41,048 TRACE [org.jgroups.protocols.MFC] () node2 used 2170 credits, 3016571 remaining
2025-03-27T14:42:41.1034474Z 2025-03-27 14:42:41,048 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#53, conn_id=31)
2025-03-27T14:42:41.1036240Z 2025-03-27 14:42:41,048 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.1037945Z 2025-03-27 14:42:41,048 TRACE [org.jgroups.protocols.UFC] () node1 used 29 credits, 3997286 remaining
2025-03-27T14:42:41.1039872Z 2025-03-27 14:42:41,051 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 26 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=82, TP: [cluster=ISPN]
2025-03-27T14:42:41.1041708Z 2025-03-27 14:42:41,051 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#82, conn_id=0)
2025-03-27T14:42:41.1053192Z 2025-03-27 14:42:41,051 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#82
2025-03-27T14:42:41.1054632Z 2025-03-27 14:42:41,051 INFO  [org.infinispan.CLUSTER] () [Context=actionTokens] ISPN100008: Updating cache members list [node2], topology id 157
2025-03-27T14:42:41.1056000Z 2025-03-27 14:42:41,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1978
2025-03-27T14:42:41.1057307Z 2025-03-27 14:42:41,051 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2213, headers are NAKACK2: [MSG, seqno=1978], TP: [cluster=ISPN]
2025-03-27T14:42:41.1058633Z 2025-03-27 14:42:41,052 TRACE [org.jgroups.protocols.MFC] () node2 used 2168 credits, 3014403 remaining
2025-03-27T14:42:41.1059650Z 2025-03-27 14:42:41,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1979
2025-03-27T14:42:41.1060971Z 2025-03-27 14:42:41,053 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=2212, headers are NAKACK2: [MSG, seqno=1979], TP: [cluster=ISPN]
2025-03-27T14:42:41.1072969Z 2025-03-27 14:42:41,053 TRACE [org.jgroups.protocols.MFC] () node2 used 2167 credits, 3012236 remaining
2025-03-27T14:42:41.1074084Z 2025-03-27 14:42:41,053 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: DATA(#54, conn_id=31)
2025-03-27T14:42:41.1075632Z 2025-03-27 14:42:41,053 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.1078321Z 2025-03-27 14:42:41,053 TRACE [org.jgroups.protocols.UFC] () node1 used 26 credits, 3997260 remaining
2025-03-27T14:42:41.1079849Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.TCP] () node2: received [node1 to node2, 0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=node1, UNICAST3: DATA, seqno=83, TP: [cluster=ISPN]
2025-03-27T14:42:41.1080940Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.UNICAST3] () node2 <-- node1: DATA(#83, conn_id=0)
2025-03-27T14:42:41.1081520Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.UNICAST3] () node2: delivering node1#83
2025-03-27T14:42:41.1082107Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: handleMembershipChange([LEAVE(node1)])
2025-03-27T14:42:41.1083079Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: joiners=[], suspected=[], leaving=[node1], new view: [node2|62] (1) [node2]
2025-03-27T14:42:41.1083914Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: sending LEAVE response to node1
2025-03-27T14:42:41.1084694Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=58, headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster=ISPN]
2025-03-27T14:42:41.1085496Z 2025-03-27 14:42:41,057 DEBUG [org.jgroups.protocols.pbcast.GMS] () node2: installing view [node2|62] (1) [node2] (node1 left)
2025-03-27T14:42:41.1086238Z 2025-03-27 14:42:41,057 TRACE [org.jgroups.protocols.UNICAST3] () node2: closing connections of non members [node1]
2025-03-27T14:42:41.1086949Z 2025-03-27 14:42:41,057 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] () node2: removed node1 from xmit_table (not member anymore)
2025-03-27T14:42:41.1087670Z 2025-03-27 14:42:41,058 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:41.1088310Z 2025-03-27 14:42:41,059 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: cleared table for cluster ISPN
2025-03-27T14:42:41.1089213Z 2025-03-27 14:42:41,059 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf') ]
2025-03-27T14:42:41.1090103Z 2025-03-27 14:42:41,059 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: removed node2 for cluster ISPN from database
2025-03-27T14:42:41.1091138Z 2025-03-27 14:42:41,060 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf'), ('node2'), ('ISPN'), ('172.17.0.1:7801'), ('TRUE'::boolean)) ]
2025-03-27T14:42:41.1092153Z Mar 27, 2025 2:42:41 PM org.jboss.arquillian.container.impl.DefaultServerKillProcessor kill
2025-03-27T14:42:41.1093094Z WARNING: Triggering default implementation of a server kill() command => using stop() internally
2025-03-27T14:42:41.1610638Z 2025-03-27 14:42:41,061 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: inserted node2 for cluster ISPN
2025-03-27T14:42:41.1611677Z 2025-03-27 14:42:41,061 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: wrote to backend store: [node2]
2025-03-27T14:42:41.1612787Z 2025-03-27 14:42:41,062 DEBUG [org.jgroups.protocols.FD_SOCK2] () node2: connection to node1 [172.17.0.1:57800 DISCONNECTED] closed
2025-03-27T14:42:41.1613505Z 2025-03-27 14:42:41,062 TRACE [org.jgroups.protocols.UFC] () new membership: [node2]
2025-03-27T14:42:41.1614041Z 2025-03-27 14:42:41,062 TRACE [org.jgroups.protocols.MFC] () new membership: [node2]
2025-03-27T14:42:41.1614690Z 2025-03-27 14:42:41,062 TRACE [org.jgroups.protocols.FRAG4] () node2: removed node1 from fragmentation table
2025-03-27T14:42:41.1615472Z 2025-03-27 14:42:41,062 INFO  [org.infinispan.CLUSTER] () ISPN000094: Received new cluster view for channel ISPN: [node2|62] (1) [node2]
2025-03-27T14:42:41.1616386Z 2025-03-27 14:42:41,062 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] () Reloading JGroups Certificate
2025-03-27T14:42:41.1617247Z 2025-03-27 14:42:41,068 INFO  [org.infinispan.CLUSTER] () ISPN100001: Node node1 left the cluster
2025-03-27T14:42:41.1617853Z 2025-03-27 14:42:41,069 INFO  [org.infinispan.CLUSTER] () ISPN100001: Node node1 left the cluster
2025-03-27T14:42:41.1618573Z 2025-03-27 14:42:41,069 TRACE [org.jgroups.protocols.pbcast.GMS] () node2: mcasting view [node2|62], ref-view=[node2|61], left=[node1]
2025-03-27T14:42:41.1619558Z 2025-03-27 14:42:41,070 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2 --> [all]: #1980
2025-03-27T14:42:41.1620460Z 2025-03-27 14:42:41,070 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=114, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1980], TP: [cluster=ISPN]
2025-03-27T14:42:41.1621567Z 2025-03-27 14:42:41,086 TRACE [org.jgroups.protocols.TCP] (Connection.Receiver [172.17.0.1:41243 - 172.17.0.1:7800]-44,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:41.2611265Z 2025-03-27 14:42:41,240 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: ACK(#83)
2025-03-27T14:42:41.2612879Z 2025-03-27 14:42:41,240 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=61, headers are UNICAST3: ACK, seqno=83, ts=175, TP: [cluster=ISPN]
2025-03-27T14:42:41.2614031Z 2025-03-27 14:42:41,240 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:41.2615336Z 2025-03-27 14:42:41,240 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:41.2616520Z 2025-03-27 14:42:41,240 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:41.2617976Z 2025-03-27 14:42:41,240 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (61 bytes): java.net.ConnectException: Connection refused, headers: UNICAST3: ACK, seqno=83, ts=175, TP: [cluster=ISPN]
2025-03-27T14:42:41.4613271Z 2025-03-27 14:42:41,440 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:41.4614744Z 2025-03-27 14:42:41,440 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.4616065Z 2025-03-27 14:42:41,440 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:41.4617077Z 2025-03-27 14:42:41,440 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:41.4618100Z 2025-03-27 14:42:41,440 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:41.4619651Z 2025-03-27 14:42:41,440 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.4621057Z 14:42:41,451 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Node killed
2025-03-27T14:42:41.4621660Z 14:42:41,451 INFO  [org.keycloak.testsuite.util.WaitUtils] Wait: 100ms
2025-03-27T14:42:41.5614406Z Mar 27, 2025 2:42:41 PM org.jboss.arquillian.container.test.impl.client.container.ClientContainerController start
2025-03-27T14:42:41.5616079Z 2025-03-27 14:42:41,468 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=41, headers are NAKACK2: [HIGHEST_SEQNO, seqno=1980], TP: [cluster=ISPN]
2025-03-27T14:42:41.5617622Z 14:42:41,551 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Starting node
2025-03-27T14:42:41.5618549Z 14:42:41,551 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Bringing all backend nodes online
2025-03-27T14:42:41.5619540Z 14:42:41,551 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Starting backend node: auth-server-quarkus-backend1
2025-03-27T14:42:41.5620702Z 14:42:41,552 INFO  [org.keycloak.testsuite.arquillian.AuthServerTestEnricher] ************************auth-server-quarkus-backend1*****************************************************************************
2025-03-27T14:42:41.5621975Z 14:42:41,552 DEBUG [org.keycloak.testsuite.arquillian.containers.AbstractQuarkusDeployableContainer] FIPS Mode: disabled
2025-03-27T14:42:41.5623114Z 14:42:41,552 DEBUG [org.keycloak.testsuite.arquillian.containers.AbstractQuarkusDeployableContainer] Store 'JPA' is used.
2025-03-27T14:42:41.5626108Z 14:42:41,552 DEBUG [org.keycloak.testsuite.arquillian.containers.KeycloakQuarkusServerDeployableContainer] Quarkus process arguments: [./kc.sh, -v, start, --http-enabled=true, --http-port=8181, --https-port=8544, --http-relative-path=/auth, --health-enabled=true, --http-management-port=9000, -Djboss.node.name=node1, -Dauth.server.host=localhost, --cache=ispn, --cache-config-file=cluster-ha.xml, --log-level=org.jgroups.protocols:trace, --db=postgres, --db-username=keycloak, --db-*** --db-url=jdbc:postgresql://172.17.0.2:5432/keycloak]
2025-03-27T14:42:41.5628540Z INFO: Manual starting of a server instance
2025-03-27T14:42:41.6616363Z JAVA_OPTS already set in environment; overriding default settings
2025-03-27T14:42:41.6617378Z 2025-03-27 14:42:41,640 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:41.6619070Z 2025-03-27 14:42:41,640 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.6620990Z 2025-03-27 14:42:41,640 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:41.6623062Z 2025-03-27 14:42:41,641 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:41.6624637Z 2025-03-27 14:42:41,641 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:41.6626907Z 2025-03-27 14:42:41,641 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.8619123Z 2025-03-27 14:42:41,840 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:41.8620802Z 2025-03-27 14:42:41,841 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:41.8622726Z 2025-03-27 14:42:41,841 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:41.8624263Z 2025-03-27 14:42:41,841 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:41.8625763Z 2025-03-27 14:42:41,841 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:41.8627124Z 2025-03-27 14:42:41,841 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.0626007Z 2025-03-27 14:42:42,042 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:42.0629100Z 2025-03-27 14:42:42,042 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.0631291Z 2025-03-27 14:42:42,042 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:42.0633031Z 2025-03-27 14:42:42,042 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:42.0634702Z 2025-03-27 14:42:42,042 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:42.0636976Z 2025-03-27 14:42:42,042 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.2634528Z 2025-03-27 14:42:42,242 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:42.2636282Z 2025-03-27 14:42:42,242 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.2637512Z 2025-03-27 14:42:42,242 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:42.2638363Z 2025-03-27 14:42:42,242 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:42.2639311Z 2025-03-27 14:42:42,242 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:42.2640639Z 2025-03-27 14:42:42,242 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.4642560Z 2025-03-27 14:42:42,442 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:42.4643891Z 2025-03-27 14:42:42,442 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.4645112Z 2025-03-27 14:42:42,442 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:42.4646072Z 2025-03-27 14:42:42,443 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:42.4647034Z 2025-03-27 14:42:42,443 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:42.4648500Z 2025-03-27 14:42:42,443 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.5645376Z 2025-03-27 14:42:42,483 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: updating the local digest with a stable message (coordinator): node2: [1980 (1980)]
2025-03-27T14:42:42.5651900Z 2025-03-27 14:42:42,483 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: handling digest from node2:
2025-03-27T14:42:42.5657174Z mine:   node2: [-1]
2025-03-27T14:42:42.5661739Z sender: node2: [1980]
2025-03-27T14:42:42.5664817Z result: node2: [1980]
2025-03-27T14:42:42.5672925Z 
2025-03-27T14:42:42.5675145Z 2025-03-27 14:42:42,483 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: sending stability msg node2: [1980]
2025-03-27T14:42:42.5683871Z 2025-03-27 14:42:42,483 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=84, headers are STABLE: [STABILITY] view-id= [node2|62], TP: [cluster=ISPN]
2025-03-27T14:42:42.5685436Z 2025-03-27 14:42:42,483 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: received stable digest node2: [1980 (1980)]
2025-03-27T14:42:42.5686841Z 2025-03-27 14:42:42,483 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: deleting msgs <= 1980 from node2
2025-03-27T14:42:42.6646615Z 2025-03-27 14:42:42,642 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:42.6648435Z 2025-03-27 14:42:42,643 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.6650295Z 2025-03-27 14:42:42,643 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:42.6652107Z 2025-03-27 14:42:42,643 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:42.6655473Z 2025-03-27 14:42:42,643 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:42.6658109Z 2025-03-27 14:42:42,643 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.8680104Z 2025-03-27 14:42:42,845 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:42.8682631Z 2025-03-27 14:42:42,845 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:42.8684805Z 2025-03-27 14:42:42,845 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:42.8686540Z 2025-03-27 14:42:42,845 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:42.8689023Z 2025-03-27 14:42:42,845 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:42.8691783Z 2025-03-27 14:42:42,845 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.0655257Z 2025-03-27 14:42:43,045 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:43.0661415Z 2025-03-27 14:42:43,045 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.0670898Z 2025-03-27 14:42:43,045 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:43.0672702Z 2025-03-27 14:42:43,046 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:43.0676354Z 2025-03-27 14:42:43,046 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:43.0679075Z 2025-03-27 14:42:43,046 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.2683461Z 2025-03-27 14:42:43,248 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:43.2684798Z 2025-03-27 14:42:43,248 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.2685857Z 2025-03-27 14:42:43,248 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:43.2686738Z 2025-03-27 14:42:43,248 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:43.2687681Z 2025-03-27 14:42:43,248 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:43.2689008Z 2025-03-27 14:42:43,248 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.5670338Z 2025-03-27 14:42:43,448 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:43.5671675Z 2025-03-27 14:42:43,448 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.5673062Z 2025-03-27 14:42:43,448 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:43.5673890Z 2025-03-27 14:42:43,449 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:43.5674729Z 2025-03-27 14:42:43,449 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:43.5676008Z 2025-03-27 14:42:43,449 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.6671010Z 2025-03-27 14:42:43,648 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:43.6673088Z 2025-03-27 14:42:43,649 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.6674969Z 2025-03-27 14:42:43,649 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:43.6676462Z 2025-03-27 14:42:43,649 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:43.6678020Z 2025-03-27 14:42:43,649 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:43.6680380Z 2025-03-27 14:42:43,649 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.8733698Z 2025-03-27 14:42:43,849 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:43.8735907Z 2025-03-27 14:42:43,849 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:43.8738163Z 2025-03-27 14:42:43,849 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:43.8739848Z 2025-03-27 14:42:43,849 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:43.8741548Z 2025-03-27 14:42:43,849 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:43.8745076Z 2025-03-27 14:42:43,849 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.0679112Z 2025-03-27 14:42:44,049 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:44.0680936Z 2025-03-27 14:42:44,049 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.0683323Z 2025-03-27 14:42:44,049 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:44.0684851Z 2025-03-27 14:42:44,050 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:44.0686400Z 2025-03-27 14:42:44,050 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:44.0688753Z 2025-03-27 14:42:44,050 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.2719028Z 2025-03-27 14:42:44,249 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:44.2721276Z 2025-03-27 14:42:44,249 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.2723749Z 2025-03-27 14:42:44,250 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:44.2725508Z 2025-03-27 14:42:44,250 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:44.2727301Z 2025-03-27 14:42:44,250 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:44.2729939Z 2025-03-27 14:42:44,250 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.4749282Z 2025-03-27 14:42:44,450 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:44.4751721Z 2025-03-27 14:42:44,450 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.4758753Z 2025-03-27 14:42:44,450 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:44.4760473Z 2025-03-27 14:42:44,450 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:44.4762343Z 2025-03-27 14:42:44,450 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:44.4764836Z 2025-03-27 14:42:44,450 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.6774058Z 2025-03-27 14:42:44,650 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:44.6775762Z 2025-03-27 14:42:44,650 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.6777637Z 2025-03-27 14:42:44,650 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:44.6779425Z 2025-03-27 14:42:44,651 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:44.6780929Z 2025-03-27 14:42:44,651 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:44.6783473Z 2025-03-27 14:42:44,651 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.8801707Z 2025-03-27 14:42:44,850 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:44.8804236Z 2025-03-27 14:42:44,850 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:44.8813337Z 2025-03-27 14:42:44,851 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:44.8816247Z 2025-03-27 14:42:44,851 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:44.8818015Z 2025-03-27 14:42:44,851 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:44.8822480Z 2025-03-27 14:42:44,851 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.0796698Z 2025-03-27 14:42:45,051 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:45.0801023Z 2025-03-27 14:42:45,051 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.0803714Z 2025-03-27 14:42:45,051 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:45.0805193Z 2025-03-27 14:42:45,051 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:45.0806697Z 2025-03-27 14:42:45,051 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:45.0809172Z 2025-03-27 14:42:45,051 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.2798643Z 2025-03-27 14:42:45,251 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:45.2800660Z 2025-03-27 14:42:45,251 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.2802747Z 2025-03-27 14:42:45,251 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:45.2804194Z 2025-03-27 14:42:45,251 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:45.2805588Z 2025-03-27 14:42:45,251 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:45.2807995Z 2025-03-27 14:42:45,251 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.4831497Z 2025-03-27 14:42:45,452 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:45.4833868Z 2025-03-27 14:42:45,453 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.4837298Z 2025-03-27 14:42:45,453 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:45.4839137Z 2025-03-27 14:42:45,453 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:45.4841048Z 2025-03-27 14:42:45,453 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:45.4843775Z 2025-03-27 14:42:45,453 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.6832881Z 2025-03-27 14:42:45,653 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:45.6834730Z 2025-03-27 14:42:45,653 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.6836549Z 2025-03-27 14:42:45,653 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:45.6838336Z 2025-03-27 14:42:45,653 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:45.6839745Z 2025-03-27 14:42:45,653 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:45.6842107Z 2025-03-27 14:42:45,653 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.7830837Z 2025-03-27 14:42:44,020 INFO  [org.keycloak.protocol.oidc.OIDCWellKnownProviderFactory] (main) Overriding default OIDC well-known endpoint configuration with the options from file 'classpath:wellknown/oidc-well-known-config-override.json'
2025-03-27T14:42:45.7833867Z 2025-03-27 14:42:44,021 WARN  [org.keycloak.truststore.FileTruststoreProviderFactory] (main) Using deprecated 'spi-truststore-file-*' options. Consider using 'truststore-paths' option.
2025-03-27T14:42:45.8831659Z 2025-03-27 14:42:45,853 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:45.8833678Z 2025-03-27 14:42:45,853 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:45.8839396Z 2025-03-27 14:42:45,853 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:45.8841176Z 2025-03-27 14:42:45,854 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:45.8843387Z 2025-03-27 14:42:45,854 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:45.8845538Z 2025-03-27 14:42:45,854 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:46.0847685Z 2025-03-27 14:42:46,053 TRACE [org.jgroups.protocols.UNICAST3] () node2 --> node1: resending(#54)
2025-03-27T14:42:46.0851394Z 2025-03-27 14:42:46,053 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to node1, src=node2, size=74, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:46.0853555Z 2025-03-27 14:42:46,053 DEBUG [org.jgroups.protocols.UNICAST3] () node2: removing expired connection for node1 (5006 ms old) from send_table
2025-03-27T14:42:46.0854959Z 2025-03-27 14:42:46,053 DEBUG [org.jgroups.protocols.UNICAST3] () node2: removing expired connection for node1 (5006 ms old) from recv_table
2025-03-27T14:42:46.0856304Z 2025-03-27 14:42:46,053 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: connecting to 172.17.0.1:7800
2025-03-27T14:42:46.0857742Z 2025-03-27 14:42:46,054 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: failed connecting to 172.17.0.1:7800: java.net.ConnectException: Connection refused
2025-03-27T14:42:46.0859209Z 2025-03-27 14:42:46,054 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) 172.17.0.1:7801: removed connection to 172.17.0.1:7800
2025-03-27T14:42:46.0861494Z 2025-03-27 14:42:46,054 TRACE [org.jgroups.protocols.TCP] (TQ-Bundler-5,node2) JGRP000029: node2: failed sending message to node1 (74 bytes): java.net.ConnectException: Connection refused, headers: RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=31, TP: [cluster=ISPN]
2025-03-27T14:42:47.1882454Z 2025-03-27 14:42:47,118 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Starting Infinispan embedded cache manager
2025-03-27T14:42:47.1884232Z 2025-03-27 14:42:47,123 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) JGroups JDBC_PING discovery enabled.
2025-03-27T14:42:47.2882838Z 2025-03-27 14:42:47,254 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) JGroups Encryption enabled (mTLS).
2025-03-27T14:42:47.2886333Z 2025-03-27 14:42:47,255 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for sessions to 10000 entries.
2025-03-27T14:42:47.2890548Z 2025-03-27 14:42:47,255 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for clientSessions to 10000 entries.
2025-03-27T14:42:47.2894580Z 2025-03-27 14:42:47,255 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for offlineSessions to 10000 entries.
2025-03-27T14:42:47.2897348Z 2025-03-27 14:42:47,255 INFO  [org.keycloak.quarkus.runtime.storage.infinispan.CacheManagerFactory] (main) Persistent user sessions enabled and no memory limit found in configuration. Setting max entries for offlineClientSessions to 10000 entries.
2025-03-27T14:42:47.3884550Z 2025-03-27 14:42:47,361 INFO  [org.infinispan.CONTAINER] (main) Virtual threads support enabled
2025-03-27T14:42:47.4893906Z 2025-03-27 14:42:47,473 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] (main) Starting JGroups certificate reload manager
2025-03-27T14:42:47.5894438Z 2025-03-27 14:42:47,551 INFO  [org.infinispan.CONTAINER] (main) ISPN000556: Starting user marshaller 'org.infinispan.commons.marshall.ImmutableProtoStreamMarshaller'
2025-03-27T14:42:47.6919511Z 2025-03-27 14:42:47,687 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] () [Boot] reloading certificate.
2025-03-27T14:42:47.7911160Z 2025-03-27 14:42:47,734 TRACE [org.jgroups.protocols.JDBC_PING2] (main) null: SQL for initializing schema: wrapped[  ]
2025-03-27T14:42:47.7917930Z 2025-03-27 14:42:47,734 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) null: table created for JDBC_PING discovery protocol
2025-03-27T14:42:47.7919238Z 2025-03-27 14:42:47,735 TRACE [org.jgroups.protocols.UNICAST3] (main) null: set max_xmit_req_size from 0 to 511600
2025-03-27T14:42:47.7920525Z 2025-03-27 14:42:47,738 INFO  [org.infinispan.CLUSTER] (main) ISPN000078: Starting JGroups channel `ISPN` with stack `jdbc-ping`
2025-03-27T14:42:47.7921801Z 2025-03-27 14:42:47,739 INFO  [org.jgroups.JChannel] (main) local_addr: 80a3bbef-c294-4250-9f21-b9142b218ca3, name: node1
2025-03-27T14:42:47.7924223Z 2025-03-27 14:42:47,746 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf') ]
2025-03-27T14:42:47.7926005Z 2025-03-27 14:42:47,747 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: removed node2 for cluster ISPN from database
2025-03-27T14:42:47.7927948Z 2025-03-27 14:42:47,747 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://861cd8e9-2c98-4fcd-914c-8ed053306acf'), ('node2'), ('ISPN'), ('172.17.0.1:7801'), ('TRUE'::boolean)) ]
2025-03-27T14:42:47.7931046Z 2025-03-27 14:42:47,748 INFO  [org.jgroups.protocols.FD_SOCK2] (main) server listening on *:57800
2025-03-27T14:42:47.7932072Z 2025-03-27 14:42:47,749 TRACE [org.jgroups.protocols.pbcast.STABLE] (main) node1: stable task started
2025-03-27T14:42:47.7933501Z 2025-03-27 14:42:47,750 DEBUG [org.jgroups.protocols.pbcast.GMS] (main) address=node1, cluster=ISPN, physical address=172.17.0.1:7800
2025-03-27T14:42:47.7935322Z 2025-03-27 14:42:47,751 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: SQL for reading: wrapped[ SELECT address, name, ip, coord FROM JGROUPS_PING WHERE cluster_name=('ISPN') ]
2025-03-27T14:42:47.7937282Z 2025-03-27 14:42:47,752 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://80a3bbef-c294-4250-9f21-b9142b218ca3') ]
2025-03-27T14:42:47.7938938Z 2025-03-27 14:42:47,752 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) node1: removed node1 for cluster ISPN from database
2025-03-27T14:42:47.7940303Z 2025-03-27 14:42:47,752 DEBUG [org.jgroups.protocols.JDBC_PING2] () node2: inserted node2 for cluster ISPN
2025-03-27T14:42:47.7942145Z 2025-03-27 14:42:47,752 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://80a3bbef-c294-4250-9f21-b9142b218ca3'), ('node1'), ('ISPN'), ('172.17.0.1:7800'), ('FALSE'::boolean)) ]
2025-03-27T14:42:47.7944205Z 2025-03-27 14:42:47,752 TRACE [org.jgroups.protocols.JDBC_PING2] () node2: wrote to backend store: [node2]
2025-03-27T14:42:47.7945504Z 2025-03-27 14:42:47,753 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) node1: inserted node1 for cluster ISPN
2025-03-27T14:42:47.7946842Z 2025-03-27 14:42:47,754 INFO  [org.jgroups.protocols.pbcast.GMS] (main) node1: no members discovered after 4 ms: creating cluster as coordinator
2025-03-27T14:42:47.7948019Z 2025-03-27 14:42:47,755 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (main) 
2025-03-27T14:42:47.7948677Z [node1 setDigest()]
2025-03-27T14:42:47.7949063Z existing digest:  []
2025-03-27T14:42:47.7949455Z new digest:       node1: [0 (0)]
2025-03-27T14:42:47.7949909Z resulting digest: node1: [0 (0)]
2025-03-27T14:42:47.7950955Z 2025-03-27 14:42:47,755 DEBUG [org.jgroups.protocols.pbcast.GMS] (main) node1: installing view [node1|0] (1) [node1] (node1 joined)
2025-03-27T14:42:47.7952505Z 2025-03-27 14:42:47,756 DEBUG [org.jgroups.protocols.pbcast.STABLE] (main) node1: resuming message garbage collection
2025-03-27T14:42:47.7953809Z 2025-03-27 14:42:47,769 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) node1: cleared table for cluster ISPN
2025-03-27T14:42:47.7955397Z 2025-03-27 14:42:47,769 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://80a3bbef-c294-4250-9f21-b9142b218ca3') ]
2025-03-27T14:42:47.7957065Z 2025-03-27 14:42:47,770 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) node1: removed node1 for cluster ISPN from database
2025-03-27T14:42:47.7959030Z 2025-03-27 14:42:47,770 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://80a3bbef-c294-4250-9f21-b9142b218ca3'), ('node1'), ('ISPN'), ('172.17.0.1:7800'), ('TRUE'::boolean)) ]
2025-03-27T14:42:47.7960899Z 2025-03-27 14:42:47,770 DEBUG [org.jgroups.protocols.JDBC_PING2] (main) node1: inserted node1 for cluster ISPN
2025-03-27T14:42:47.7962041Z 2025-03-27 14:42:47,771 TRACE [org.jgroups.protocols.JDBC_PING2] (main) node1: wrote to backend store: [node1]
2025-03-27T14:42:47.7963307Z 2025-03-27 14:42:47,772 TRACE [org.jgroups.protocols.UFC] (main) new membership: [node1]
2025-03-27T14:42:47.7964238Z 2025-03-27 14:42:47,773 TRACE [org.jgroups.protocols.MFC] (main) new membership: [node1]
2025-03-27T14:42:47.7965355Z 2025-03-27 14:42:47,774 INFO  [org.infinispan.CLUSTER] (main) ISPN000094: Received new cluster view for channel ISPN: [node1|0] (1) [node1]
2025-03-27T14:42:47.7966899Z 2025-03-27 14:42:47,776 INFO  [org.keycloak.infinispan.module.certificates.CertificateReloadManager] (main) Reloading JGroups Certificate
2025-03-27T14:42:47.7968511Z 2025-03-27 14:42:47,781 DEBUG [org.jgroups.protocols.pbcast.GMS] (main) node1: created cluster (first member). My view is [node1|0], impl is CoordGmsImpl
2025-03-27T14:42:47.8936028Z 2025-03-27 14:42:47,822 INFO  [org.infinispan.CLUSTER] (main) ISPN000079: Channel `ISPN` local address is `node1`, physical addresses are `[172.17.0.1:7800]`
2025-03-27T14:42:47.8963680Z 2025-03-27 14:42:47,888 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: updating the local digest with a stable message (coordinator): node2: [1980 (1980)]
2025-03-27T14:42:47.8965334Z 2025-03-27 14:42:47,888 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: handling digest from node2:
2025-03-27T14:42:47.8966213Z mine:   node2: [-1]
2025-03-27T14:42:47.8966708Z sender: node2: [1980]
2025-03-27T14:42:47.8967302Z result: node2: [1980]
2025-03-27T14:42:47.8967735Z 
2025-03-27T14:42:47.8968242Z 2025-03-27 14:42:47,888 TRACE [org.jgroups.protocols.pbcast.STABLE] () node2: sending stability msg node2: [1980]
2025-03-27T14:42:47.8969614Z 2025-03-27 14:42:47,888 TRACE [org.jgroups.protocols.TCP] () node2: sending msg to null, src=node2, size=84, headers are STABLE: [STABILITY] view-id= [node2|62], TP: [cluster=ISPN]
2025-03-27T14:42:47.8971025Z 2025-03-27 14:42:47,888 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: received stable digest node2: [1980 (1980)]
2025-03-27T14:42:47.8972114Z 2025-03-27 14:42:47,888 TRACE [org.jgroups.protocols.pbcast.NAKACK2] () node2: deleting msgs <= 1980 from node2
2025-03-27T14:42:48.0938084Z 2025-03-27 14:42:48,039 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t6) node1 --> [all]: #1
2025-03-27T14:42:48.0942944Z 2025-03-27 14:42:48,041 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to null, src=node1, size=1202, headers are NAKACK2: [MSG, seqno=1], TP: [cluster=ISPN]
2025-03-27T14:42:48.0945782Z 2025-03-27 14:42:48,041 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t6) node1 used 1158 credits, 3998842 remaining
2025-03-27T14:42:48.0948393Z 2025-03-27 14:42:48,080 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t1) node1 --> [all]: #2
2025-03-27T14:42:48.0951473Z 2025-03-27 14:42:48,080 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to null, src=node1, size=2211, headers are NAKACK2: [MSG, seqno=2], TP: [cluster=ISPN]
2025-03-27T14:42:48.0954521Z 2025-03-27 14:42:48,080 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t1) node1 used 2167 credits, 3996675 remaining
2025-03-27T14:42:48.0956760Z 2025-03-27 14:42:48,087 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t4) node1 --> [all]: #3
2025-03-27T14:42:48.0965556Z 2025-03-27 14:42:48,087 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t4) node1: sending msg to null, src=node1, size=2221, headers are NAKACK2: [MSG, seqno=3], TP: [cluster=ISPN]
2025-03-27T14:42:48.0967236Z 2025-03-27 14:42:48,088 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t4) node1 used 2177 credits, 3994498 remaining
2025-03-27T14:42:48.1945342Z 2025-03-27 14:42:48,111 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t6) node1 --> [all]: #4
2025-03-27T14:42:48.1965253Z 2025-03-27 14:42:48,111 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t6) node1: sending msg to null, src=node1, size=2213, headers are NAKACK2: [MSG, seqno=4], TP: [cluster=ISPN]
2025-03-27T14:42:48.1967045Z 2025-03-27 14:42:48,111 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t6) node1 used 2169 credits, 3992329 remaining
2025-03-27T14:42:48.1968427Z 2025-03-27 14:42:48,122 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t1) node1 --> [all]: #5
2025-03-27T14:42:48.1970051Z 2025-03-27 14:42:48,122 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t1) node1: sending msg to null, src=node1, size=2212, headers are NAKACK2: [MSG, seqno=5], TP: [cluster=ISPN]
2025-03-27T14:42:48.1971686Z 2025-03-27 14:42:48,123 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t1) node1 used 2168 credits, 3990161 remaining
2025-03-27T14:42:48.1973167Z 2025-03-27 14:42:48,127 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t7) node1 --> [all]: #6
2025-03-27T14:42:48.1974815Z 2025-03-27 14:42:48,127 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t7) node1: sending msg to null, src=node1, size=2220, headers are NAKACK2: [MSG, seqno=6], TP: [cluster=ISPN]
2025-03-27T14:42:48.1976747Z 2025-03-27 14:42:48,127 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t7) node1 used 2176 credits, 3987985 remaining
2025-03-27T14:42:48.1978045Z 2025-03-27 14:42:48,132 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t8) node1 --> [all]: #7
2025-03-27T14:42:48.1979752Z 2025-03-27 14:42:48,132 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t8) node1: sending msg to null, src=node1, size=2214, headers are NAKACK2: [MSG, seqno=7], TP: [cluster=ISPN]
2025-03-27T14:42:48.1981765Z 2025-03-27 14:42:48,133 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t8) node1 used 2170 credits, 3985815 remaining
2025-03-27T14:42:48.1983314Z 2025-03-27 14:42:48,139 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t5) node1 --> [all]: #8
2025-03-27T14:42:48.1985126Z 2025-03-27 14:42:48,139 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t5) node1: sending msg to null, src=node1, size=2207, headers are NAKACK2: [MSG, seqno=8], TP: [cluster=ISPN]
2025-03-27T14:42:48.1986842Z 2025-03-27 14:42:48,139 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t5) node1 used 2163 credits, 3983652 remaining
2025-03-27T14:42:48.1988200Z 2025-03-27 14:42:48,144 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (non-blocking-thread-node1-p2-t2) node1 --> [all]: #9
2025-03-27T14:42:48.1989837Z 2025-03-27 14:42:48,145 TRACE [org.jgroups.protocols.TCP] (non-blocking-thread-node1-p2-t2) node1: sending msg to null, src=node1, size=1185, headers are NAKACK2: [MSG, seqno=9], TP: [cluster=ISPN]
2025-03-27T14:42:48.1991604Z 2025-03-27 14:42:48,145 TRACE [org.jgroups.protocols.MFC] (non-blocking-thread-node1-p2-t2) node1 used 1141 credits, 3982511 remaining
2025-03-27T14:42:48.2947328Z 2025-03-27 14:42:48,194 INFO  [org.keycloak.connections.infinispan.DefaultInfinispanConnectionProviderFactory] (main) Node name: node1, Site name: null
2025-03-27T14:42:48.3954487Z 2025-03-27 14:42:48,356 TRACE [org.jgroups.protocols.TCP] () node1: sending msg to null, src=node1, size=40, headers are NAKACK2: [HIGHEST_SEQNO, seqno=9], TP: [cluster=ISPN]
2025-03-27T14:42:48.7964695Z 2025-03-27 14:42:48,771 TRACE [org.jgroups.protocols.JDBC_PING2] () node1: SQL for deletion: wrapped[ DELETE from JGROUPS_PING WHERE address=('uuid://80a3bbef-c294-4250-9f21-b9142b218ca3') ]
2025-03-27T14:42:48.7973615Z 2025-03-27 14:42:48,773 DEBUG [org.jgroups.protocols.JDBC_PING2] () node1: removed node1 for cluster ISPN from database
2025-03-27T14:42:48.7975749Z 2025-03-27 14:42:48,773 TRACE [org.jgroups.protocols.JDBC_PING2] () node1: SQL for insertion: wrapped[ INSERT INTO JGROUPS_PING values (('uuid://80a3bbef-c294-4250-9f21-b9142b218ca3'), ('node1'), ('ISPN'), ('172.17.0.1:7800'), ('TRUE'::boolean)) ]
2025-03-27T14:42:48.7977550Z 2025-03-27 14:42:48,775 DEBUG [org.jgroups.protocols.JDBC_PING2] () node1: inserted node1 for cluster ISPN
2025-03-27T14:42:48.7978670Z 2025-03-27 14:42:48,775 TRACE [org.jgroups.protocols.JDBC_PING2] () node1: wrote to backend store: [node1]
2025-03-27T14:42:48.9981601Z 2025-03-27 14:42:48,922 INFO  [io.quarkus] (main) Keycloak 999.0.0-SNAPSHOT on JVM (powered by Quarkus 3.20.0.CR1) started in 6.447s. Listening on: http://0.0.0.0:8181 and https://0.0.0.0:8544. Management interface listening on https://0.0.0.0:9000.
2025-03-27T14:42:48.9983427Z 2025-03-27 14:42:48,923 INFO  [io.quarkus] (main) Profile prod activated. 
2025-03-27T14:42:48.9985134Z 2025-03-27 14:42:48,923 INFO  [io.quarkus] (main) Installed features: [agroal, cdi, hibernate-orm, jdbc-postgresql, keycloak, narayana-jta, opentelemetry, reactive-routes, rest, rest-jackson, smallrye-context-propagation, smallrye-health, vertx]
2025-03-27T14:42:49.8988745Z 14:42:49,838 INFO  [org.keycloak.testsuite.arquillian.containers.AbstractQuarkusDeployableContainer] Keycloak is ready at https://localhost:8544/auth/realms/master/
2025-03-27T14:42:49.8990308Z 14:42:49,839 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Backend node auth-server-quarkus-backend1 is started
2025-03-27T14:42:49.8991415Z 14:42:49,839 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Initializing admin client for https://localhost:8544/auth
2025-03-27T14:42:49.8992843Z 14:42:49,842 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Initializing testing client for https://localhost:8544/auth
2025-03-27T14:42:49.8994129Z 14:42:49,843 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] Backend node auth-server-quarkus-backend2 is started
2025-03-27T14:42:49.8995076Z 14:42:49,843 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] ---------- Node started
2025-03-27T14:42:49.8995752Z 14:42:49,843 INFO  [org.keycloak.testsuite.util.WaitUtils] Wait: 100ms
2025-03-27T14:42:49.9989887Z 14:42:49,985 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/RoleInvalidationClusterTest.class
2025-03-27T14:42:49.9992188Z 14:42:49,991 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/AbstractInvalidationClusterTestWithTestRealm.class
2025-03-27T14:42:49.9994428Z 14:42:49,993 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/AbstractInvalidationClusterTest.class
2025-03-27T14:42:49.9996137Z 14:42:49,994 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/AbstractClusterTest.class
2025-03-27T14:42:49.9997558Z 14:42:49,995 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/AbstractKeycloakTest.class
2025-03-27T14:42:50.0897499Z 14:42:49,999 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/runners/model/TestTimedOutException.class
2025-03-27T14:42:50.0899048Z 14:42:50,001 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/arquillian/ContainerInfo.class
2025-03-27T14:42:50.0900665Z 14:42:50,002 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/admin/client/resource/RoleResource.class
2025-03-27T14:42:50.0901783Z 14:42:50,003 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/admin/client/resource/RoleByIdResource.class
2025-03-27T14:42:50.0903246Z 14:42:50,004 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/admin/client/resource/RolesResource.class
2025-03-27T14:42:50.0904331Z 14:42:50,005 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/util/CryptoInitRule.class
2025-03-27T14:42:50.0905337Z 14:42:50,006 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/rules/ExternalResource.class
2025-03-27T14:42:50.0906366Z 14:42:50,007 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/rules/TestRule.class
2025-03-27T14:42:50.0907300Z 14:42:50,008 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/runners/model/Statement.class
2025-03-27T14:42:50.0908254Z 14:42:50,008 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/rules/ExternalResource$1.class
2025-03-27T14:42:50.0909270Z 14:42:50,009 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/keycloak/testsuite/cluster/CheckClusterSize.class
2025-03-27T14:42:50.0909958Z Member set size: 1 [[node1]]
2025-03-27T14:42:50.0910497Z 14:42:50,011 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/Assert.class
2025-03-27T14:42:50.0911308Z 14:42:50,012 INFO  [org.keycloak.testsuite.arquillian.TestClassProvider] Request: /org/junit/ComparisonFailure.class
2025-03-27T14:42:50.0912001Z 14:42:50,083 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] calling all TestCleanup
2025-03-27T14:42:50.1918839Z 14:42:50,098 ERROR [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] [RoleInvalidationClusterTest] testClusterFormed() FAILED
2025-03-27T14:42:50.1920668Z 14:42:50,099 INFO  [org.keycloak.testsuite.cluster.RoleInvalidationClusterTest] [RoleInvalidationClusterTest] testClusterFormed() FINISHED
2025-03-27T14:42:50.1921386Z 
2025-03-27T14:42:50.1921391Z 
2025-03-27T14:42:50.4005142Z [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 324.483 s <<< FAILURE! - in org.keycloak.testsuite.cluster.RoleInvalidationClusterTest
2025-03-27T14:42:50.4006660Z [ERROR] org.keycloak.testsuite.cluster.RoleInvalidationClusterTest.testClusterFormed  Time elapsed: 321.592 s  <<< FAILURE!
2025-03-27T14:42:50.4007521Z java.lang.AssertionError: expected:<2> but was:<1>
2025-03-27T14:42:50.4007982Z 	at org.junit.Assert.fail(Assert.java:89)
2025-03-27T14:42:50.4008404Z 	at org.junit.Assert.failNotEquals(Assert.java:835)
2025-03-27T14:42:50.4008856Z 	at org.junit.Assert.assertEquals(Assert.java:647)
2025-03-27T14:42:50.4009284Z 	at org.junit.Assert.assertEquals(Assert.java:633)
2025-03-27T14:42:50.4010019Z 	at org.keycloak.testsuite.cluster.CheckClusterSize.clusterSize(CheckClusterSize.java:20)
2025-03-27T14:42:50.4010928Z 	at org.keycloak.testsuite.rest.TestingResourceProvider.runOnServer(TestingResourceProvider.java:794)
2025-03-27T14:42:50.4012125Z 	at org.keycloak.testsuite.rest.TestingResourceProvider$quarkusrestinvoker$runOnServer_ff89fab48911f9f930b958e942a03e8c3bccf56c.invoke(Unknown Source)
2025-03-27T14:42:50.4013814Z 	at org.jboss.resteasy.reactive.server.handlers.InvocationHandler.handle(InvocationHandler.java:29)
2025-03-27T14:42:50.4015776Z 	at io.quarkus.resteasy.reactive.server.runtime.QuarkusResteasyReactiveRequestContext.invokeHandler(QuarkusResteasyReactiveRequestContext.java:141)
2025-03-27T14:42:50.4017082Z 	at org.jboss.resteasy.reactive.common.core.AbstractResteasyReactiveContext.run(AbstractResteasyReactiveContext.java:147)
2025-03-27T14:42:50.4017855Z 	at io.quarkus.vertx.core.runtime.VertxCoreRecorder$15.runWith(VertxCoreRecorder.java:638)
2025-03-27T14:42:50.4018466Z 	at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.java:2675)
2025-03-27T14:42:50.4019065Z 	at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2654)
2025-03-27T14:42:50.4019662Z 	at org.jboss.threads.EnhancedQueueExecutor.runThreadBody(EnhancedQueueExecutor.java:1627)
2025-03-27T14:42:50.4020279Z 	at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1594)
2025-03-27T14:42:50.4020854Z 	at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:11)
2025-03-27T14:42:50.4021424Z 	at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:11)
2025-03-27T14:42:50.4022062Z 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
2025-03-27T14:42:50.4022699Z 	at java.base/java.lang.Thread.run(Thread.java:1583)
2025-03-27T14:42:50.4022919Z 
2025-03-27T14:42:50.4024844Z Log has ended
2025-03-27T14:42:50.7008724Z Log has ended
2025-03-27T14:42:51.0306056Z 14:42:51,021 INFO  [org.keycloak.testsuite.arquillian.undertow.lb.SimpleUndertowLoadBalancerContainer] Going to stop loadbalancer
2025-03-27T14:42:51.0307519Z 14:42:51,021 INFO  [io.undertow] stopping server: Undertow - 2.3.2.Final
2025-03-27T14:42:51.0313898Z 14:42:51,024 INFO  [io.undertow] stopping server: Undertow - 2.3.2.Final
2025-03-27T14:42:51.0638196Z [INFO] 
2025-03-27T14:42:51.0638586Z [INFO] Results:
2025-03-27T14:42:51.0638963Z [INFO] 
2025-03-27T14:42:51.0639251Z [ERROR] Failures: 
2025-03-27T14:42:51.0639866Z [ERROR]   RoleInvalidationClusterTest.testClusterFormed expected:<2> but was:<1>
2025-03-27T14:42:51.0640532Z [INFO] 
2025-03-27T14:42:51.0640927Z [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
2025-03-27T14:42:51.0641418Z [INFO] 
2025-03-27T14:42:51.0667006Z [INFO] ------------------------------------------------------------------------
2025-03-27T14:42:51.0667560Z [INFO] BUILD FAILURE
2025-03-27T14:42:51.0668036Z [INFO] ------------------------------------------------------------------------
2025-03-27T14:42:51.0668998Z [INFO] Total time:  06:07 min
2025-03-27T14:42:51.0670922Z [INFO] Finished at: 2025-03-27T14:42:51Z
2025-03-27T14:42:51.0671538Z [INFO] ------------------------------------------------------------------------
2025-03-27T14:42:51.0678677Z [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M7:test (default-test) on project integration-arquillian-tests-base: There are test failures.
2025-03-27T14:42:51.0679963Z [ERROR] 
2025-03-27T14:42:51.0681011Z [ERROR] Please refer to /home/runner/work/keycloak/keycloak/testsuite/integration-arquillian/tests/base/target/surefire-reports for the individual test results.
2025-03-27T14:42:51.0682643Z [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
2025-03-27T14:42:51.0683423Z [ERROR] -> [Help 1]
2025-03-27T14:42:51.0683753Z [ERROR] 
2025-03-27T14:42:51.0684227Z [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
2025-03-27T14:42:51.0685060Z [ERROR] Re-run Maven using the -X switch to enable full debug logging.
2025-03-27T14:42:51.0685766Z [ERROR] 
2025-03-27T14:42:51.0686435Z [ERROR] For more information about the errors and possible solutions, please read the following articles:
2025-03-27T14:42:51.0687490Z [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
2025-03-27T14:42:51.4177799Z ##[error]Process completed with exit code 1.
2025-03-27T14:42:51.4240954Z Post job cleanup.
2025-03-27T14:42:51.4282934Z Post job cleanup.
2025-03-27T14:42:51.6006777Z Post job cleanup.
2025-03-27T14:42:51.6986752Z [command]/usr/bin/git version
2025-03-27T14:42:51.7022822Z git version 2.49.0
2025-03-27T14:42:51.7067550Z Temporarily overriding HOME='/home/runner/work/_temp/6aa00864-4cf2-4431-bb50-5544efea1c6e' before making global git config changes
2025-03-27T14:42:51.7068832Z Adding repository directory to the temporary git global config as a safe directory
2025-03-27T14:42:51.7074738Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/keycloak/keycloak
2025-03-27T14:42:51.7113775Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-03-27T14:42:51.7147477Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-03-27T14:42:51.7393286Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-03-27T14:42:51.7414810Z http.https://github.com/.extraheader
2025-03-27T14:42:51.7427249Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2025-03-27T14:42:51.7458321Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-03-27T14:42:51.7799866Z Cleaning up orphan processes