-
Bug
-
Resolution: Done
-
Critical
-
None
Splunk query:
index=rh_rhsm namespace=rhsm-prod source=swatch-billable-usage "Exception" | regex _raw!="ContractCoverageException"
Stacktrace:
{2024-10-21 09:01:46,057 ERROR [com.red.swa.bil.usa.adm.api.InternalBillableUsageResource] (executor-thread-6126) Error retrying billable usage remittances: io.quarkus.arc.ArcUndeclaredThrowableException: Error invoking subclass method at com.redhat.swatch.billable.usage.admin.api.InternalBillableUsageController_Subclass.processRetries(Unknown Source) at com.redhat.swatch.billable.usage.admin.api.InternalBillableUsageController_ClientProxy.processRetries(Unknown Source) at com.redhat.swatch.billable.usage.admin.api.InternalBillableUsageResource.processRetries(InternalBillableUsageResource.java:154) at com.redhat.swatch.billable.usage.admin.api.InternalBillableUsageResource_ClientProxy.processRetries(Unknown Source) at com.redhat.swatch.billable.usage.openapi.resource.DefaultApi$quarkusrestinvoker$processRetries_20c8d311437a2bc7f9beb76db205cb01b1023ae6.invoke(Unknown Source) at org.jboss.resteasy.reactive.server.handlers.InvocationHandler.handle(InvocationHandler.java:29) at io.quarkus.resteasy.reactive.server.runtime.QuarkusResteasyReactiveRequestContext.invokeHandler(QuarkusResteasyReactiveRequestContext.java:141) at org.jboss.resteasy.reactive.common.core.AbstractResteasyReactiveContext.run(AbstractResteasyReactiveContext.java:147) at io.quarkus.vertx.core.runtime.VertxCoreRecorder$14.runWith(VertxCoreRecorder.java:635) at org.jboss.threads.EnhancedQueueExecutor$Task.doRunWith(EnhancedQueueExecutor.java:2516) at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2495) at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1521) at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:11) at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:11) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: jakarta.transaction.RollbackException: ARJUNA016102: The transaction is not active! Uid is 0:ffff0a800ee6:b251:6711354e:1061ae at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1280) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:104) at io.quarkus.narayana.jta.runtime.NotifyingTransactionManager.commit(NotifyingTransactionManager.java:70) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorBase.endTransaction(TransactionalInterceptorBase.java:406) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorBase.invokeInOurTx(TransactionalInterceptorBase.java:175) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorBase.invokeInOurTx(TransactionalInterceptorBase.java:107) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorRequired.doIntercept(TransactionalInterceptorRequired.java:38) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorBase.intercept(TransactionalInterceptorBase.java:61) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorRequired.intercept(TransactionalInterceptorRequired.java:32) at io.quarkus.narayana.jta.runtime.interceptor.TransactionalInterceptorRequired_Bean.intercept(Unknown Source) at io.quarkus.arc.impl.InterceptorInvocation.invoke(InterceptorInvocation.java:42) at io.quarkus.arc.impl.AroundInvokeInvocationContext.perform(AroundInvokeInvocationContext.java:30) at io.quarkus.arc.impl.InvocationContexts.performAroundInvoke(InvocationContexts.java:27) ... 16 more
Checking
index=rh_rhsm namespace=rhsm-prod source=swatch-billable-usage properties.traceId="b1364b212be931ffa9524afa52c23bce"
, it seems that the transaction is open for more than almost 90 seconds which might cause the transaction being aborted.
Acceptance Criteria
- Investigate why the processRetries takes long time and fix