A misconfiguration or bug which fails Infinispan's Cache Container to start correctly will not have the core lifecycle shutdown and cleanup all resources which have been started.
In the case of the JPACacheStore, this could include database connection pools and it's critical to get these resources disposed.