Speeding up pubsub replication

andom · July 5, 2022, 8:39am

How can I speed up the pubsub replication and why is there a difference between deleting pubsubs and creating.

Once I remove a pubsub of an user account through the admin console it will be removed from the second node immediately.
Instead, if a client app creates such pubsubs on one server, it takes 20 minutes … which is bad once another user is logged in on the second node that the pubsub still not knows.

guus · July 6, 2022, 7:35am

20 minutes? That sounds like a bug, not expected behavior. I would not be surprised if this is some kind of cache that does not get purged properly.

Can you provide an exact reproduction path? Does it still take 20 minutes if you purge all caches?

andom · July 7, 2022, 6:57am

Hey Guus,
have cleared the entire cache before creating pubsubs.
Same behavior, server 2 has the pupbsubs server 1 has not.

Event Log spits these logs repeatedly, never ending until I restart openfire

2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-15]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-5]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-18]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-10]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null
2022.07.07 08:47:43 DEBUG [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - Executing asynchronous DistributedTask: org.jivesoftware.openfire.cluster.RemotePacketExecution
2022.07.07 08:47:43 TRACE [hz.openfire.cached.thread-14]: org.jivesoftware.openfire.plugin.util.cache.ClusteredCacheFactory - CallableTask[org.jivesoftware.openfire.cluster.RemotePacketExecution] result: null

After restart I got this

2022.07.07 08:53:31 ERROR [hz.openfire.generic-operation.thread-0]: com.hazelcast.executor.impl.operations.MemberCallableTaskOperation - [10.0.0.103]:5701 [openfire] [3.12.5] java.lang.ClassNotFoundException: org.jivesoftware.openfire.archive.cluster.GetConversationsWriteETATask
com.hazelcast.nio.serialization.HazelcastSerializationException: java.lang.ClassNotFoundException: org.jivesoftware.openfire.archive.cluster.GetConversationsWriteETATask
	at com.hazelcast.internal.serialization.impl.JavaDefaultSerializers$JavaSerializer.read(JavaDefaultSerializers.java:88) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.internal.serialization.impl.JavaDefaultSerializers$JavaSerializer.read(JavaDefaultSerializers.java:77) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.read(StreamSerializerAdapter.java:48) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject(AbstractSerializationService.java:187) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.executor.impl.operations.AbstractCallableTaskOperation$OffloadImpl.loadCallable(AbstractCallableTaskOperation.java:106) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.executor.impl.operations.AbstractCallableTaskOperation$OffloadImpl.start(AbstractCallableTaskOperation.java:98) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:224) [hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:199) [hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:416) [hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:153) [hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:123) [hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.run(OperationThread.java:110) [hazelcast-3.12.5.jar!/:?]
Caused by: java.lang.ClassNotFoundException: org.jivesoftware.openfire.archive.cluster.GetConversationsWriteETATask
	at org.jivesoftware.openfire.plugin.util.cache.ClusterClassLoader.lambda$loadClass$2(ClusterClassLoader.java:94) ~[hazelcast-2.6.0.jar!/:?]
	at java.util.Optional.orElseThrow(Optional.java:290) ~[?:1.8.0_332]
	at org.jivesoftware.openfire.plugin.util.cache.ClusterClassLoader.loadClass(ClusterClassLoader.java:94) ~[hazelcast-2.6.0.jar!/:?]
	at com.hazelcast.nio.ClassLoaderUtil.tryLoadClass(ClassLoaderUtil.java:288) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.nio.ClassLoaderUtil.loadClass(ClassLoaderUtil.java:252) ~[hazelcast-3.12.5.jar!/:?]
	at com.hazelcast.nio.IOUtil$ClassLoaderAwareObjectInputStream.resolveClass(IOUtil.java:699) ~[hazelcast-3.12.5.jar!/:?]
	at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1987) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1851) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2185) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1668) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2430) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2354) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2212) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1668) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:502) ~[?:1.8.0_332]
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:460) ~[?:1.8.0_332]
	at com.hazelcast.internal.serialization.impl.JavaDefaultSerializers$JavaSerializer.read(JavaDefaultSerializers.java:84) ~[hazelcast-3.12.5.jar!/:?]
	... 11 more

guus · July 10, 2022, 6:07pm

I’m not sure if this is related to the pubsub issue, but something is wrong with the Monitoring plugin. Are you using the latest version of the monitoring plugin, and have you installed it on all cluster members?

andom · July 11, 2022, 4:52am

My fault, I recently removed the plugin from server 2 for any reason I do not remember.
Re-installed latest version.
Any clue for the pubsub issue? What do you mean with reproduction path?

guus · July 11, 2022, 7:54am

A reproduction path is the exact steps that someone needs to perform to create the problem in their setup.

andom · July 11, 2022, 8:03am

OK. Thank you.
User signs in on a converse.js (separate server) or even inverse (with libsignal).
Works well so far.
When it comes to creating pubsubs like bundle and device list it creates these on Server 2.
After around 20 minutes these pubsubs will be replicated on Server 1. Should be replicated instantly, right?

andom · September 22, 2022, 5:38pm

Still have this issue. Any idea?
Even updating the cache doesn’t work properly.
I have to restart the OF service to get ldap information updated. New group assignments user changes are not being updated till OFservices was restarted. Seems it is going to be worse.