Problems after upgrade to 4.6.6

You should not need to restart Openfire after changing this session. It will only apply to new client connections though (so restarting Openfire will make sure that it applies to all sessions).

@guus as i sad earlier… i have this issue too on a 4.5.x branch…
it happens 2-3 times a week

another sympthome is that i can not close invalid sessions on the admin sessions tab

i will test xmpp.client.version-query.enabled = false if it will help

by the way: bosh connections are not affected

my config:
OF 4.5.x
Port 5222 Plain, legacy SSL not used (disabled)
Disconnect inactive clients after 120 seconds (send xmpp pings)
port readbuffer: 10485760 (tested also unlimited)
startTSL = optional
client certs are disabled
TLSv1, TLSv1.1, TLSv1.2 and SSLv2Hello enabled
all krypto suites enabled
16 worker Threads

ok. done.

1 Like
2022.01.07 02:08:54 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Found 7 invalid sessions

this solution didn’t help :frowning:

1 Like

maybe it will helpfull…
maybe this problem only on OF with enabled s2s? and when something broken not only in client sessions? because when it happened, i can open 5222 port over telnet, then close it and have record in OF log about it:

2022.01.07 02:16:37 org.jivesoftware.openfire.nio.ConnectionHandler - Closing connection due to exception in session: (0x00000043: nio socket, server, /93.100.253.178:44588 => /109.167.208.180:5222) 

before happened Ivalid Sessions:

2022.01.07 01:07:34 org.jivesoftware.openfire.server.ServerDialback[Acting as Originating Server: Authenticate domain: softjoys.pro with RS: openfire.pp.ua (id: 1atci6rhkf)] - Ignoring unexpected answer while waiting for dialback validation: <stream:error xmlns:stream="http://etherx.jabber.org/streams"><policy-violation xmlns="urn:ietf:params:xml:ns:xmpp-streams"></policy-violation></stream:error>
2022.01.07 01:09:34 org.jivesoftware.openfire.server.ServerDialback[Acting as Originating Server: Create Outgoing Session from: softjoys.pro to RS at: openfire.pp.ua (port: 5269)] - Unable to create a new outgoing session
2022.01.07 01:09:34 org.jivesoftware.openfire.session.LocalOutgoingServerSession[Create outgoing session for: softjoys.pro to openfire.pp.ua] - Unable to create a new session: Dialback (as a fallback) failed.
2022.01.07 01:09:34 org.jivesoftware.openfire.session.LocalOutgoingServerSession[Authenticate local domain: 'softjoys.pro' to remote domain: 'openfire.pp.ua'] - Unable to authenticate: Fail to create new session.

after resrat OF:

2022.01.07 02:18:57 org.jivesoftware.openfire.spi.LegacyConnectionAcceptor - Configuration allows for up to 16 threads, although implementation is limited to exactly one.

Sorry to hear that disabling the version query functionality did not prevent the issue. It was a bit of a long shot.

I do not believe that those s2s log lines are related. They’re very common.

I have tested within 4.6.6, 4.6.7 and 4.7 and same problems

Now I am testing with 4.6.7

Debian GNU/Linux 10
Port 5222 (StartTLS optional) (try disable but no good results)
Not disconnect inative users
Stream Managemant disabled
client cert disabled
all krypto enabled
16 worker Threads

Now I have disabled xmpp.client.version-query.enabled to see what happen

In my case I can close invalid session from session tab, but ones the problem starts the only solucion is to restart connection listener.

In my case this issue happens many times every day.

Thanks.

We have noticed that the conference rooms are not working properly either.

Ones that we restart connection listener they can start working again, but after some minutes they can not send any message.

In my logs:

2022.01.07 12:34:19 WARN [socket_c2s-thread-15]: org.jivesoftware.openfire.nio.ConnectionHandler - Closing connection due to exception in session: (0x000000A9: nio socket, server, null => 0.0.0.0/0.0.0.0:5222)
java.io.IOException: Conexi▒n reinicializada por la m▒quina remota
at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[?:?]
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) ~[?:?]
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276) ~[?:?]
at sun.nio.ch.IOUtil.read(IOUtil.java:245) ~[?:?]
at sun.nio.ch.IOUtil.read(IOUtil.java:223) ~[?:?]
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:356) ~[?:?]
at org.apache.mina.transport.socket.nio.NioProcessor.read(NioProcessor.java:378) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.transport.socket.nio.NioProcessor.read(NioProcessor.java:47) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.core.polling.AbstractPollingIoProcessor.read(AbstractPollingIoProcessor.java:519) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.core.polling.AbstractPollingIoProcessor.access$1200(AbstractPollingIoProcessor.java:68) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.core.polling.AbstractPollingIoProcessor$Processor.process(AbstractPollingIoProcessor.java:1222) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.core.polling.AbstractPollingIoProcessor$Processor.process(AbstractPollingIoProcessor.java:1211) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.core.polling.AbstractPollingIoProcessor$Processor.run(AbstractPollingIoProcessor.java:683) ~[mina-core-2.1.3.jar:?]
at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) ~[mina-core-2.1.3.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]

Until now… no invalid sessions appear…My last changed has been xmpp.client.version-query.enabled

I will continue monitoring and asking user for feeling

2022.01.07 12:38:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:38:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…
2022.01.07 12:39:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:39:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…
2022.01.07 12:40:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:40:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…
2022.01.07 12:41:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:41:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…
2022.01.07 12:42:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:42:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…
2022.01.07 12:43:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:43:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…
2022.01.07 12:44:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - Start sessioncheck
2022.01.07 12:44:25 org.igniterealtime.openfire.plugin.sessioncheck.SessionCheckPlugin - No invalid sessions found…

For sure that I need more time, but until now the system seems to be holding up with this last change.

if xmpp.client.version-query.enabled = false should resolve the issue (we will see) then it sounds like a bug is consuming all worker threads so new connections could not be accepted …

but what is causing the invalid sessions? hmm

I’m getting conflicting reports about xmpp.client.version-query.enabled being successful. @pedimave what are your findings?

Can someone please verify if, after trying to close a session in the admin console that is marked as marked as “invalid session/connection”, a line appears in the Security Audit Viewer that contains: “closed session for address” (followed by the address of the session that you’re trying to close.

i will keep an eye on it…

1 Like

I am wondering if after the problem starts happening, the log files contain one or more stack traces that contains this line:

org.apache.mina.core.filterchain.IoFilterEvent.fire

Could someone please check that (and provide me with the full stack trace)?

I have searched the logs and found this:

org.apache.mina.filter.codec.ProtocolDecoderException: org.jivesoftware.openfire.nio.XMLNotWellFormedException: Character is invalid in:  (Hexdump: 16 03 01 01 70 01 00 01 6C 03 03 1D 3C 6E E7 B3 37 DB 2D 7E 58 00 97 30 95 CD 35 10 59 C3 D6 B0 E4 E6 A0 BC 24 AB 85 50 24 93 CA 20 AF 02 4E 5C A5 BA 88 AE 27 6A AE E5 E9 F4 9D B2 C6 00 82 EC EC 62 80 F1 45 CE BD 71 17 63 33 96 00 96 13 02 13 03 13 01 C0 2C C0 30 00 A3 00 9F CC A9 CC A8 CC AA C0 AF C0 AD C0 A3 C0 9F C0 5D C0 61 C0 57 C0 53 C0 2B C0 2F 00 A2 00 9E C0 AE C0 AC C0 A2 C0 9E C0 5C C0 60 C0 56 C0 52 C0 24 C0 28 00 6B 00 6A C0 73 C0 77 00 C4 00 C3 C0 23 C0 27 00 67 00 40 C0 72 C0 76 00 BE 00 BD C0 0A C0 14 00 39 00 38 00 88 00 87 C0 09 C0 13 00 33 00 32 00 45 00 44 00 9D C0 A1 C0 9D C0 51 00 9C C0 A0 C0 9C C0 50 00 3D 00 C0 00 3C 00 BA 00 35 00 84 00 2F 00 41 00 FF 01 00 00 8D 00 0B 00 04 03 00 01 02 00 0A 00 0C 00 0A 00 1D 00 17 00 1E 00 19 00 18 00 16 00 00 00 17 00 00 00 0D 00 30 00 2E 04 03 05 03 06 03 08 07 08 08 08 09 08 0A 08 0B 08 04 08 05 08 06 04 01 05 01 06 01 03 03 02 03 03 01 02 01 03 02 02 02 04 02 05 02 06 02 00 2B 00 05 04 03 04 03 03 00 2D 00 02 01 01 00 33 00 26 00 24 00 1D 00 20 9B 35 10 80 C7 1D 5D 67 1D 02 96 17 D5 67 A6 A3 CE 82 F2 42 81 C5 0F 98 1A 12 36 E6 19 4D BB 68)
	at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:263) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterEvent.fire (IoFilterEvent.java:106) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.session.IoEvent.run(IoEvent.java:89) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTask(OrderedThreadPoolExecutor.java:766) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTasks(OrderedThreadPoolExecutor.java:758) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.run(OrderedThreadPoolExecutor.java:697) [mina-core-2.1.3.jar:?]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202]
Caused by: org.jivesoftware.openfire.nio.XMLNotWellFormedException: Character is invalid in: 
	at org.jivesoftware.openfire.nio.XMLLightweightParser.read(XMLLightweightParser.java:220) ~[xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.nio.XMPPDecoder.doDecode(XMPPDecoder.java:38) ~[xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.apache.mina.filter.codec.CumulativeProtocolDecoder.decode(CumulativeProtocolDecoder.java:180) ~[mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:254) ~[mina-core-2.1.3.jar:?]
	... 9 more

or

java.sql.SQLException: Transaction (Process ID 98) was deadlocked on lock | communication buffer resources with another process and has been chosen as the deadlock victim. Rerun the transaction.
	at net.sourceforge.jtds.jdbc.SQLDiagnostic.addDiagnostic(SQLDiagnostic.java:372) ~[jtds-1.3.1.jar:1.3.1]
	at net.sourceforge.jtds.jdbc.TdsCore.tdsErrorToken(TdsCore.java:2988) ~[jtds-1.3.1.jar:1.3.1]
	at net.sourceforge.jtds.jdbc.TdsCore.nextToken(TdsCore.java:2421) ~[jtds-1.3.1.jar:1.3.1]
	at net.sourceforge.jtds.jdbc.TdsCore.getMoreResults(TdsCore.java:671) ~[jtds-1.3.1.jar:1.3.1]
	at net.sourceforge.jtds.jdbc.JtdsStatement.processResults(JtdsStatement.java:613) ~[jtds-1.3.1.jar:1.3.1]
	at net.sourceforge.jtds.jdbc.JtdsStatement.executeSQL(JtdsStatement.java:572) ~[jtds-1.3.1.jar:1.3.1]
	at net.sourceforge.jtds.jdbc.JtdsPreparedStatement.executeUpdate(JtdsPreparedStatement.java:727) ~[jtds-1.3.1.jar:1.3.1]
	at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:136) ~[commons-dbcp2-2.6.0.jar:2.6.0]
	at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:136) ~[commons-dbcp2-2.6.0.jar:2.6.0]
	at org.jivesoftware.openfire.OfflineMessageStore.getMessages(OfflineMessageStore.java:234) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.handler.PresenceUpdateHandler.initSession(PresenceUpdateHandler.java:265) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateHandler.java:157) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateHandler.java:137) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateHandler.java:205) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.PresenceRouter.handle(PresenceRouter.java:143) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.PresenceRouter.route(PresenceRouter.java:79) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:84) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.StanzaHandler.processPresence(StanzaHandler.java:384) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.ClientStanzaHandler.processPresence(ClientStanzaHandler.java:102) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:285) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:203) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.nio.ConnectionHandler.messageReceived(ConnectionHandler.java:183) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$TailFilter.messageReceived(DefaultIoFilterChain.java:1015) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:122) [mina-core-2.1.3.jar:?]
	at org.jivesoftware.openfire.plugin.RawPrintFilter.messageReceived(RawPrintFilter.java:108) [xmldebugger-1.7.3.jar!/:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:122) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.codec.ProtocolCodecFilter$ProtocolDecoderOutputImpl.flush(ProtocolCodecFilter.java:413) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:257) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterEvent.fire(IoFilterEvent.java:106) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.session.IoEvent.run(IoEvent.java:89) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTask(OrderedThreadPoolExecutor.java:766) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTasks(OrderedThreadPoolExecutor.java:758) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.run(OrderedThreadPoolExecutor.java:697) [mina-core-2.1.3.jar:?]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202]

or

2022.01.10 05:33:58 ERROR [socket_c2s-thread-5]: org.jivesoftware.openfire.handler.IQHandler - Interner Serverfehler
java.lang.IllegalArgumentException: IQ must be of type 'set' or 'get'. Original IQ: <iq id="557-274" to="DOMAIN" from="USER@DOMAIN/RESSOURCE-X77G7RD4" type="result"><query xmlns="http://jabber.org/protocol/disco#info"><identity type="pc" category="client" name="Gajim"/><feature var="http://jabber.org/protocol/bytestreams"/><feature var="http://jabber.org/protocol/si"/><feature var="http://jabber.org/protocol/si/profile/file-transfer"/><feature var="http://jabber.org/protocol/muc"/><feature var="http://jabber.org/protocol/muc#user"/><feature var="http://jabber.org/protocol/muc#admin"/><feature var="http://jabber.org/protocol/muc#owner"/><feature var="http://jabber.org/protocol/muc#roomconfig"/><feature var="http://jabber.org/protocol/commands"/><feature var="http://jabber.org/protocol/disco#info"/><feature var="ipv6"/><feature var="jabber:iq:gateway"/><feature var="jabber:iq:last"/><feature var="jabber:iq:privacy"/><feature var="jabber:iq:private"/><feature var="jabber:iq:register"/><feature var="jabber:iq:version"/><feature var="jabber:x:data"/><feature var="jabber:x:encrypted"/><feature var="msglog"/><feature var="sslc2s"/><feature var="stringprep"/><feature var="urn:xmpp:ping"/><feature var="urn:xmpp:time"/><feature var="urn:xmpp:ssn"/><feature var="http://jabber.org/protocol/mood"/><feature var="http://jabber.org/protocol/activity"/><feature var="http://jabber.org/protocol/nick"/><feature var="http://jabber.org/protocol/rosterx"/><feature var="urn:xmpp:sec-label:0"/><feature var="urn:xmpp:hashes:2"/><feature var="urn:xmpp:hash-function-text-names:md5"/><feature var="urn:xmpp:hash-function-text-names:sha-1"/><feature var="urn:xmpp:hash-function-text-names:sha-256"/><feature var="urn:xmpp:hash-function-text-names:sha-512"/><feature var="jabber:x:conference"/><feature var="urn:xmpp:message-correct:0"/><feature var="urn:xmpp:eme:0"/><feature var="urn:xmpp:avatar:metadata+notify"/><feature var="http://jabber.org/protocol/mood+notify"/><feature var="http://jabber.org/protocol/activity+notify"/><feature var="http://jabber.org/protocol/tune+notify"/><feature var="http://jabber.org/protocol/nick+notify"/><feature var="http://jabber.org/protocol/geoloc+notify"/><feature var="http://jabber.org/protocol/chatstates"/><feature var="http://jabber.org/protocol/xhtml-im"/><feature var="urn:xmpp:receipts"/><feature var="urn:xmpp:jingle:1"/><feature var="urn:xmpp:jingle:apps:file-transfer:5"/><feature var="urn:xmpp:jingle:security:xtls:0"/><feature var="urn:xmpp:jingle:transports:s5b:1"/><feature var="urn:xmpp:jingle:transports:ibb:1"/><feature var="eu.siacs.conversations.axolotl.devicelist+notify"/></query></iq>
	at org.xmpp.packet.IQ.createResultIQ(IQ.java:378) ~[tinder-2.0.0.jar:?]
	at org.jivesoftware.openfire.disco.IQDiscoInfoHandler.handleIQ(IQDiscoInfoHandler.java:136) ~[xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.handler.IQHandler.process(IQHandler.java:62) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.IQRouter.handle(IQRouter.java:369) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.IQRouter.route(IQRouter.java:112) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:74) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.StanzaHandler.processIQ(StanzaHandler.java:366) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.ClientStanzaHandler.processIQ(ClientStanzaHandler.java:95) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:316) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:203) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.jivesoftware.openfire.nio.ConnectionHandler.messageReceived(ConnectionHandler.java:183) [xmppserver-4.6.0-SNAPSHOT.jar:4.6.0-SNAPSHOT]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$TailFilter.messageReceived(DefaultIoFilterChain.java:1015) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:122) [mina-core-2.1.3.jar:?]
	at org.jivesoftware.openfire.plugin.RawPrintFilter.messageReceived(RawPrintFilter.java:108) [xmldebugger-1.7.3.jar!/:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:122) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.codec.ProtocolCodecFilter$ProtocolDecoderOutputImpl.flush(ProtocolCodecFilter.java:413) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:257) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.filterchain.IoFilterEvent.fire(IoFilterEvent.java:106) [mina-core-2.1.3.jar:?]
	at org.apache.mina.core.session.IoEvent.run(IoEvent.java:89) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTask(OrderedThreadPoolExecutor.java:766) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTasks(OrderedThreadPoolExecutor.java:758) [mina-core-2.1.3.jar:?]
	at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.run(OrderedThreadPoolExecutor.java:697) [mina-core-2.1.3.jar:?]

… at org.apache.mina.core.filterchain.IoFilterEvent.fire (IoFilterEvent.java:106) …
is allways part of the stacktrace

1 Like

Ones that I have change xmpp.client.version-query.enabled no more invalid session appear on my side.

With the help of @catmanspb I’ve found pretty conclusive evidence of at least one source of the reason why no users can connect any more when the problem occurs. I have updated OF-2367 with the details. I’ve also implemented a fix that would prevent all users from having problems logging in again.

With the above, when the problem occurs, it should now only affect the user that triggers it. To fix that issue, I’ll need to dig deeper. I suspect that this problem is caused by a combination of all of these factors:

  • Openfire 4.6.4 or later
  • Push Notification plugin 0.9.0 Pade plugin 1.5.2 or older
  • Having a user that has enabled push notifications in their client
  • That user being offline
  • Another user sending a message to the offline user

Can someone confirm all of this?

we dont have push notification plugin installed, sorry cant help with it

Very confusingly, the Pade plugin has a class that uses the exact same name as a class in the Push Notification plugin. I suspect that the problem is caused by the Pade plugin (in combination with all of the above), not the Push Notification plugin.

The source code of the Pade plugin has already been updated to fix this problem. That code has not yet been released. It is scheduled to be part of version 1.6.0 of the Pade plugin.

We don’t use the Pade plugin either in my setup… :roll_eyes: