Hi.
More than a year we suffer from the problem of hanging up Spark on laptops.
Watching this problem, I realized that Spark freezes exactly 5 hours after its opening.
Because we have people come at 8:00 and Spark hangs up at 13:00, if a person comes at 10:00, then he hangs at exactly 15:00.
Which laptops have a problem? all, HP DELL ASUS Lenovo, no difference.
Installed a clean Windows 10, completely removed Spark 2.8.3, deleted appdata and all logs.
Updated Openfire to version 4.2.3> 4.2.4> 4.3.2> 4.4.0
I installed Spark online and connected to different versions of Java 8, up to 1.8.0.212.
I tried to install Windows 10 1803 1809 1903, but this also does not solve the problem.
I thought the problem was in stream Openfire and I disconnected it to the server, but that didn’t help either. (stream.management.active false)
BUT! No advice helped me to overcome this problem. Only the transition to Windows 7 or the transition to the version of Spark 2.6.3, but it is old and does not support the simultaneous authorization of PLAIN and SSO.I will be happy if anyone can implement these fixes in Spark 2.6.3 PLAIN +SSO [SPARK-1747] - Ignite Realtime Jira and and give me exe file…
Tonight I will change the default value.
And in the logs I see it periodically, what can it be?
Do I need to install the Avatar Resizer plugin?
2019.07.31 12:53:01 org.jivesoftware.openfire.vcard.PhotoResizer - Failed to resize avatar. An unexpected exception occurred while writing the resized image.
javax.imageio.IIOException: Invalid argument to native writeImage
at com.sun.imageio.plugins.jpeg.JPEGImageWriter.writeImage(Native Method) ~[?:1.8.0_212]
at com.sun.imageio.plugins.jpeg.JPEGImageWriter.writeOnThread(JPEGImageWriter.java:1067) ~[?:1.8.0_212]
at com.sun.imageio.plugins.jpeg.JPEGImageWriter.write(JPEGImageWriter.java:363) ~[?:1.8.0_212]
at javax.imageio.ImageWriter.write(ImageWriter.java:615) ~[?:1.8.0_212]
at org.jivesoftware.openfire.vcard.PhotoResizer.cropAndShrink(PhotoResizer.java:155) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.vcard.PhotoResizer.resizeAvatar(PhotoResizer.java:80) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.ldap.LdapVCardProvider.loadVCard(LdapVCardProvider.java:262) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.vcard.VCardManager.getOrLoadVCard(VCardManager.java:247) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.vcard.VCardManager.getVCard(VCardManager.java:240) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.handler.IQvCardHandler.handleIQ(IQvCardHandler.java:136) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.handler.IQHandler.process(IQHandler.java:62) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.IQRouter.handle(IQRouter.java:369) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.IQRouter.route(IQRouter.java:112) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:74) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.StanzaHandler.processIQ(StanzaHandler.java:360) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.ClientStanzaHandler.processIQ(ClientStanzaHandler.java:95) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:314) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:201) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.nio.ConnectionHandler.messageReceived(ConnectionHandler.java:183) [xmppserver-4.4.0.jar:4.4.0]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$TailFilter.messageReceived(DefaultIoFilterChain.java:1015) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:122) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.codec.ProtocolCodecFilter$ProtocolDecoderOutputImpl.flush(ProtocolCodecFilter.java:413) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:257) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.IoFilterEvent.fire(IoFilterEvent.java:106) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.session.IoEvent.run(IoEvent.java:89) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTask(OrderedThreadPoolExecutor.java:766) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTasks(OrderedThreadPoolExecutor.java:758) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.run(OrderedThreadPoolExecutor.java:697) [mina-core-2.1.3.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
My bad, the problem with Spark 2.8.3 freezing on laptops remained even after changing the Openfire server to 4.4.0 (ubuntu 18.04LTS server (+ latest updates) Openfire 4.4.0 + openjdk 11.0.4 + Mysql 8.0.17 + mysql-connector- java_8.0.17.)…
Whoever encounters such a problem, I wrote a PowerShell script to restart Spark when it freezes or when it cannot be opened and it can be seen that it consumes a lot of memory(>250mb), cycle timer 5 min.
In continuation of the topic of freezing:
I noticed that Spark on laptops freezes if it consumes more than 280 MB.
But at the same time, this person does not correspond with anyone, I think Spark has a memory leak …