Spark freeze after 5 hour Windows 10

Spark Spark Support
1

Hi.
More than a year we suffer from the problem of hanging up Spark on laptops.
Watching this problem, I realized that Spark freezes exactly 5 hours after its opening.
Because we have people come at 8:00 and Spark hangs up at 13:00, if a person comes at 10:00, then he hangs at exactly 15:00.

Which laptops have a problem? all, HP DELL ASUS Lenovo, no difference.

Installed a clean Windows 10, completely removed Spark 2.8.3, deleted appdata and all logs.

Updated Openfire to version 4.2.3> 4.2.4> 4.3.2> 4.4.0

I installed Spark online and connected to different versions of Java 8, up to 1.8.0.212.

I tried to install Windows 10 1803 1809 1903, but this also does not solve the problem.

I thought the problem was in stream Openfire and I disconnected it to the server, but that didn’t help either. (stream.management.active false)

BUT! No advice helped me to overcome this problem. Only the transition to Windows 7 or the transition to the version of Spark 2.6.3, but it is old and does not support the simultaneous authorization of PLAIN and SSO.I will be happy if anyone can implement these fixes in Spark 2.6.3 PLAIN +SSO [SPARK-1747] - Ignite Realtime Jira and and give me exe file…

Please community, tell me a solution …

2

maybe there is a reason for a non-standard cache? My colleagues changed it a long time ago.
Usually we have 200 users online.

local
local1920×1668 285 KB

3

Have you tried changing it back to defaults?

4

Tonight I will change the default value.
And in the logs I see it periodically, what can it be?
Do I need to install the Avatar Resizer plugin?

2019.07.31 12:53:01 org.jivesoftware.openfire.vcard.PhotoResizer - Failed to resize avatar. An unexpected exception occurred while writing the resized image.
javax.imageio.IIOException: Invalid argument to native writeImage
at com.sun.imageio.plugins.jpeg.JPEGImageWriter.writeImage(Native Method) ~[?:1.8.0_212]
at com.sun.imageio.plugins.jpeg.JPEGImageWriter.writeOnThread(JPEGImageWriter.java:1067) ~[?:1.8.0_212]
at com.sun.imageio.plugins.jpeg.JPEGImageWriter.write(JPEGImageWriter.java:363) ~[?:1.8.0_212]
at javax.imageio.ImageWriter.write(ImageWriter.java:615) ~[?:1.8.0_212]
at org.jivesoftware.openfire.vcard.PhotoResizer.cropAndShrink(PhotoResizer.java:155) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.vcard.PhotoResizer.resizeAvatar(PhotoResizer.java:80) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.ldap.LdapVCardProvider.loadVCard(LdapVCardProvider.java:262) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.vcard.VCardManager.getOrLoadVCard(VCardManager.java:247) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.vcard.VCardManager.getVCard(VCardManager.java:240) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.handler.IQvCardHandler.handleIQ(IQvCardHandler.java:136) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.handler.IQHandler.process(IQHandler.java:62) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.IQRouter.handle(IQRouter.java:369) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.IQRouter.route(IQRouter.java:112) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:74) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.StanzaHandler.processIQ(StanzaHandler.java:360) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.ClientStanzaHandler.processIQ(ClientStanzaHandler.java:95) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:314) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.net.StanzaHandler.process(StanzaHandler.java:201) [xmppserver-4.4.0.jar:4.4.0]
at org.jivesoftware.openfire.nio.ConnectionHandler.messageReceived(ConnectionHandler.java:183) [xmppserver-4.4.0.jar:4.4.0]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$TailFilter.messageReceived(DefaultIoFilterChain.java:1015) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.IoFilterAdapter.messageReceived(IoFilterAdapter.java:122) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.codec.ProtocolCodecFilter$ProtocolDecoderOutputImpl.flush(ProtocolCodecFilter.java:413) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.codec.ProtocolCodecFilter.messageReceived(ProtocolCodecFilter.java:257) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.callNextMessageReceived(DefaultIoFilterChain.java:650) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain.access$1300(DefaultIoFilterChain.java:49) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.DefaultIoFilterChain$EntryImpl$1.messageReceived(DefaultIoFilterChain.java:1128) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.filterchain.IoFilterEvent.fire(IoFilterEvent.java:106) [mina-core-2.1.3.jar:?]
at org.apache.mina.core.session.IoEvent.run(IoEvent.java:89) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTask(OrderedThreadPoolExecutor.java:766) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.runTasks(OrderedThreadPoolExecutor.java:758) [mina-core-2.1.3.jar:?]
at org.apache.mina.filter.executor.OrderedThreadPoolExecutor$Worker.run(OrderedThreadPoolExecutor.java:697) [mina-core-2.1.3.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]

5

I don’t know what this error means. Suggest posting it as a separate post, so it would get more views.

6

after reset cache I encountered a problem that in Spark Vcard is not displayed.Restored openfire.

Probably try to install another clean Openfire server and connect it as the main one.
I will write how to do it.

7

wroot, I installed the new ubuntu 18.04LTS server (+ latest updates) Openfire 4.4.0+openjdk 11.0.4+Mysql 8.0.17 + mysql-connector-java_8.0.17.

No more freezes, perfect.

1 Like
8

My bad, the problem with Spark 2.8.3 freezing on laptops remained even after changing the Openfire server to 4.4.0 (ubuntu 18.04LTS server (+ latest updates) Openfire 4.4.0 + openjdk 11.0.4 + Mysql 8.0.17 + mysql-connector- java_8.0.17.)…

9

Whoever encounters such a problem, I wrote a PowerShell script to restart Spark when it freezes or when it cannot be opened and it can be seen that it consumes a lot of memory(>250mb), cycle timer 5 min.

while($true){
if((get-process Spark).Responding){
$proc = (Get-Process Spark -ea 0)| where {$_.ws/1024 -gt “250000”}
if ($proc)
{
Stop-Process -id $proc.id
Start-Process “C:\Program Files (x86)\Spark\Spark.exe”;
}
sleep(300)
}else{
Stop-Process -processname Spark;
Start-Process “C:\Program Files (x86)\Spark\Spark.exe”;
sleep(300);
}
}

1 Like
10

In continuation of the topic of freezing:
I noticed that Spark on laptops freezes if it consumes more than 280 MB.
But at the same time, this person does not correspond with anyone, I think Spark has a memory leak …

Screenshot_210
Screenshot_2101011×953 41.5 KB

11

I think Spark has a lot of memory leaks and you stumbled just on one of them…

13

I managed to solve the problem without a script, I need to disable Spark.exe antivirus scan…
Kaspersky Endpoint Security 11…

2 Likes