Spark Crashes overnight

I have been using spark for quite a few years now and ever since I upgraded from 2.7.X to 2.8.2 my spark has been crashing almost every night when I am away from my computer. When I come in in the morning my CPU is either sitting at 30% utilization for the spark executable which is unresponsive or it has a windows debug screen. I tried uninstalling it and reinstalling an older version and that didn’t fix anything. I also just yesterday uninstalled and installed 2.8.3. I have never had an issue before this upgrade and I am not sure how to troubleshoot this. The only similar issues I have seen via a goolgle search and a forum search are 5-9 years old.

Faulting application name: Spark.exe, version: 2.8.3.960, time stamp: 0x57b30ef4

Faulting module name: jvm.dll, version: 25.71.0.1, time stamp: 0x584f6441

Exception code: 0xc0000005

Fault offset: 0x000e7d88

Faulting process id: 0x4dfc

Faulting application start time: 0x01d282ecb1e2fca7

Faulting application path: C:\PROGRA~2\Spark\Spark.exe

Faulting module path: c:\program files (x86)\spark\jre\bin\client\jvm.dll

Report Id: ee44303f-8ed5-4cf1-91d7-9fe1fec87116

Faulting package full name:

Faulting package-relative application ID:

What operating system? Is you PC going to sleep/hibernate during the night? You can also check Spark logs here C:\Users\User\AppData\Roaming\Spark\logs

I am on Windows 10 64bit. The PC does not sleep or hibernate at night, it is set to turn off the monitors only after inactivity.

The spark logs have no entries in them for the last few weeks but the last crash was last night. There are files called report.wer in the programdata folder with data about the crashes if that helps. I downloaded Nirsoft AppCrashView and I can see all of the crashes dating back to 12/6 shortly after I installed 2.8.2 and nothing before that. (the history goes back to when I received the laptop early last year)

I can’t say if that will be helpful, but sure, you can attach those crash dump files here.

It looks like they are just text files with more information about the crash.

Any other troubleshooting steps or information gathering I can do?

Here is what last nights crash file looks like:

Version=1

EventType=APPCRASH

EventTime=131311625927431038

ReportType=2

Consent=1

UploadTime=131311625929576782

ReportIdentifier=9f86e01f-ef2d-11e6-b9a4-00dbdf5e3cb4

IntegratorReportIdentifier=ee44303f-8ed5-4cf1-91d7-9fe1fec87116

WOW64=1

NsAppName=Spark.exe

Response.BucketId=d744d3a2425abf17640b5a44662fc439

Response.BucketTable=1

Response.LegacyBucketId=108733824758

Response.type=4

Sig[0].Name=Application Name

Sig[0].Value=Spark.exe

Sig[1].Name=Application Version

Sig[1].Value=2.8.3.960

Sig[2].Name=Application Timestamp

Sig[2].Value=57b30ef4

Sig[3].Name=Fault Module Name

Sig[3].Value=jvm.dll

Sig[4].Name=Fault Module Version

Sig[4].Value=25.71.0.1

Sig[5].Name=Fault Module Timestamp

Sig[5].Value=584f6441

Sig[6].Name=Exception Code

Sig[6].Value=c0000005

Sig[7].Name=Exception Offset

Sig[7].Value=000e7d88

DynamicSig[1].Name=OS Version

DynamicSig[1].Value=10.0.10586.2.0.0.256.48

DynamicSig[2].Name=Locale ID

DynamicSig[2].Value=1033

DynamicSig[22].Name=Additional Information 1

DynamicSig[22].Value=843e

DynamicSig[23].Name=Additional Information 2

DynamicSig[23].Value=843e3f9a6ac3cc1f3b91e1589db5fd03

DynamicSig[24].Name=Additional Information 3

DynamicSig[24].Value=b6ce

DynamicSig[25].Name=Additional Information 4

DynamicSig[25].Value=b6ce83fec8e4742e535bc6831118c891

UI[2]=C:\PROGRA~2\Spark\Spark.exe

UI[3]=Spark has stopped working

UI[4]=Windows can check online for a solution to the problem.

UI[5]=Check online for a solution and close the program

UI[6]=Check online for a solution later and close the program

UI[7]=Close the program

LoadedModule[0]=C:\PROGRA~2\Spark\Spark.exe

LoadedModule[1]=C:\Windows\SYSTEM32\ntdll.dll

LoadedModule[2]=C:\Windows\SYSTEM32\KERNEL32.DLL

LoadedModule[3]=C:\Windows\SYSTEM32\KERNELBASE.dll

LoadedModule[4]=C:\Windows\SYSTEM32\USER32.dll

LoadedModule[5]=C:\Windows\SYSTEM32\GDI32.dll

LoadedModule[6]=C:\Windows\SYSTEM32\ADVAPI32.dll

LoadedModule[7]=C:\Windows\SYSTEM32\msvcrt.dll

LoadedModule[8]=C:\Windows\SYSTEM32\sechost.dll

LoadedModule[9]=C:\Windows\SYSTEM32\RPCRT4.dll

LoadedModule[10]=C:\Windows\SYSTEM32\SspiCli.dll

LoadedModule[11]=C:\Windows\SYSTEM32\CRYPTBASE.dll

LoadedModule[12]=C:\Windows\SYSTEM32\bcryptPrimitives.dll

LoadedModule[13]=C:\Windows\SYSTEM32\IMM32.DLL

LoadedModule[14]=C:\Windows\WinSxS\x86_microsoft.windows.common-controls_6595b64 144ccf1df_6.0.10586.0_none_d3c2e4e965da4528\comctl32.dll

LoadedModule[15]=C:\Windows\SYSTEM32\combase.dll

LoadedModule[16]=C:\Windows\system32\apphelp.dll

LoadedModule[17]=c:\program files (x86)\spark\jre\bin\client\jvm.dll

LoadedModule[18]=C:\Windows\SYSTEM32\PSAPI.DLL

LoadedModule[19]=C:\Windows\SYSTEM32\VERSION.dll

LoadedModule[20]=C:\Windows\SYSTEM32\MSVCR100.dll

LoadedModule[21]=C:\Windows\SYSTEM32\WINMM.dll

LoadedModule[22]=C:\Windows\SYSTEM32\WSOCK32.dll

LoadedModule[23]=C:\Windows\SYSTEM32\WS2_32.dll

LoadedModule[24]=C:\Windows\SYSTEM32\WINMMBASE.dll

LoadedModule[25]=C:\Windows\SYSTEM32\cfgmgr32.dll

LoadedModule[26]=c:\program files (x86)\spark\jre\bin\verify.dll

LoadedModule[27]=c:\program files (x86)\spark\jre\bin\java.dll

LoadedModule[28]=c:\program files (x86)\spark\jre\bin\zip.dll

LoadedModule[29]=C:\Windows\SYSTEM32\SHELL32.dll

LoadedModule[30]=C:\Windows\SYSTEM32\windows.storage.dll

LoadedModule[31]=C:\Windows\SYSTEM32\shlwapi.dll

LoadedModule[32]=C:\Windows\SYSTEM32\kernel.appcore.dll

LoadedModule[33]=C:\Windows\SYSTEM32\shcore.dll

LoadedModule[34]=C:\Windows\SYSTEM32\powrprof.dll

LoadedModule[35]=C:\Windows\SYSTEM32\profapi.dll

LoadedModule[36]=C:\Program Files (x86)\Spark.install4j\i4jinst.dll

LoadedModule[37]=C:\Windows\SYSTEM32\OLEAUT32.dll

LoadedModule[38]=C:\Windows\SYSTEM32\ole32.dll

LoadedModule[39]=C:\Program Files (x86)\Spark\jre\bin\management.dll

LoadedModule[40]=C:\Program Files (x86)\Spark\jre\bin\awt.dll

LoadedModule[41]=C:\Windows\system32\uxtheme.dll

LoadedModule[42]=C:\Windows\SYSTEM32\MSCTF.dll

LoadedModule[43]=C:\Windows\system32\dwmapi.dll

LoadedModule[44]=C:\Program Files (x86)\Spark\jre\bin\fontmanager.dll

LoadedModule[45]=C:\Windows\system32\opengl32.dll

LoadedModule[46]=C:\Windows\SYSTEM32\DDRAW.dll

LoadedModule[47]=C:\Windows\SYSTEM32\GLU32.dll

LoadedModule[48]=C:\Windows\SYSTEM32\DCIMAN32.dll

LoadedModule[49]=C:\Program Files (x86)\Spark\jre\bin\net.dll

LoadedModule[50]=C:\Windows\system32\mswsock.dll

LoadedModule[51]=C:\Program Files (x86)\Spark\jre\bin\nio.dll

LoadedModule[52]=C:\Program Files (x86)\Spark\jre\bin\t2k.dll

LoadedModule[53]=C:\Program Files (x86)\Spark\jre\bin\sunec.dll

LoadedModule[54]=C:\Windows\SYSTEM32\IPHLPAPI.DLL

LoadedModule[55]=C:\Windows\SYSTEM32\NSI.dll

LoadedModule[56]=C:\Windows\SYSTEM32\dhcpcsvc6.DLL

LoadedModule[57]=C:\Windows\SYSTEM32\dhcpcsvc.DLL

LoadedModule[58]=C:\Windows\SYSTEM32\clbcatq.dll

LoadedModule[59]=C:\Windows\SYSTEM32\WindowsCodecs.dll

LoadedModule[60]=C:\Windows\system32\dataexchange.dll

LoadedModule[61]=C:\Windows\system32\dcomp.dll

LoadedModule[62]=C:\Windows\system32\d3d11.dll

LoadedModule[63]=C:\Windows\system32\dxgi.dll

LoadedModule[64]=C:\Windows\system32\twinapi.appcore.dll

LoadedModule[65]=C:\Windows\system32\bcrypt.dll

LoadedModule[66]=C:\Windows\SYSTEM32\CRYPTSP.dll

LoadedModule[67]=C:\Windows\system32\rsaenh.dll

LoadedModule[68]=C:\Windows\SYSTEM32\USERENV.dll

LoadedModule[69]=C:\Windows\SYSTEM32\DNSAPI.dll

LoadedModule[70]=C:\Windows\System32\rasadhlp.dll

LoadedModule[71]=C:\Windows\System32\fwpuclnt.dll

LoadedModule[72]=C:\Program Files (x86)\Spark\jre\bin\sunmscapi.dll

LoadedModule[73]=C:\Windows\SYSTEM32\CRYPT32.dll

LoadedModule[74]=C:\Windows\SYSTEM32\MSASN1.dll

LoadedModule[75]=C:\Program Files (x86)\Spark\lib\windows\jnopus.dll

LoadedModule[76]=C:\Program Files (x86)\Spark\lib\windows\jnspeex.dll

LoadedModule[77]=C:\Program Files (x86)\Spark\lib\windows\jnffmpeg.dll

LoadedModule[78]=C:\Program Files (x86)\Spark\lib\windows\jnwasapi.dll

LoadedModule[79]=C:\Windows\SYSTEM32\msdmo.dll

LoadedModule[80]=C:\Windows\SYSTEM32\propsys.dll

LoadedModule[81]=C:\Windows\System32\MMDevApi.dll

LoadedModule[82]=C:\Windows\System32\DEVOBJ.dll

LoadedModule[83]=C:\Windows\SYSTEM32\mfwmaaec.dll

LoadedModule[84]=C:\Windows\SYSTEM32\mfperfhelper.dll

LoadedModule[85]=C:\Windows\SYSTEM32\AUDIOSES.DLL

LoadedModule[86]=C:\Windows\SYSTEM32\wintypes.dll

LoadedModule[87]=C:\Program Files (x86)\Spark\lib\windows\jnportaudio.dll

LoadedModule[88]=C:\Windows\SYSTEM32\setupapi.dll

LoadedModule[89]=C:\Windows\SYSTEM32\dsound.dll

LoadedModule[90]=C:\Windows\SYSTEM32\WINTRUST.dll

LoadedModule[91]=C:\Windows\SYSTEM32\wdmaud.drv

LoadedModule[92]=C:\Windows\SYSTEM32\AVRT.dll

LoadedModule[93]=C:\Windows\SYSTEM32\ksuser.dll

LoadedModule[94]=C:\Windows\SYSTEM32\msacm32.drv

LoadedModule[95]=C:\Windows\SYSTEM32\MSACM32.dll

LoadedModule[96]=C:\Windows\SYSTEM32\midimap.dll

LoadedModule[97]=C:\Program Files (x86)\Spark\lib\windows\jndirectshow.dll

LoadedModule[98]=C:\Windows\SYSTEM32\devenum.dll

LoadedModule[99]=C:\Windows\SYSTEM32\ntmarta.dll

LoadedModule[100]=C:\Windows\SYSTEM32\ksproxy.ax

LoadedModule[101]=C:\Windows\SYSTEM32\d3d9.dll

LoadedModule[102]=C:\Windows\SYSTEM32\policymanager.dll

LoadedModule[103]=C:\Windows\SYSTEM32\msvcp110_win.dll

LoadedModule[104]=C:\Windows\SYSTEM32\vidcap.ax

LoadedModule[105]=C:\Windows\SYSTEM32\kswdmcap.ax

LoadedModule[106]=C:\Windows\SYSTEM32\MFC42.dll

LoadedModule[107]=C:\Windows\SYSTEM32\ODBC32.dll

LoadedModule[108]=C:\Windows\SYSTEM32\DPAPI.dll

LoadedModule[109]=C:\Windows\SYSTEM32\quartz.dll

LoadedModule[110]=C:\Windows\SYSTEM32\qcap.dll

LoadedModule[111]=C:\Windows\SYSTEM32\MSVFW32.dll

LoadedModule[112]=C:\Windows\SYSTEM32\qedit.dll

LoadedModule[113]=C:\Windows\SYSTEM32\COMDLG32.dll

LoadedModule[114]=C:\Windows\SYSTEM32\FirewallAPI.dll

LoadedModule[115]=C:\Windows\SYSTEM32\NETAPI32.dll

LoadedModule[116]=C:\Windows\SYSTEM32\DAVHLPR.DLL

LoadedModule[117]=C:\Windows\WinSxS\x86_microsoft.windows.gdiplus_6595b64144ccf1 df_1.1.10586.0_none_538a540779726150\gdiplus.dll

LoadedModule[118]=C:\Windows\SYSTEM32\fwbase.dll

LoadedModule[119]=C:\Program Files (x86)\Spark\lib\windows\jnawtrenderer.dll

LoadedModule[120]=c:\program files (x86)\spark\jre\bin\jawt.dll

LoadedModule[121]=C:\Windows\SYSTEM32\mscms.dll

LoadedModule[122]=C:\Windows\SYSTEM32\icm32.dll

LoadedModule[123]=C:\Users\rwilliams\AppData\Local\Temp\jna–1056826878\jna69361 95826078955390.dll

LoadedModule[124]=C:\Users\rwilliams\AppData\Roaming\Spark\plugins\flashing\lib\ FlashWindow.dll

LoadedModule[125]=C:\Windows\SYSTEM32\Wtsapi32.dll

LoadedModule[126]=C:\Windows\SYSTEM32\WINSTA.dll

LoadedModule[127]=C:\Program Files (x86)\Spark\jre\bin\dcpr.dll

LoadedModule[128]=C:\Program Files (x86)\Common Files\microsoft shared\ink\tiptsf.dll

LoadedModule[129]=C:\Program Files (x86)\Spark\jre\bin\jsound.dll

LoadedModule[130]=C:\Program Files (x86)\Spark\jre\bin\jsoundds.dll

State[0].Key=Transport.DoneStage1

State[0].Value=1

FriendlyEventName=Stopped working

ConsentKey=APPCRASH

AppName=Spark

AppPath=C:\PROGRA~2\Spark\Spark.exe

NsPartner=windows

NsGroup=windows8

ApplicationIdentity=50EDDAD0888D57BEDA10297D8379D8F1

Yeah, not much info here. In Java world there is such a thing as Heap Dump taking of a faulty or crashing app. I don’t know much about it, but you can try say this app VisualVM: Download Run it before leaving work and in the morning right click Spark process in there and take the Heap Dump (maybe also Thread Dump) when Spark is already hanging and attach them here. Those dumps should show what exception occurred in JVM. There is also an option “Generate Heap Dump on OOME”. OOME means out of memory exception. You can also try this at some point. I think this will generate dump automatically once OOME occurs. My guess is that there is a memory leak somewhere in the Spark 2.8 code (or maybe Smack code, library Spark is based upon) and JVM eventually runs out of memory and crashes. As i’m not a developer, i won’t be able to read those dumps myself though. But maybe someone else will take a look at them later.

I have filed a ticket to track this [SPARK-1879] Spark hangs and crashes after a prolonged run - IgniteRealtime JIRA

i have not seen this issue. Are you running any antivirus scans or vulnerability scans or anything else going on at night that could be related?

I downloaded the application and Spark is the only Java app on my pc that does not have the option to run a heap or thread dump. Right clicking on the app only gives Open, Sample, Application snapshot and properties.

It crashed again this morning so I added the spark directory to the exclude list for my AV. I will let you know.

I don’t think it is an AV problem because we have about 40 spark users that all use the same AV with the same policies applied and I am the only one with the issue.

Try running VisualVM via Run as administrator and then launch Spark. It looks like it needs some special permissions for TMP folder on Windows 10.

I had already tried that with no change in behavior.Spark is there it just doesn’t have those options like I get with other Java apps.

Strange. Works for me (in a VM with the latest Windows 10 Insider build). There are some other apps or ways to get a heap dump which may work with Windows 10 probably.