In spark 3.x there is a file being created in C:\Users*\AppData\Local\Temp in a folder called jna-* and there is a jna*.dll that is being created inside that folder. Our security policy is blocking anything that runs from the user profile. I have tried changing where the TEMP and TMP environment variables are set upon the launch of spark so they can be redirected elsewhere but that also has lead to no success. Does anyone have an idea of how I can change where that JNA is being created/read at so my spark will launch properly?
I have figured out how to redirect where the dll would be loaded with the -Djava.io.tmpdir="Z:/your/path/here. However I am still running into the same issue, and I am wondering if there is a way to either stop the .jar from unpacking or if it is possible to force the JNA to load the native library without having to place a .dll into a temp directory. Any advice would be helpful!