Spark 2.5.1 OS X: Incorrect default folder location?

The default location for a user’'s profile with Spark 2.5.1 is in the folder ~/Spark/…

AFAIK the correct location for this folder structure is ~/Library/Application Support/Spark/…

This same issue appears in the Windows client; the folder is

%%ROOTDRIVE%%:\Documents and Settings%%USERNAME%%\Spark

and it should be

%%ROOTDRIVE%%:\Documents and Settings%%USERNAME%%\Application Data\Spark

On Windows this may not be such a heavy issue but Mac users might object to the pollution of their home folder and certain Backup applications will not recognise the Spark folder structure as an application’'s settings needing to be backed up.

Can this be fixed please?

Thanks in advance.

Niall

Hi,

This issue is addressed here: SPARK-743.

As a workaround you can add a system property user.home to your own home directory.

  1. Open the file c:\Program Files\Spark\bin\startup.bat (or .sh for linux)

  2. After java add: -Duser.home=YourPath.

For example:

java -Duser.home=c:\myPrograms\ -Dappdir=… -cp … (etc.)

Let me know if it works properly.

Regards,

Francisco