I set user.usePlainPassword to true Yet only encrypted accounts can login

After setting user.usePlainPassword users are added with plain text passwords in plainPassword, and encryptedPassword is set to NULL. Trying to login with these accounts results in wrong password. The encrypted admin account can still login.

Is there something else I need to configure in order to login with credentials read from plainPassword?