Fast Path Queue

I’m getting ready to deploy fast path in my environment and everything seems to be working smoothly accept for one thing. When a user rejects a chat requet they keep getting asked to accept the chat. If they just let the request time out it moves on to the next user in the queue. Does anyone know how to fix this?