[2.6.3 Mac] Can't close inactive chat windows

Whenever I initiate a message window with someone or if someone sends a message to me, after closing the window (either using the two circled methods in the first image), the conversation goes away within the main chat window, but the chat window itself stays there indefinitely (and looks like the second image) until I restart the application.