That's the intended behaviour of the Overlays window. It was this way originally, then in one version it was changed so that it stayed on top like the other windows, but we had complaints from a number of users and so we reverted to the window behaviour that you see now.
