What you're seeing was the behaviour prior to 1.5. When we switched to 1.5 I changed the Overlay window to stay in front (just like the other windows), but a bunch of people complained and so I reverted that change for 1.6. Maybe there is a better way for me to do this.... we could put a pin button on every window I guess, but that might be overkill.