I am using Meta VNC from Windows to connect to a vncserver on Ubuntu, with windowmonitor running.
When I close a window, the icon stays when I press alt+tab. I have to close MetaVNC get rid of them.
Naturally this gets annoying when you open and close a lot of windows...
