Hey I don't know if it helps but if you look at this repo ( https://github.com/linuxdeepin/dde-kwin ) they also have a Round corner effect (at plugins/kwineffects/scissor-window). The strange thing is that their version works fine under Wayland with both monitors but it is hella buggy (any X window under Wayland crashes thes session unlike your plugin). I would still prefer your version by far but maybe you can see something that could is done differently which can cause the error with your plugin....
Hey I don't know if it helps but if you look at this repo ( https://github.com/linuxdeepin/dde-kwin ) they also have a Round corner effect (at plugins/kwineffects/scissor-window). The strange thing is that their version works fine under Wayland with both monitors but it is hella buggy (any X window under Wayland crashes thes session unlike your plugin). I would still prefer your version by far but maybe you can see something that could is done differently which can cause the error with your plug...
Well everything works now on the monitor that is not considered the HDMI monitor by Systemsettings. Restarting Kwin isn't really possible under Wayland but killing the session and restarting didn't help no. Also I'm on Nouveau drivers where under X11 it works fine on both monitors without any issue. I think you are correct with All I can think of is it copies the framebuffer incorrectly in some cases, (right) and if the window geometry is wrong somehow theres very little I can do about that. I thought...
So here's an update: Appearently this is caused by a 2nd monitor. I have one HDMI and one VGA monitor and when I change the monitor layout with the systemsettings tool the error by shapecorners seems to follow the screen where Systemsettings thinks the HDMI monitor is. It works under my HDMI monitor though if I choose the wrong layout (ie swap HDMI and VGA in the systemsettings) but then the VGA monitor has the bug. Under X11 it works perfectly fine with both monitors at any position. See the screenshot...
This bug is caused by this plugin+Wayland. It happens with all window decoration I tried.
Tried it out with a fresh profile and still the error persists. With a bigger radius you can see that those are black squares where the transparent mask is supposed to be.
Doesn't work under Wayland