Pixels shift when using reference layer

Hi,
I have just encounter strange bug.
When reference layer is enabled, and you turn on and off this layer some pixels are shifting position.
This happens on certain zoom level. And sometimes when painting.
You can see it on attached gif (animation).