Oh, so THAT’S what’s happening. I made a bug report for the same thing here: Gradient Tool acting weird after quick selection wand across different layers
Yeah it’s really annoying, I actually couldn’t finish an animation because of it once. Good to know there is a workaround at least.