Changing colors resizes the layer boundaries, edges

[Dominus]

I have the need for several layers having different layer boundaries but changing the color of a pixel in a layer (replace, pencil, bucket…) resets the layer boundaries to the visible part of the layer.

[Dominus]

I should maybe add a screenshot

S this is the layer boundary (blue outline) to begin with:

And this is after I made a single pencil dot: