Color Palette deleting color issue

I would like some help with my project.

I want to remove the colors I am not using like the green but whenever I remove unused colors or move any the art changes colors on its own for some reason. Is there a way to lock the palette and remove all the unused colors without seeing my progress lost?

click on the remap palette button, in indexed mode each pixel is assined a positions from the palette, when you delete a color, their positions change, thats why all colors change
thats why the remap palette button is there.