Secondary color somtimes only effects the primary color

For some reason the secondary color will sometimes only effect the primary color when on the canvas. At first I thought it was a issue of using the color on 0 alpha but it would also do it with 255 alpha
eraser