Why does drawing circles work as it does?

You can observe this behavior because the default way of drawing a circle (or more precisely - an ellipse) actually creates a rectangle selection inside which a circle/ellipse is drawn.

As a side note, you can also draw circles/ellipses (but not only) in an alternate mode where the starting point is the center by holding the CTRL button while holding the mouse button.