If you are listening on headphones to a single channel, then the pan control will have no effect as the PFL bus (the one routed to when pressing the headphone switches) is mono.
However, if you have nothing ‘PFL’d’ (the PFL LED is off), you will be hearing the stereo main mix, and will then hear the effect of the pan.