When holding a certain directional key, the redstone compass reajusts as a direction is changed via mouse. However, when this action is repeated, the direction it considers to be what I shall call "True Up" changes. Therefore, compasses are effectively useless...
Compasses point towards your world spawn, not north.