I'm not sure what addon I use is causing it. I suspect Azurah or Votan's minimap. However, neither seem to have related compass settings (that goes for all my addons really)
Best way to track this down is:
Disable all addons and text if this happens even without addons.
Then enable addons one by one, starting with the ones that you suspect to be the culprit.
Try to enable only one addon!
After this start to enable different addons together to check if they interfer if both/multiple are enabled.