Controller Mode Bug with FancyActionBar

[Rakusai]

Maybe someone can help me.

I have an issue with controller mode, if I switch from controller to mouse or from mouse to controller.
The action bar jumps to the middle of the screen, it's easily fixed if I enter a menu like map or inventory.
But it's still annoying.

I traced it down to this list of addons:
-Addon Selector (Not important for the problem, but just to give you a full list)

-FancyActionBar (ofc)
-Bandits User Interface
-Info Panel (Same author as Bandits User Interface)
-BeamMeUp - Teleporter

Their Libs
-LibAddonMenu-2.0
-LibCustomMenu
-LibDialog
-LibScrollableMenu
-LibZone

If I disable Bandits User Interface or FancyActionBar, it works just fine.
If I disable Info Panel AND BeamMeUp - Teleporter, it works fine as well.

That means my only options are to disable either FancyActionBar OR Bandits User Interface.
Or to disable the Info Panel AND BeamMeUp - Teleporter.

I'm trying my luck, in case someone else knows a fix for all of those mods to work together, I kinda like all of them.