i came across this after posting an addon request... i recently added "Disable Controller UI" to esoui. It's not a great solution but if you're just using the pad so you can chill a bit and pick up the kb+m when required then it works fine (although I wouldn't recommend it for a full 'console-like' experience).
May gamepad addon support improve as time goes on
