Well I did something stupid in the last update (0.5.1).
I actually initialized my stuff in the OnPlayerActivated Event that gets called after every Loadingscreen and didn't unregister it after the first usage. And in return bugged stuff out badly by fixing what wasn't broken. I'll revert what I did - then everything should be fine again!