With disable all addons I mean also the libraries, which are basically addons as well
And libraries alone won't be loaded if there is no addon which uses it, so they shouldn't lag the game.
Just disable ALL in the addon manager (you can use Circonians Addon Selector which provides a keybind to select/unselect all).