While I understand what you're trying to say, you're not thinking it through all the way: addons do all sorts of things far more dangerous (if misused) all of the time. If you had to manually approve everything even more so than that, most addons would have dozens of permissions that need approved and the addon size and development (for many) would end up being more checkboxes than addon.
If you want to remove the library:
- Open an offending addon.
- Open the .txt file.
- Delete the line that references it, such as: Libs/LibCustomTitles/LibCustomTitles.lua