5~10 second lag spike after login or reload

[Saxayone]

Addon Version

v0.3.47

World of Warcraft Version

Retail

Describe the bug

Any time I finish a loading screen via reload/relog with only BetterBags enabled causes me to have a 5~10 second lag spike.
Tested on multiple characters with no other addons enabled.
No addons and enabling all other addons except BetterBags also causes no spike.
Tested with AddonProfiler+BetterBags+Bugsack and this was the results of just one reload:

Steps to reproduce

Enable only BetterBags and /reload.

[Bauxite]

Can you check how many categories exist? Categories are statically loaded once created, disabling the addon that put them there in the first place doesn't remove them. Having a huge number of categories can cause lag spikes, ref #745