CI: Remove B320 and B410 bandit skips

They were removed upstream recently, so now Bandit is complaining about
the unknown test.

See PyCQA/bandit#1212

Change-Id: Ie668d49a56c0a6542d28128656cfd44f7c089ec4

Author: tipabu

bandit.yaml

@@ -97,9 +97,7 @@ skips:
   - B603
   - B607
   # We parse xml
-  - B320
   - B405
-  - B410
   - B603
 
 ### (optional) plugin settings - some test plugins require configuration data