labeler.yml: Don't apply CI-all-test for west.yml

action-manifest now allows adding CI labels based on which module
was changed.

Signed-off-by: Øyvind Rønningstad <[email protected]>

Author: oyvindronningstad

.github/labeler.yml

@@ -46,7 +46,6 @@
   - "tests/subsys/net/**/*"
 
 "CI-all-test":
-  - "west.yml"
   - "**/*partition_manager*/**/*"
   - "**/*partition_manager*"