It's probably going to become unwieldy this way, with slap-on mechanisms to create exceptions in all sorts of domain-specific situations, see #174.
Maybe this is an unsolvable problem and any software project will always struggle to be generic and configurable, maybe especially in the area of access control DSLs