At the moment the object pointer can only have validity rules based on the gameobject being collided with or the point at where the pointer cursor is.
It would be more powerful if a target validation could be done on anything included in the hit raycast