Create a validate-config goal to check the appmap configuration file. The same way the maven plugin does it. @ptrdvrk