Annotations

What is an Annotation?

An annotation is metadata attached to a reverse-engineered widget. More specifically, an annotation is a tuple consisting of a tree node representing the identified widget in a screenshot, and the associated metadata. Annotations can be used by layers at runtime to tag specific elements with semantic information, or more sophisticatedly they can be used by layers as training data for a classification algorithm.

Annotation Libraries

Annotations are stored in libraries. A library has a unique name (e.g. targets, widget_type, is_text). Layers can access annotations in their generalize_annotations method. See Authoring Layers for more details.