Skip to content

Support Modules

cjgabrie edited this page Feb 28, 2022 · 12 revisions

Inter-Rater Module

Allows user to make comparisons and visualizations of behavior annotations from multiple users using an averaged-rater projection or a chosen rater as a reference; includes useful visualizations and the ability to output a report of errors between each user and the reference dataset.

Usage

Validation Module

Allows user to choose a batch of BehDEPOT-analyzed files (with associated hBehavior files) and quickly generate performance statistics and visualizations for each video and average statistics for the entire set.

Usage

  • Can run in single or batch mode based on the input provided to it
  • When run, prompts user to select:
  • SINGLE: a directory containing 1 BehaviorDEPOT output folder and 1 associated hB file.
  • BATCH: a directory containing other directories in the format for single mode described above.

Classifier Optimization Module

Allows user to choose a behavior classifier, 1-2 classifier parameters (i.e. thresholds), a range of test values, and a human annotation file to quickly examine effects of chosen values on classifier performance (reporting F1 score and ROC-based AUC values for range of tested parameters)

Usage

Data Exploration Module

Allows user to choose 1 or 2 metrics from a BehDEPOT-analyzed file and an associated hBehavior file to sort data by chosen behavior and generates a report comparing the behavior subset to the complete dataset based on the selected Metrics.

Usage

Clone this wiki locally