components Benchmarking documentation

Benchmarking

Components in this category

---

• benchmark_result_aggregator

  Aggregate quality metrics, performance metrics and all of the metadata from the pipeline. Also add them to the root run.

• compute_performance_metrics

  Performs performance metric post processing using data from a model inference run.

• dataset_downloader

  Downloads the dataset onto blob store.

• dataset_sampler

  Samples a dataset containing JSONL file(s).