Benchmarks

Jump to bottom

Artem Trofimov edited this page Aug 1, 2022 · 13 revisions

Baselines

Kubeflow
Airflow

Microbenchmark scenarios

Startup latency

Metric: a time interval between user clicks run and the task is started.

The following setups should be covered:

With custom conda env
With custom docker env

End-to-end scenarios

Data transfer latency

Metric: how much time data transfer of 1GB between 2 tasks takes.

Workload: data preparation on CPU + learning on GPU

Utilization

Metric: how