Skip to content

Benchmark performance overhead of spy #3541

@olevski

Description

@olevski

We should have an idea of how much overhead using something like spy represents.

For this purpose I propose two tests:

  1. Overhead for an optimized script/command @Panaetius mentions he has something in Rust for reading many files at once
  2. Overhead for a python ML model. Here it would be nice to test out training an image classification model. We can either get a simple one from the academic team or find one online. For example the CIFAR-10 dataset is ~200MB and can be easily fed into some reference image recognition CNN.

The goal is to compare the increase in execution time from running with spy relative to running without it.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions