Skip to content

Comparison across experiment runs and hyper parameters #19

@nitish1295

Description

@nitish1295
  1. Offer a way to compare 2 or more different runs of an experiment and show the metrics on on the same graph.
  2. Offer functionalities to filter runs of an experiment on a certain hyper param and show metrics associated with those runs.

A possible way to implement these could be as follows:

  • Over the course of time the number of experiments and runs will increase for a user, or they might have large set of experiments already. We should Offer a tables for experiments, and runs for users to choose from.
  • In the initial stage the filtering based on hyper param can also be done based on the same table.

Implementation:

  • A separate table located under a separate tab to select experiments from(instead of a drop down). The runs corresponding to these experiments show up on the graph page which includes another table, detailed in the next point
  • Make a table component which can enable selection from runs of an experiment/experiments, this component can live just below the graphs and show runs and associated hyper params. A possible example implementation for column freeze so that we can show multiple hyper params for a run https://www.material-react-table.com/docs/guides/column-pinning

Please feel free to add any suggestions

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions