Add start/end date selectors for experiment filtering

[EZoni]

Overview

Add a date range selector (including single dates) using the VDateInput component to filter the experiment data points used for visualization and ML training.

To do

• Replace VTextField with VDateInput for date range selection (full range at once, one state variable).
• Use date information to filter database query in the dashboard code base.
• Use date information to filter database query in the ML training code base.
• Test ML training locally.

Notes

See related discussion Kitware/trame#846.

[RemiLehe]

Thanks!
Btw, could you also modify train_model.py to make sure that it applies the date selection to the training data? I think that the way to do this would be to add the dates (with some standardized convention) in the YAML file that the dashboard sends to the training job at NERSC.

[Copilot]

Pull request overview

This PR adds date range filtering functionality for experiments in the dashboard. Users can select a start and end date to filter experiment data displayed in the dashboard.

Changes:

• Added a VDateInput component to the dashboard toolbar for date range selection
• Implemented date filtering logic in the database query for experiment data
• Configured state management to track the selected date range and trigger updates

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File	Description
dashboard/state_manager.py	Added experiment_date_range state variable and enabled Vuetify Labs components
dashboard/app.py	Added VDateInput component to toolbar and updated state change handler to respond to date range changes
dashboard/utils.py	Implemented date filtering logic in load_data() to filter database queries based on selected date range

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[EZoni]

This should add to the configuration file a new section that reads, e.g.,

date_filter:
  date:
    $gte: 2024-03-28 00:00:00
    $lte: 2024-03-28 23:59:59.999000

[EZoni]

This change mimics the new lines 111-113 in dashboard/utils.py:

-    exp_data = pd.DataFrame(db[state.experiment].find({"experiment_flag": 1}))
+    exp_data = pd.DataFrame(
+        db[state.experiment].find({"experiment_flag": 1, **date_filter})
+    )

[EZoni]

@RemiLehe

I think this PR is ready for review.

[RemiLehe]

Could we modify this so that, if there is no dates in the config.yaml file, it simply ignores the date selection? e.g. config_dict.get( 'date_filter', {} )

[RemiLehe]

If the config.yaml file contains a section

date_filter:
  date:
    $gte: 2024-03-28 00:00:00
    $lte: 2024-03-28 23:59:59.999000

will experiment_date_range be initialized with these values in the dashboad?