run_reports crashes

[TobiasAntiGravity]

Hi

I am sorry for all the posts - but I am stuck on this one, so I am posting in hopes that someone has experienced this and has an answer;

My run_reports always crashes when it comes to the status report. I am running the processes "out of the box" with one exception - I am running mongo on a different machine, and therefore cannot use the bakcup processes. I therefore strongly suspect that this is the cause. I have tried various ways of "deactivating" the backup process, but have not found a way that avoids the crash.

The error message is as follows;

2022-04-19:2133.10 {'type': 'risk_report'}  Sent email subject Risk report
2022-04-19:2133.10 {'type': 'run_reports'}  risk_report executed 1 times so done
2022-04-19:2133.10 {'type': 'run_reports'}  status_report still alive, done 0 of 1 executions every 60 minutes
2022-04-19:2133.10 {'type': 'status_report'}  Running report Status report sysproduction.reporting.status_reporting.system_status email {}
Traceback (most recent call last):
  File "run.py", line 65, in <module>
    func(*args, **kwargs)
  File "/opt/projects/pysystemtrade/sysproduction/run_reports.py", line 15, in run_reports
    price_process.run_process()
  File "/opt/projects/pysystemtrade/syscontrol/run_process.py", line 103, in run_process
    self._main_loop_over_methods()
  File "/opt/projects/pysystemtrade/syscontrol/run_process.py", line 126, in _main_loop_over_methods
    timer_class.check_and_run()
  File "/opt/projects/pysystemtrade/syscontrol/timer_functions.py", line 124, in check_and_run
    self.run_function()
  File "/opt/projects/pysystemtrade/syscontrol/timer_functions.py", line 299, in run_function
    self._function()
  File "/opt/projects/pysystemtrade/sysproduction/run_reports.py", line 45, in run_generic_report
    run_report(self.config, data=self.data)
  File "/opt/projects/pysystemtrade/sysproduction/reporting/reporting_functions.py", line 26, in run_report
    run_report_with_data_blob(report_config, data)
  File "/opt/projects/pysystemtrade/sysproduction/reporting/reporting_functions.py", line 40, in run_report_with_data_blob
    report_results = report_function(data, **report_kwargs)
  File "/opt/projects/pysystemtrade/sysproduction/reporting/status_reporting.py", line 52, in system_status
    formatted_output.append(func())
  File "/opt/projects/pysystemtrade/sysproduction/reporting/api.py", line 313, in table_of_delayed_methods
    method_status = get_control_data_list_for_all_methods_as_df(self.data)
  File "/opt/projects/pysystemtrade/sysproduction/reporting/data/status.py", line 142, in get_control_data_list_for_all_methods_as_df
    pdf = pdf.sort_values("last_start")
  File "/usr/local/lib/python3.8/site-packages/pandas/core/frame.py", line 4932, in sort_values
    indexer = nargsort(
  File "/usr/local/lib/python3.8/site-packages/pandas/core/sorting.py", line 274, in nargsort
    indexer = non_nan_idx[non_nans.argsort(kind=kind)]
TypeError: '<' not supported between instances of 'datetime.datetime' and 'named_object'

the current state of of my private_control_config.yaml (the relevant parts) are as follows;

  run_backups:
    backup_arctic_to_csv:
      max_executions: 0
    backup_files:
      max_executions: 0
    backup_mongo_data_as_dump:
      max_executions: 0

process_configuration_start_time:
  default: '00:01'
  run_stack_handler: '00:01'
  run_capital_update: '01:00'
  run_daily_prices_updates: '20:00'
  run_systems: '20:05'
  run_strategy_order_generator: '20:10'
  run_backups: '20:15'
  run_cleaners: '20:20'
  run_reports: '20:25'
process_configuration_stop_time:
  default: '23:50'
  run_strategy_order_generator: '23:50'
  run_stack_handler: '19:45'
  run_capital_update: '19:50'
  run_daily_prices_updates: '23:50'
  run_systems: '23:50'
  run_backups: '20:00'
  run_cleaners: '23:50'
  run_reports: '23:50'

process_configuration_previous_process:
  run_systems: 'run_daily_prices_updates'
  run_strategy_order_generator: 'run_systems'
  run_cleaners: 'run_strategy_order_generator'
  run_backups: 'run_cleaners'
  run_reports: 'run_strategy_order_generator'

I have tried to comment out backups completely - adding hashes to the backup process parts the syscontrol/control_config.yaml, but to no avail.

Any input on this would be greatly appreciated.

[bug-or-feature]

I think this should have been fixed by PR#577

[TobiasAntiGravity]

Ah - great - thank you so much Andy - I will pull the new commits asap!