Batch CMORISer

[rbeucher]

This pull request introduces significant updates to the ACCESS-MOPPeR tool, focusing on enhancing usability, scalability, and integration with high-performance computing (HPC) environments. The changes include a revamped README, expanded documentation, and the addition of a batch processing system with real-time monitoring capabilities. Below are the key updates grouped by theme:

Enhancements to Batch Processing

• Introduced a comprehensive batch processing system for HPC environments, enabling parallel processing of variables as independent PBS jobs. Features include resource management, error recovery, and scalability. (README.md, docs/source/batch_processing.rst, docs/source/getting_started.rst) [1] [2] [3]
• Added a Streamlit-based real-time monitoring dashboard for tracking job progress, status, and errors. (README.md, docs/source/batch_processing.rst) [1] [2]

Documentation Improvements

• Expanded the documentation with detailed guides on batch processing, configuration file specifications, and troubleshooting. (docs/source/batch_processing.rst, docs/source/getting_started.rst) [1] [2]
• Updated the index to include new sections for batch processing. (docs/source/index.rst)

README Overhaul

• Rewritten README to reflect the latest features, including the batch processing system, Python API usage, and installation instructions. (README.md)

Feature Additions

• Added support for CMIP6 and CMIP7 FastTrack datasets, with improved flexibility for variable-specific CMORisation. (README.md, docs/source/batch_processing.rst) [1] [2]

These updates make ACCESS-MOPPeR more user-friendly and better suited for large-scale workflows in HPC environments.