What's New
Fine-tuning Support
FinetuneDataModule: PyTorch Lightning DataModule for training on custom HuggingFace datasetsTotoForFinetuning: Lightning module with default configuration matching Toto's pretraining recipe- Ready-to-use training script (
finetune_toto.py) with YAML configuration - Interactive tutorial notebook (
finetuning_tutorial.ipynb)
Exogenous Variable Support
- Extended
TotoBackboneto handle known future covariates (e.g., weather forecasts, scheduled events) Fusionmodule for combining target and exogenous variate embeddings with learnable labels- Updated
TotoForecasterto inject future exogenous values during autoregressive decoding
Evaluation & Benchmarking
- Custom evaluation on FEV datasets that are not included in Toto's pretraining corpus
- Evaluation scripts comparing zero-shot, fine-tuned, and fine-tuned with exogenous approaches
- Pre-computed results on 14 datasets (ENTSOE, EPF, Solar, UCI Air Quality, Rohlik)
Installation
pip install toto-ts==0.2.0Full Changelog: v0.1.4...v0.2.0