-
Notifications
You must be signed in to change notification settings - Fork 39
Description
Version Checks (indicate both or one)
-
This bug exists on the master branch of PyPSA-USA.
-
This bug exists on the develop branch of PyPSA-USA.
The Issue
`Config file config/config.cluster.yaml is extended by additional config specified via the command line.
Config file config/config.common.yaml is extended by additional config specified via the command line.
Config file config/config.plotting.yaml is extended by additional config specified via the command line.
Config file config/config.api.yaml is extended by additional config specified via the command line.
Config file config/config.sector.yaml is extended by additional config specified via the command line.
Building DAG of jobs...
Using shell: /usr/bin/bash
Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
Conda environments: ignored
Job stats:
job count
add_demand 1
add_electricity 1
add_extra_components 1
add_sectors 1
build_base_network 1
build_bus_regions 1
build_cost_data 3
build_electrical_demand 1
build_fuel_prices 1
build_powerplants 1
build_renewable_profiles 3
build_shapes 1
cluster_network 1
data_model 1
prepare_network 1
retrieve_caiso_data 1
retrieve_cutout 1
retrieve_nrel_efs_data 1
retrieve_zenodo_databundles 1
simplify_network 1
total 24
Select jobs to execute...
[Fri Dec 19 20:49:19 2025]
rule retrieve_cutout:
input: zenodo.org/records/14611937/files/usa_era5_2019.nc
output: cutouts/usa_era5_2019.nc
log: logs/retrieve_cutout_usa_era5_2019.log
jobid: 14
reason: Missing output files: cutouts/usa_era5_2019.nc
wildcards: cutout=era5_2019
resources: tmpdir=/tmp, walltime=00:50:00, mem_mb=5000, mem_mib=4769
[Fri Dec 19 21:19:38 2025]
Finished job 14.
1 of 24 steps (4%) done
Select jobs to execute...
[Fri Dec 19 21:19:38 2025]
rule build_cost_data:
input: repo_data/costs/EFS_Technology_Data.xlsx, repo_data/costs/efs_icev_costs.csv, repo_data/costs/eia_tech_costs.csv, repo_data/costs/egs_costs.csv, repo_data/costs/additional_costs.csv
output: resources/Default/costs/costs_2050.csv, resources/Default/costs/sector_costs_2050.csv
log: logs/Default/costs_2050.log
jobid: 23
reason: Missing output files: resources/Default/costs/costs_2050.csv
wildcards: year=2050
resources: tmpdir=/tmp, mem_mb=5000, mem_mib=4769, walltime=00:30:00
[Fri Dec 19 21:19:58 2025]
Finished job 23.
2 of 24 steps (8%) done
Select jobs to execute...
[Fri Dec 19 21:19:58 2025]
rule retrieve_caiso_data:
input: repo_data/plants/wecc_fuelregions.xlsx
output: data/costs/caiso_ng_power_prices.csv
log: logs/Default/retrieve_caiso_data.log
jobid: 11
reason: Missing output files: data/costs/caiso_ng_power_prices.csv
resources: tmpdir=/tmp, walltime=00:10:00, mem_mb=2000, mem_mib=1908
[Fri Dec 19 21:22:02 2025]
Finished job 11.
3 of 24 steps (12%) done
Select jobs to execute...
[Fri Dec 19 21:22:02 2025]
rule build_fuel_prices:
input: data/costs/caiso_ng_power_prices.csv
output: resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv
log: logs/Default/western/build_fuel_prices.log
jobid: 10
benchmark: benchmarks/Default/western/build_fuel_prices
reason: Missing output files: resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv, resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv; Input files updated by another job: data/costs/caiso_ng_power_prices.csv
wildcards: interconnect=western
resources: tmpdir=/tmp, mem_mb=30000, mem_mib=28611, walltime=00:20:00
Will exit after finishing currently running jobs (scheduler).
[Fri Dec 19 21:23:02 2025]
Error in rule build_fuel_prices:
jobid: 10
input: data/costs/caiso_ng_power_prices.csv
output: resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv
log: logs/Default/western/build_fuel_prices.log (check log file(s) for error details)
RuleException:
CalledProcessError in file /mnt/c/pypsa-usa/workflow/rules/build_electricity.smk, line 554:
Command 'set -euo pipefail; /home/glara/miniforge3/envs/pypsa-usa/bin/python3.11 /mnt/c/pypsa-usa/workflow/.snakemake/scripts/tmprl22czxi.build_fuel_prices.py' died with <Signals.SIGKILL: 9>.
File "/mnt/c/pypsa-usa/workflow/rules/build_electricity.smk", line 554, in __rule_build_fuel_prices
File "/home/glara/miniforge3/envs/pypsa-usa/lib/python3.11/concurrent/futures/thread.py", line 58, in run
Removing output files of failed job build_fuel_prices since they might be corrupted:
resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv
Trying to restart job 10.
Will exit after finishing currently running jobs (scheduler).
Shutting down, this might take some time.
Complete log: .snakemake/log/2025-12-19T204917.404558.snakemake.log
`
Steps To Reproduce
Usage in the Installation tuorial:
mamba activate pypsa-usa snakemake -j1 --configfile config/config.default.yaml
Error Message
Error in rule build_fuel_prices:
jobid: 10
input: data/costs/caiso_ng_power_prices.csv
output: resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv
log: logs/Default/western/build_fuel_prices.log (check log file(s) for error details)
RuleException:
CalledProcessError in file /mnt/c/pypsa-usa/workflow/rules/build_electricity.smk, line 554:
Command 'set -euo pipefail; /home/glara/miniforge3/envs/pypsa-usa/bin/python3.11 /mnt/c/pypsa-usa/workflow/.snakemake/scripts/tmprl22czxi.build_fuel_prices.py' died with <Signals.SIGKILL: 9>.
File "/mnt/c/pypsa-usa/workflow/rules/build_electricity.smk", line 554, in __rule_build_fuel_prices
File "/home/glara/miniforge3/envs/pypsa-usa/lib/python3.11/concurrent/futures/thread.py", line 58, in run
Removing output files of failed job build_fuel_prices since they might be corrupted:
resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv
Trying to restart job 10.
Will exit after finishing currently running jobs (scheduler).
Shutting down, this might take some time.
Complete log: .snakemake/log/2025-12-19T204917.404558.snakemake.logAnything else?
Windows