Skip to content

Error in rule build_fuel_prices: #720

@glarange

Description

@glarange

Version Checks (indicate both or one)

The Issue

`Config file config/config.cluster.yaml is extended by additional config specified via the command line.
Config file config/config.common.yaml is extended by additional config specified via the command line.
Config file config/config.plotting.yaml is extended by additional config specified via the command line.
Config file config/config.api.yaml is extended by additional config specified via the command line.
Config file config/config.sector.yaml is extended by additional config specified via the command line.
Building DAG of jobs...
Using shell: /usr/bin/bash
Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
Conda environments: ignored
Job stats:
job count


add_demand 1
add_electricity 1
add_extra_components 1
add_sectors 1
build_base_network 1
build_bus_regions 1
build_cost_data 3
build_electrical_demand 1
build_fuel_prices 1
build_powerplants 1
build_renewable_profiles 3
build_shapes 1
cluster_network 1
data_model 1
prepare_network 1
retrieve_caiso_data 1
retrieve_cutout 1
retrieve_nrel_efs_data 1
retrieve_zenodo_databundles 1
simplify_network 1
total 24

Select jobs to execute...

[Fri Dec 19 20:49:19 2025]
rule retrieve_cutout:
input: zenodo.org/records/14611937/files/usa_era5_2019.nc
output: cutouts/usa_era5_2019.nc
log: logs/retrieve_cutout_usa_era5_2019.log
jobid: 14
reason: Missing output files: cutouts/usa_era5_2019.nc
wildcards: cutout=era5_2019
resources: tmpdir=/tmp, walltime=00:50:00, mem_mb=5000, mem_mib=4769

[Fri Dec 19 21:19:38 2025]
Finished job 14.
1 of 24 steps (4%) done
Select jobs to execute...

[Fri Dec 19 21:19:38 2025]
rule build_cost_data:
input: repo_data/costs/EFS_Technology_Data.xlsx, repo_data/costs/efs_icev_costs.csv, repo_data/costs/eia_tech_costs.csv, repo_data/costs/egs_costs.csv, repo_data/costs/additional_costs.csv
output: resources/Default/costs/costs_2050.csv, resources/Default/costs/sector_costs_2050.csv
log: logs/Default/costs_2050.log
jobid: 23
reason: Missing output files: resources/Default/costs/costs_2050.csv
wildcards: year=2050
resources: tmpdir=/tmp, mem_mb=5000, mem_mib=4769, walltime=00:30:00

[Fri Dec 19 21:19:58 2025]
Finished job 23.
2 of 24 steps (8%) done
Select jobs to execute...

[Fri Dec 19 21:19:58 2025]
rule retrieve_caiso_data:
input: repo_data/plants/wecc_fuelregions.xlsx
output: data/costs/caiso_ng_power_prices.csv
log: logs/Default/retrieve_caiso_data.log
jobid: 11
reason: Missing output files: data/costs/caiso_ng_power_prices.csv
resources: tmpdir=/tmp, walltime=00:10:00, mem_mb=2000, mem_mib=1908

[Fri Dec 19 21:22:02 2025]
Finished job 11.
3 of 24 steps (12%) done
Select jobs to execute...

[Fri Dec 19 21:22:02 2025]
rule build_fuel_prices:
input: data/costs/caiso_ng_power_prices.csv
output: resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv
log: logs/Default/western/build_fuel_prices.log
jobid: 10
benchmark: benchmarks/Default/western/build_fuel_prices
reason: Missing output files: resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv, resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv; Input files updated by another job: data/costs/caiso_ng_power_prices.csv
wildcards: interconnect=western
resources: tmpdir=/tmp, mem_mb=30000, mem_mib=28611, walltime=00:20:00

Will exit after finishing currently running jobs (scheduler).
[Fri Dec 19 21:23:02 2025]
Error in rule build_fuel_prices:
jobid: 10
input: data/costs/caiso_ng_power_prices.csv
output: resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv
log: logs/Default/western/build_fuel_prices.log (check log file(s) for error details)

RuleException:
CalledProcessError in file /mnt/c/pypsa-usa/workflow/rules/build_electricity.smk, line 554:
Command 'set -euo pipefail; /home/glara/miniforge3/envs/pypsa-usa/bin/python3.11 /mnt/c/pypsa-usa/workflow/.snakemake/scripts/tmprl22czxi.build_fuel_prices.py' died with <Signals.SIGKILL: 9>.
File "/mnt/c/pypsa-usa/workflow/rules/build_electricity.smk", line 554, in __rule_build_fuel_prices
File "/home/glara/miniforge3/envs/pypsa-usa/lib/python3.11/concurrent/futures/thread.py", line 58, in run
Removing output files of failed job build_fuel_prices since they might be corrupted:
resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv
Trying to restart job 10.
Will exit after finishing currently running jobs (scheduler).
Shutting down, this might take some time.
Complete log: .snakemake/log/2025-12-19T204917.404558.snakemake.log

`

Steps To Reproduce

Usage in the Installation tuorial:

mamba activate pypsa-usa snakemake -j1 --configfile config/config.default.yaml

Error Message

Error in rule build_fuel_prices:
    jobid: 10
    input: data/costs/caiso_ng_power_prices.csv
    output: resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv, resources/Default/western/pudl_fuel_costs.csv
    log: logs/Default/western/build_fuel_prices.log (check log file(s) for error details)

RuleException:
CalledProcessError in file /mnt/c/pypsa-usa/workflow/rules/build_electricity.smk, line 554:
Command 'set -euo pipefail;  /home/glara/miniforge3/envs/pypsa-usa/bin/python3.11 /mnt/c/pypsa-usa/workflow/.snakemake/scripts/tmprl22czxi.build_fuel_prices.py' died with <Signals.SIGKILL: 9>.
  File "/mnt/c/pypsa-usa/workflow/rules/build_electricity.smk", line 554, in __rule_build_fuel_prices
  File "/home/glara/miniforge3/envs/pypsa-usa/lib/python3.11/concurrent/futures/thread.py", line 58, in run
Removing output files of failed job build_fuel_prices since they might be corrupted:
resources/Default/western/state_ng_power_prices.csv, resources/Default/western/state_coal_power_prices.csv, resources/Default/western/ba_ng_power_prices.csv
Trying to restart job 10.
Will exit after finishing currently running jobs (scheduler).
Shutting down, this might take some time.
Complete log: .snakemake/log/2025-12-19T204917.404558.snakemake.log

Anything else?

Windows

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions