Skip to content

Multi Processing

Ben Stabler edited this page Oct 4, 2018 · 8 revisions

Configuration Example

chunk_size: 4000000000

multiprocess_steps:
  - label: mp_initialize
    begin: initialize_landuse
  - label: mp_households
    begin: _school_location_sample
    num_processes: 3
    chunk_size: 1000000000
    slice:
      tables:
        - households
        - persons
  - label: mp_summarize
    begin: write_data_dictionary 

Clone this wiki locally