How to align each process before algo.compute()? #591
-
| 
         I would like to measure the algo.compute() runtime in distributed computing. So I wonder if there's an API like mpi_barrier() to sync each process after data loading and before algo.compute(). Something like below,  | 
  
Beta Was this translation helpful? Give feedback.
      
      
          Answered by
          
            PetrovKP
          
      
      
        Mar 29, 2021 
      
    
    Replies: 1 comment 1 reply
-
| 
         We use mpi to run our algorithms for python. For synchronization across all group members, you can use the MPI functions. For example: import daal4py as d4p
d4p.daalinit() # for MPI init of daal4py
from mpi4py import MPI
comm = MPI.COMM_WORLD
data = read_csv()
comm.Barrier()
algo = d4p.algorithm()
algo.compute(data)
...
d4p.daalfini() # for MPI finilize of daal4py | 
  
Beta Was this translation helpful? Give feedback.
                  
                    1 reply
                  
                
            
      Answer selected by
        SmirnovEgorRu
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
We use mpi to run our algorithms for python. For synchronization across all group members, you can use the MPI functions. For example: