mpiexec -n P python3 with project()

[Hasupama]

Hi,
My code has a project command. When I run the code using mpirun, it is perfectly running. When I use the mpiexec -n then the below error appears for the project function.

A1.project(A)
File "PETSc/Log.pyx", line 115, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "PETSc/Log.pyx", line 116, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "/home/............../firedrake/firedrake/adjoint/function.py", line 45, in wrapper
output = project(self, b, *args, **kwargs)

I need to use mpiexec -n and what would be the solution for this error?

[dham]

I'm afraid there isn't enough information here for us to see what is going wrong. Please post a minimal failing example (i.e. the smallest complete Python program which you can get to exhibit this error), plus the full error output (the tiny excerpt above doesn't tell us what the exception was or where it occurred).

[Hasupama]

from firedrake import *

mesh1 = Mesh('d1.msh')
mesh2 = Mesh('d2.msh')
x = SpatialCoordinate(mesh1)
s= FunctionSpace(mesh1, 'CG', 1)
c = FunctionSpace(mesh2, 'CG', 1)
A = Function(s)
B = Function(c)
A.interpolate( (10 * exp( -(0.01)* ( (x[0])**2 + (x[1])**2 ) ) ))
B.project(A)

With mpirun the above code is running without errors.

I used mpiexec -n and error message was,

B.project(A)
File "PETSc/Log.pyx", line 115, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "PETSc/Log.pyx", line 116, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "/home/a/firedrake/srcmek/firedrake/src/firedrake/firedrake/adjoint/function.py", line 45, in wrapper
output = project(self, b, *args, **kwargs)
File "/home/a/firedrake/src/firedrake/firedrake/function.py", line 354, in project
return projection.project(b, self, *args, **kwargs)
File "PETSc/Log.pyx", line 115, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "PETSc/Log.pyx", line 116, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "/home/a/firedrake/src/firedrake/firedrake/adjoint/projection.py", line 33, in wrapper
output = project(*args, **kwargs)
File "/home/a/firedrake/src/firedrake/firedrake/projection.py", line 75, in project
val = Projector(v, V, bcs=bcs, solver_parameters=solver_parameters,
File "/home/a/firedrake/src/firedrake/firedrake/projection.py", line 172, in project
self.apply_massinv(self.target, self.rhs)
File "/home/a/firedrake/src/firedrake/firedrake/projection.py", line 231, in rhs
self.mixed_mass.mult(u, v)
File "/home/a/firedrake/src/PyOP2/pyop2/utils.py", line 62, in get
obj.dict[self.name] = result = self.fget(obj)
File "/home/a/firedrake/src/firedrake/firedrake/projection.py", line 225, in mixed_mass
return assemble_mixed_mass_matrix(self.source.function_space(),
File "PETSc/Log.pyx", line 115, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "PETSc/Log.pyx", line 116, in petsc4py.PETSc.Log.EventDecorator.decorator.wrapped_func
File "/home/a/firedrake/src/firedrake/firedrake/supermeshing.py", line 97, in assemble_mixed_mass_matrix
intersections = intersection_finder(mesh_A, mesh_B)
File "firedrake/cython/supermeshimpl.pyx", line 132, in firedrake.cython.supermeshimpl.intersection_finder
AssertionError: Whoever made mesh_B should explicitly mark mesh_A as having a compatible parallel layout.
application called MPI_Abort(MPI_COMM_WORLD, 1) - process 0

hope now it is clear.

[dham]

Intermesh projection only works in parallel in very highly restricted circumstances in which someone has arranged that the two meshes have the same parallel decomposition.

From a higher level, what are you trying to do here?

[Hasupama]

I want to project my results from a finer mesh to a coarser mesh for the visualization.

What is the difference between mpirun (Open MPI) 4.0.3 and mpiexec (OpenRTE) 4.0.3?

[yupeng-sun-code]

Hi,
I am also struggling with this issue now, when I use project() to transfer the results from one mesh to another mesh, it can only work on mpirun or mpiexec n-1. I am also curious how can I use multiple cores to do this.

My code looks like:
mesh = Mesh('3D_00025.msh')
dim = mesh.geometric_dimension()
submesh = Submesh(mesh, dim, regions["DOMAIN"])
GAMMA = FunctionSpace(submesh, "CG", 1)
gamma = Function(GAMMA, name="gamma")
gamma.assign(Constant(initial_gamma))
W = FunctionSpace(mesh, "CG", 1)
gamma_global = Function(W)
gamma_global.project(gammap)

[yupeng-sun-code]

Hi,
I am also struggling with this issue now, when I use project() to transfer the results from one mesh to another mesh, it can only work on mpirun or mpiexec n-1. I am also curious how can I use multiple cores to do this