dolfin team mailing list archive
-
dolfin team
-
Mailing list archive
-
Message #25272
Re: [Dorsal] petsc/hypre error in parallel
On 28 November 2011 15:45, Johannes Ring <johannr@xxxxxxxxx> wrote:
> On Mon, Nov 28, 2011 at 3:33 PM, Kristian Ølgaard
> <k.b.oelgaard@xxxxxxxxx> wrote:
>> I let Dorsal download/configure and build the entire FEniCS dev suite
>> with all the bells and whistles using the default options.
>> I only modified the download and install paths.
>>
>> When I run the navier-stokes demo in parallel (only tested the C++
>> version), I get the following error after which the process hangs
>> (usually around time step 16, but that can vary!):
>>
>> mpirun -np 3 ./demo_navier-stokes
>> Process 0: Partitioned mesh, edge cut is 62.
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.02
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.03
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.04
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.05
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.06
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.07
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.08
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.09
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.1
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.11
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.12
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.13
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.14
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.15
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> Process 0: Computing velocity correction
>> Process 0: t = 0.16
>> Process 0: Computing tentative velocity
>> Process 0: Computing pressure correction
>> [2]PETSC ERROR: --------------------- Error Message
>> ------------------------------------
>> [2]PETSC ERROR: Error in external library!
>> [2]PETSC ERROR: Error in HYPRE_IJMatrixCreate()!
>> [2]PETSC ERROR:
>> ------------------------------------------------------------------------
>> [2]PETSC ERROR: Petsc Release Version 3.2.0, Patch 5, Sat Oct 29
>> 13:45:54 CDT 2011
>> [2]PETSC ERROR: See docs/changes/index.html for recent updates.
>> [2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
>> [2]PETSC ERROR: See docs/index.html for manual pages.
>> [2]PETSC ERROR:
>> ------------------------------------------------------------------------
>> [2]PETSC ERROR: Unknown Name on a linux-gnu named oelgaard-desktop by
>> oelgaard Mon Nov 28 15:27:24 2011
>> [2]PETSC ERROR: Libraries linked from /home/oelgaard/software/fenics/lib
>> [2]PETSC ERROR: Configure run at Mon Nov 28 10:19:20 2011
>> [2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0
>> --with-shared-libraries=1 --with-clanguage=cxx --with-parmetis=1
>> --with-parmetis-dir=/usr --download-umfpack=1 --download-hypre=1
>> --download-mumps=1 --download-scalapack=1 --download-blacs=1
>> --download-ptscotch=1 --download-scotch=1 --with-ml=1
>> --with-ml-lib=/home/oelgaard/software/fenics/lib/libml.so
>> --with-ml-include=/home/oelgaard/software/fenics/include/trilinos
>> --prefix=/home/oelgaard/software/fenics
>> [2]PETSC ERROR:
>> ------------------------------------------------------------------------
>> [2]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 71 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/dm/impls/da/hypre/mhyp.c
>> [2]PETSC ERROR: PCSetUp_HYPRE() line 100 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/impls/hypre/hypre.c
>> [2]PETSC ERROR: PCSetUp() line 819 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/interface/precon.c
>> [2]PETSC ERROR: KSPSetUp() line 260 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
>> [2]PETSC ERROR: KSPSolve() line 379 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
>> [2]PETSC ERROR: --------------------- Error Message
>> ------------------------------------
>> [2]PETSC ERROR: Error in external library!
>> [2]PETSC ERROR: Error in HYPRE_DistroyXXX()!
>> [2]PETSC ERROR:
>> ------------------------------------------------------------------------
>> [2]PETSC ERROR: Petsc Release Version 3.2.0, Patch 5, Sat Oct 29
>> 13:45:54 CDT 2011
>> [2]PETSC ERROR: See docs/changes/index.html for recent updates.
>> [2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
>> [2]PETSC ERROR: See docs/index.html for manual pages.
>> [2]PETSC ERROR:
>> ------------------------------------------------------------------------
>> [2]PETSC ERROR: Unknown Name on a linux-gnu named oelgaard-desktop by
>> oelgaard Mon Nov 28 15:27:24 2011
>> [2]PETSC ERROR: Libraries linked from /home/oelgaard/software/fenics/lib
>> [2]PETSC ERROR: Configure run at Mon Nov 28 10:19:20 2011
>> [2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0
>> --with-shared-libraries=1 --with-clanguage=cxx --with-parmetis=1
>> --with-parmetis-dir=/usr --download-umfpack=1 --download-hypre=1
>> --download-mumps=1 --download-scalapack=1 --download-blacs=1
>> --download-ptscotch=1 --download-scotch=1 --with-ml=1
>> --with-ml-lib=/home/oelgaard/software/fenics/lib/libml.so
>> --with-ml-include=/home/oelgaard/software/fenics/include/trilinos
>> --prefix=/home/oelgaard/software/fenics
>> [2]PETSC ERROR:
>> ------------------------------------------------------------------------
>> [2]PETSC ERROR: PCDestroy_HYPRE() line 181 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/impls/hypre/hypre.c
>> [2]PETSC ERROR: PCDestroy() line 119 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/interface/precon.c
>> [2]PETSC ERROR: KSPDestroy() line 755 in
>> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
>>
>> Did anyone experience something similar?
>
> Are you running Ubuntu 11.10? If so, I guess this is the bug that
> Garth claims to be in the OpenMPI package. I have turned off parallel
> testing of DOLFIN on the oneiric-i386 buildbot because of this.
Yes I am. OK, so I'll just ignore this then, thanks.
Kristian
> Johannes
>
References