← Back to team overview

dolfin team mailing list archive

Re: [Dorsal] petsc/hypre error in parallel

 

On Mon, Nov 28, 2011 at 3:33 PM, Kristian Ølgaard
<k.b.oelgaard@xxxxxxxxx> wrote:
> I let Dorsal download/configure and build the entire FEniCS dev suite
> with all the bells and whistles using the default options.
> I only modified the download and install paths.
>
> When I run the navier-stokes demo in parallel (only tested the C++
> version), I get the following error after which the process hangs
> (usually around time step 16, but that can vary!):
>
> mpirun -np 3 ./demo_navier-stokes
> Process 0: Partitioned mesh, edge cut is 62.
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.02
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.03
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.04
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.05
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.06
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.07
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.08
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.09
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.1
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.11
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.12
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.13
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.14
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.15
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> Process 0: Computing velocity correction
> Process 0: t = 0.16
> Process 0: Computing tentative velocity
> Process 0: Computing pressure correction
> [2]PETSC ERROR: --------------------- Error Message
> ------------------------------------
> [2]PETSC ERROR: Error in external library!
> [2]PETSC ERROR: Error in HYPRE_IJMatrixCreate()!
> [2]PETSC ERROR:
> ------------------------------------------------------------------------
> [2]PETSC ERROR: Petsc Release Version 3.2.0, Patch 5, Sat Oct 29
> 13:45:54 CDT 2011
> [2]PETSC ERROR: See docs/changes/index.html for recent updates.
> [2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
> [2]PETSC ERROR: See docs/index.html for manual pages.
> [2]PETSC ERROR:
> ------------------------------------------------------------------------
> [2]PETSC ERROR: Unknown Name on a linux-gnu named oelgaard-desktop by
> oelgaard Mon Nov 28 15:27:24 2011
> [2]PETSC ERROR: Libraries linked from /home/oelgaard/software/fenics/lib
> [2]PETSC ERROR: Configure run at Mon Nov 28 10:19:20 2011
> [2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0
> --with-shared-libraries=1 --with-clanguage=cxx --with-parmetis=1
> --with-parmetis-dir=/usr --download-umfpack=1 --download-hypre=1
> --download-mumps=1 --download-scalapack=1 --download-blacs=1
> --download-ptscotch=1 --download-scotch=1 --with-ml=1
> --with-ml-lib=/home/oelgaard/software/fenics/lib/libml.so
> --with-ml-include=/home/oelgaard/software/fenics/include/trilinos
> --prefix=/home/oelgaard/software/fenics
> [2]PETSC ERROR:
> ------------------------------------------------------------------------
> [2]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 71 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/dm/impls/da/hypre/mhyp.c
> [2]PETSC ERROR: PCSetUp_HYPRE() line 100 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/impls/hypre/hypre.c
> [2]PETSC ERROR: PCSetUp() line 819 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/interface/precon.c
> [2]PETSC ERROR: KSPSetUp() line 260 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
> [2]PETSC ERROR: KSPSolve() line 379 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
> [2]PETSC ERROR: --------------------- Error Message
> ------------------------------------
> [2]PETSC ERROR: Error in external library!
> [2]PETSC ERROR: Error in HYPRE_DistroyXXX()!
> [2]PETSC ERROR:
> ------------------------------------------------------------------------
> [2]PETSC ERROR: Petsc Release Version 3.2.0, Patch 5, Sat Oct 29
> 13:45:54 CDT 2011
> [2]PETSC ERROR: See docs/changes/index.html for recent updates.
> [2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
> [2]PETSC ERROR: See docs/index.html for manual pages.
> [2]PETSC ERROR:
> ------------------------------------------------------------------------
> [2]PETSC ERROR: Unknown Name on a linux-gnu named oelgaard-desktop by
> oelgaard Mon Nov 28 15:27:24 2011
> [2]PETSC ERROR: Libraries linked from /home/oelgaard/software/fenics/lib
> [2]PETSC ERROR: Configure run at Mon Nov 28 10:19:20 2011
> [2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0
> --with-shared-libraries=1 --with-clanguage=cxx --with-parmetis=1
> --with-parmetis-dir=/usr --download-umfpack=1 --download-hypre=1
> --download-mumps=1 --download-scalapack=1 --download-blacs=1
> --download-ptscotch=1 --download-scotch=1 --with-ml=1
> --with-ml-lib=/home/oelgaard/software/fenics/lib/libml.so
> --with-ml-include=/home/oelgaard/software/fenics/include/trilinos
> --prefix=/home/oelgaard/software/fenics
> [2]PETSC ERROR:
> ------------------------------------------------------------------------
> [2]PETSC ERROR: PCDestroy_HYPRE() line 181 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/impls/hypre/hypre.c
> [2]PETSC ERROR: PCDestroy() line 119 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/interface/precon.c
> [2]PETSC ERROR: KSPDestroy() line 755 in
> /home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
>
> Did anyone experience something similar?

Are you running Ubuntu 11.10? If so, I guess this is the bug that
Garth claims to be in the OpenMPI package. I have turned off parallel
testing of DOLFIN on the oneiric-i386 buildbot because of this.

Johannes


Follow ups

References