← Back to team overview

dolfin team mailing list archive

petsc/hypre error in parallel

 

I let Dorsal download/configure and build the entire FEniCS dev suite
with all the bells and whistles using the default options.
I only modified the download and install paths.

When I run the navier-stokes demo in parallel (only tested the C++
version), I get the following error after which the process hangs
(usually around time step 16, but that can vary!):

mpirun -np 3 ./demo_navier-stokes
Process 0: Partitioned mesh, edge cut is 62.
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.02
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.03
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.04
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.05
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.06
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.07
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.08
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.09
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.1
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.11
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.12
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.13
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.14
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.15
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
Process 0: Computing velocity correction
Process 0: t = 0.16
Process 0: Computing tentative velocity
Process 0: Computing pressure correction
[2]PETSC ERROR: --------------------- Error Message
------------------------------------
[2]PETSC ERROR: Error in external library!
[2]PETSC ERROR: Error in HYPRE_IJMatrixCreate()!
[2]PETSC ERROR:
------------------------------------------------------------------------
[2]PETSC ERROR: Petsc Release Version 3.2.0, Patch 5, Sat Oct 29
13:45:54 CDT 2011
[2]PETSC ERROR: See docs/changes/index.html for recent updates.
[2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[2]PETSC ERROR: See docs/index.html for manual pages.
[2]PETSC ERROR:
------------------------------------------------------------------------
[2]PETSC ERROR: Unknown Name on a linux-gnu named oelgaard-desktop by
oelgaard Mon Nov 28 15:27:24 2011
[2]PETSC ERROR: Libraries linked from /home/oelgaard/software/fenics/lib
[2]PETSC ERROR: Configure run at Mon Nov 28 10:19:20 2011
[2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0
--with-shared-libraries=1 --with-clanguage=cxx --with-parmetis=1
--with-parmetis-dir=/usr --download-umfpack=1 --download-hypre=1
--download-mumps=1 --download-scalapack=1 --download-blacs=1
--download-ptscotch=1 --download-scotch=1 --with-ml=1
--with-ml-lib=/home/oelgaard/software/fenics/lib/libml.so
--with-ml-include=/home/oelgaard/software/fenics/include/trilinos
--prefix=/home/oelgaard/software/fenics
[2]PETSC ERROR:
------------------------------------------------------------------------
[2]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 71 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/dm/impls/da/hypre/mhyp.c
[2]PETSC ERROR: PCSetUp_HYPRE() line 100 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/impls/hypre/hypre.c
[2]PETSC ERROR: PCSetUp() line 819 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/interface/precon.c
[2]PETSC ERROR: KSPSetUp() line 260 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
[2]PETSC ERROR: KSPSolve() line 379 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c
[2]PETSC ERROR: --------------------- Error Message
------------------------------------
[2]PETSC ERROR: Error in external library!
[2]PETSC ERROR: Error in HYPRE_DistroyXXX()!
[2]PETSC ERROR:
------------------------------------------------------------------------
[2]PETSC ERROR: Petsc Release Version 3.2.0, Patch 5, Sat Oct 29
13:45:54 CDT 2011
[2]PETSC ERROR: See docs/changes/index.html for recent updates.
[2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[2]PETSC ERROR: See docs/index.html for manual pages.
[2]PETSC ERROR:
------------------------------------------------------------------------
[2]PETSC ERROR: Unknown Name on a linux-gnu named oelgaard-desktop by
oelgaard Mon Nov 28 15:27:24 2011
[2]PETSC ERROR: Libraries linked from /home/oelgaard/software/fenics/lib
[2]PETSC ERROR: Configure run at Mon Nov 28 10:19:20 2011
[2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0
--with-shared-libraries=1 --with-clanguage=cxx --with-parmetis=1
--with-parmetis-dir=/usr --download-umfpack=1 --download-hypre=1
--download-mumps=1 --download-scalapack=1 --download-blacs=1
--download-ptscotch=1 --download-scotch=1 --with-ml=1
--with-ml-lib=/home/oelgaard/software/fenics/lib/libml.so
--with-ml-include=/home/oelgaard/software/fenics/include/trilinos
--prefix=/home/oelgaard/software/fenics
[2]PETSC ERROR:
------------------------------------------------------------------------
[2]PETSC ERROR: PCDestroy_HYPRE() line 181 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/impls/hypre/hypre.c
[2]PETSC ERROR: PCDestroy() line 119 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/pc/interface/precon.c
[2]PETSC ERROR: KSPDestroy() line 755 in
/home/oelgaard/software/fenics/src/petsc-3.2-p5/src/ksp/ksp/interface/itfunc.c

Did anyone experience something similar?

Kristian


Follow ups