Castle Example Runtime Failure

[SamBosch77]

Summary:

The castle example test for omega_h experiences an assertion failure leading to bad termination of the application when run with the following build specs.

Error Output:

Click me!

mpirun -np 2 ./castle
[0] number of vertices 8
[0]: Local vertex number 0 has global index 0
[0]: Local vertex number 1 has global index 2
[0]: Local vertex number 2 has global index 3
[0]: Local vertex number 3 has global index 6
[0]: Local vertex number 4 has global index 7
[0]: Local vertex number 5 has global index 8
[0]: Local vertex number 6 has global index 9
[0]: Local vertex number 7 has global index 10
[0]: local  0 4 0 6
[0]: global 1 7 0 9
[0]: local  1 1 3 7
[0]: global 3 2 6 10
[0]: local  2 3 2 5
[0]: global 6 6 3 8
[0]: local  3 2 4 5
[0]: global 7 3 7 8
[0]: local  4 5 4 6
[0]: global 9 8 7 9
[0]: local  5 5 6 7
[0]: global 10 8 9 10
[0]: local  6 3 5 7
[0]: global 13 6 8 10
[1] number of vertices 8
[1]: Local vertex number 0 has global index 0
[1]: Local vertex number 1 has global index 1
[1]: Local vertex number 2 has global index 2
[1]: Local vertex number 3 has global index 4
[1]: Local vertex number 4 has global index 5
[1]: Local vertex number 5 has global index 9
[1]: Local vertex number 6 has global index 10
[1]: Local vertex number 7 has global index 11
[1]: local  0 4 2 6
[1]: global 0 5 2 10
[1]: local  1 0 3 5
[1]: global 2 0 4 9
[1]: local  2 3 1 7
[1]: global 4 4 1 11
[1]: local  3 1 4 7
[1]: global 5 1 5 11
[1]: local  4 4 6 7
[1]: global 8 5 10 11
[1]: local  5 5 3 7
[1]: global 11 9 4 11
[1]: local  6 6 5 7
[1]: global 12 10 9 11
assertion array.size() == nents_[ent_dim] * ncomps failed at /tmp/sbosch/spack-stage/spack-stage-omega-h-9.34.1-ry6e6x4xxa2gkvwflqpjxe3umvnyfajj/spack-src/src/Omega_h_mesh.cpp +158
assertion array.size() == nents_[ent_dim] * ncomps failed at /tmp/sbosch/spack-stage/spack-stage-omega-h-9.34.1-ry6e6x4xxa2gkvwflqpjxe3umvnyfajj/spack-src/src/Omega_h_mesh.cpp +158

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 398929 RUNNING AT instinct
=   EXIT CODE: 134
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Aborted (signal 6)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions

Build Info:

• built with spack (https://github.com/spack/spack)
• all packages and dependencies built using gcc 9.4.0
• OS: Ubuntu 20.04
• Architecture: x86_64

omega_h build dependencies and spack flags

==> 1 installed package
-- linux-ubuntu20.04-x86_64 / gcc@9.4.0 -------------------------
ry6e6x4 omega-h@9.34.1~cuda~examples~ipo+mpi+optimize+shared+symbols~throw+trilinos~warnings+zlib build_type=RelWithDebInfo
y3d2cji     cmake@3.23.1~doc+ncurses+ownlibs~qt build_type=Release
7ofkj5g         ncurses@6.2~symlinks+termlib abi=none
tgufarn             pkgconf@1.8.0
del3f6o         openssl@1.1.1o~docs~shared certs=system
xjse77e             perl@5.34.1+cpanm+shared+threads
bmmadng                 berkeley-db@18.1.40+cxx~docs+stl patches=b231fcc
ehf5627                 bzip2@1.0.8~debug~pic+shared
p5ebbuy                     diffutils@3.8
qnzwa5k                         libiconv@1.16 libs=shared,static
ovdf2pq                 gdbm@1.19
hse57kg                     readline@8.1
cvc7wjl                 zlib@1.2.12+optimize+pic+shared patches=0d38234
rxj536c     mpich@4.0.2~argobots~cuda+fortran+hwloc+hydra+libxml2+pci~rocm+romio~slurm~two_level_namespace~vci~verbs~wrapperrpath datatype-engine=auto device=ch4 netmod=ofi pmi=pmi
icrjbgb         findutils@4.9.0 patches=440b954
c3rwxom         hwloc@2.7.1~cairo~cuda~gl~libudev+libxml2~netloc~nvml~opencl+pci~rocm+shared
iwj5wuv             libpciaccess@0.16
tueb4ra                 libtool@2.4.7
kcj4z36                     m4@1.4.19+sigsegv patches=9dc5fbd,bfdffa7
c4hxteu                         libsigsegv@2.13
f3hyg4w                 util-macros@1.19.3
x6fwxii             libxml2@2.9.13~python
22jgjfa                 xz@5.2.5+pic libs=shared,static
xwapafs         libfabric@1.14.1~debug~kdreg fabrics=rxm,sockets,tcp,udp
qaanq7e         yaksa@0.2~cuda~rocm
d33hbbr             autoconf@2.69 patches=35c4492,7793209,a49dd5b
kc2f75p             automake@1.16.5
eqvhpoq             python@3.8.13+bz2+ctypes+dbm~debug+ensurepip+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93,4c24573,f2fd060
poaz426                 expat@2.4.8+libbsd
cv3ofog                     libbsd@0.11.5
deksstr                         libmd@1.0.4
rc7lfsx                 gettext@0.21+bzip2+curses+git~libunistring+libxml2+tar+xz
mkwelay                     tar@1.34 zip=pigz
5v6qbpo                         pigz@2.7
iz2z5mz                         zstd@1.5.2+programs compression=none libs=shared,static
dpfg22g                 libffi@3.4.2
nam6ocr                 sqlite@3.38.5+column_metadata+dynamic_extensions+fts~functions+rtree
j4isjhe                 util-linux-uuid@2.37.4
twcdwwq     trilinos@13.0.1~adelus~adios2+amesos+amesos2+anasazi+aztec~basker+belos+boost~chaco~complex~cuda~cuda_rdc~debug~dtk+epetra+epetraext~epetraextbtf~epetraextexperimental~epetraextgraphreorderings~exodus+explicit_template_instantiation~float+fortran~gtest~hdf5~hypre+ifpack+ifpack2+intrepid+intrepid2~ipo+isorropia+kokkos~mesquite+minitensor+ml+mpi+muelu~mumps+nox~openmp~panzer+phalanx+piro~python~rocm~rocm_rdc+rol+rythmos+sacado~scorec+shards+shared+shylu+stk+stokhos+stratimikos~strumpack~suite-sparse~superlu+superlu-dist+teko+tempus+thyra+tpetra+trilinoscouplings~wrapper~x11+zoltan+zoltan2 build_type=RelWithDebInfo cxxstd=14 gotype=long_long
ocgh2dj         boost@1.79.0~atomic~chrono~clanglibcpp~container~context~contract~coroutine~date_time~debug+exception~fiber~filesystem+graph~graph_parallel~icu~iostreams~json~locale~log+math+mpi+multithreaded~nowide~numpy~pic~program_options~python~random~regex~serialization+shared~signals~singlethreaded+stacktrace~system~taggedlayout~test~thread~timer~type_erasure~versionedlayout~wave cxxstd=98 patches=a440f96,b8569d7 visibility=hidden
o7bkfre         metis@5.1.0~gdb~int64~real64+shared build_type=Release patches=4991da9,b1225da
gebqx6b         openblas@0.3.20~bignuma~consistent_fpcsr~ilp64+locking+pic+shared symbol_suffix=none threads=openmp
6nyyhhf         parmetis@4.0.3~gdb~int64~ipo+shared build_type=RelWithDebInfo patches=4f89253,50ed208,704b84f
lddw7hm         superlu-dist@7.2.0~cuda~int64~ipo~openmp~rocm+shared build_type=RelWithDebInfo patches=8da9e21

Spack Maintainers and Others:

@cwsmith
@wspear