-
Notifications
You must be signed in to change notification settings - Fork 7
Open
Description
I'm starting my job as follows
LD_PRELOAD=~/mpi-tools/mpi_t/gyan/libgyan.so mpirun -np 8 -hostfile hosts -mca plm_rsh_no_tree_spawn 1 -bind-to socket -map-by slot -x HOROVOD_HIERARCHICAL_ALLREDUCE=1 -x HOROVOD_FUSION_THRESHOLD=16777216 -x NCCL_MIN_NRINGS=4 -x LD_LIBRARY_PATH -x PATH -mca pml ob1 -mca btl ^openib -x TF_CPP_MIN_LOG_LEVEL=0 python -W ignore train_imagenet_resnet_hvd.py --synthetic -b 256 --num_batches 200 --clear_log
Output is
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Performance profiling for the complete MPI job:
----------------------------------------------------------------------------------------
Variable Name Type Minimum(Rank) Maximum(Rank) Average
----------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------
Metadata
Metadata
Assignees
Labels
No labels