Sync from Develop (#72)

* Committing clang-format changes * region partition arguments * Committing clang-format changes * Update vpicio_batch.c * Committing clang-format changes * Update vpicio_batch.c * Committing clang-format changes * Additional server timing and PDCflush_obj * Committing clang-format changes * flush all RPCs for PDC cache * Committing clang-format changes * Add flush all to vpicio_batch * Committing clang-format changes * Update vpicio_batch.c * Update vpicio_batch.c * change API name and place flush lock * Committing clang-format changes * Update pdc_obj.c * fix restart timing bug * Committing clang-format changes * flush for vpicio_batch * Committing clang-format changes * Update vpicio_batch.c * remove barriers * Committing clang-format changes * barrier back * Fix HOST_NAME_MAX undefined issue on MacOS * Fix HOST_NAME_MAX undefined issue on MacOS * Dynamic region partition Implementation of dynamic region partitioning. A metadata server dynamically assigns regions to data server depending on the workload. * Committing clang-format changes * Add posix timing * Committing clang-format changes * Rename pdc timing variables * Committing clang-format changes * Update pdc_region_cache.c * Update pdc_timing.c * Committing clang-format changes * Update pdc_timing.c * Update pdc_server.c * Update pdc_server_data.c * Committing clang-format changes * Add region local implementation * Committing clang-format changes * Update pdc_region_transfer.c * fix issues * Committing clang-format changes * Update pdc_region_transfer_metadata_query.c * Committing clang-format changes * Fix bugs * Committing clang-format changes * Update pdc_region_transfer.c * Committing clang-format changes * Mixed region partition type fix * Update pdc_timing.h * Update pdc_timing.h * Update pdc_region_transfer_metadata_query.c * Committing clang-format changes * Fix a dynamic partition bug * Committing clang-format changes * Update CMakeLists.txt * Update CMakeLists.txt * Sort out PDC timing * Update pdc.h * update timer link * Committing clang-format changes * sync with test folder * remove warnings * Update pdc.h * attribute unused. * Committing clang-format changes * Update CMakeLists.txt * Update pdc_client_server_common.c * Committing clang-format changes * Change path * Update CMakeLists.txt * test * Update pdc_timing.h * Metadata separate checkpoint and finalize * Committing clang-format changes * change the cmake layout * Committing clang-format changes * separating implementations into independent files * Committing clang-format changes * missing file * Update CMakeLists.txt * Update CMakeLists.txt * Update CMakeLists.txt * Update CMakeLists.txt * Update pdc_timing.h * Update pdc_region_transfer_metadata_query.c * Fix a dynamic allocation bug * Committing clang-format changes * Update pdc_region_transfer_metadata_query.c * Timing values * obj reset dimension implementation * Committing clang-format changes * solve compile errors * Committing clang-format changes * Update pdc_obj.c * Committing clang-format changes * Fix a bug * Committing clang-format changes * Rename files for consistency * Committing clang-format changes * Fix some conflicts * Cmake changes * Update CMakeLists.txt * Update CMakeLists.txt * Add a new API to set consistency semantics (#56) * Add consistency constants Signed-off-by: Chen Wang <wangvsa@gmail.com> * Committing clang-format changes * Ignore install directory Signed-off-by: Chen Wang <wangvsa@gmail.com> * Add a new API to set consistency semantics Signed-off-by: Chen Wang <wangvsa@gmail.com> * Committing clang-format changes * Copy consistency at transfer creation time Signed-off-by: Chen Wang <wangvsa@gmail.com> * Committing clang-format changes * Insert wait calls at transfer/close time depends on the consistency requirement Signed-off-by: Chen Wang <wangvsa@gmail.com> * Committing clang-format changes * Use the new semantics setting api in haccio Signed-off-by: Chen Wang <wangvsa@gmail.com> * Add a unit test for consistency semantics Signed-off-by: Chen Wang <wangvsa@gmail.com> Co-authored-by: github-actions <github-actions[bot]@users.noreply.github.com> * Update pdc_region_transfer.c * Committing clang-format changes * Update pdc_region_transfer.c * Set dims test * Committing clang-format changes * Fix issues at server cache * Committing clang-format changes * server cache cleanups * Update pdc_server_region_cache.c * Committing clang-format changes * Update pdc_server_region_cache.c * Committing clang-format changes * 2D set dims case * Committing clang-format changes * Update region_transfer_set_dims_2D.c * Fix dimension check bug * error code when error * 3D case for set dims * Update region_transfer_set_dims_3D.c * Update pdc_server_region_cache.c * Committing clang-format changes * Rename PDC folders * Update CMakeLists.txt * Update CMakeLists.txt * Update CMakeLists.txt * change for path * Update CMakeLists.txt * Update pdc_client_server_common.c * Update pdc_client_server_common.c * Committing clang-format changes * reset path * Fix a consistency bug, server metadata structure has to be modified along with local property * Committing clang-format changes * Server files reordering * Update CMakeLists.txt * Update README.md * Update pdc_server_region_cache.h * Update pdc_server_region_cache.c * Fix a metadata ID bug * Committing clang-format changes * Update vpicio_batch.c * Code comments and examples in C++ * Committing clang-format changes * Upload documentation to developer note section. Fixed a bug in vpicio_batch.c * Fix Cmake issues * Committing clang-format changes * Add PDC server cache to cmake * Cori scripts and results * Adding descriptions for running vpicio_batch.c on Cori * Update script_cori_shared.sh * Upload figures used by developer's note * Update readme.md * Include all figures to developer's note * Shrink font size * Update container_hashtable_checkpoint.png * Update documentations to include new APIs * Update struct type documentations with latest implementation * Committing clang-format changes * Add PDC future work * Update readme.md * Fix a couple of issues with MPI and cmake checkpoint * Update CMakeLists.txt * add local partition result * Add vpicio results * Fixed some typos * Add binary to Cmake install directory contents in bin are pdc_server.exe and close_server * Bring develop branch to current branch. * Create CMakeLists.txt * add missing file * Update CMakeLists.txt * Update github CI script * Update github CI script * Update github CI script * Add PDC Tools (#63) * update vol documentation * add tools * update pdc_ls and documentation * remove extraneous files in tools * add cjson * update pdc_ls and tools documentation * update tools documentation * fix undefined behavior * update pdc_import * update pdc tools * fix formatting * Committing clang-format changes * Fix a bug with packing local region buffer * Fix a bug with packing local region buffer * Partially fixed issues with data query * Committing clang-format changes * Remove unnecessary header * Fix compile error * Update linux.yml * Update linux.yml * Fix compile issues * Disable the skewed tests for now * Disable the skewed tests for now * Fix the issue with vpic scaling * Committing clang-format changes * Add multi-step VPIC * Committing clang-format changes * Update documentation for Perlmutter (#69) * Update getting_started.rst * Update getting_started.rst * Add fcommon flag * Change default client lookup to local server only, remove query test * Committing clang-format changes * Update server automatic flush cache to storage mechnism, minor updates to test code * Committing clang-format changes * Change default consistency to eventual * update Cori CI * update Cori CI * temporarily disable test in CI * update tests for parallel CI * update CI dependecy * set distinct directory for each test * include Perlmutter in the CI * fix path for multiple CIs * update compilation for Perlmutter * fix Perlmutter CI * update Perlmutter CI policy * change scheduler parameters * fix to enable Perlmutter CI * fix to enable Perlmutter CI * fix to enable both Cori and Perlmutter CI * further split CI * Update README.md * Update getting_started.rst * remove unnecessary install block from CMakeLists.txt (#73) * Update Readme for better readability (#74) * update the doc * update readme * update readme with `libibverb` instruction * resolve review comments * improve the readability further * review comments * Fix kvtag tests * Committing clang-format changes * Update CMakelist --------- Co-authored-by: github-actions <github-actions[bot]@users.noreply.github.com> Co-authored-by: Qiao Kang <qiaokang2015@u.northwestern.edu> Co-authored-by: Chen Wang <wangvsa@gmail.com> Co-authored-by: Qiao Kang <QKang@lbl.gov> Co-authored-by: Qiao Kang <qkang@data6.lbl.gov> Co-authored-by: Jonathan Luo <45892670+JLaoo@users.noreply.github.com> Co-authored-by: Jean Luca Bez <jlbez@lbl.gov> Co-authored-by: Zhang Wei <zhangwei217245@gmail.com>
hpc-io · Mar 22, 2023 · 02388ff · 02388ff
1 parent e7f9b70
commit 02388ff
Show file tree

Hide file tree

Showing 160 changed files with 24,394 additions and 3,750 deletions.
diff --git a/.github/workflows/linux.yml b/.github/workflows/linux.yml
@@ -21,7 +21,7 @@ jobs:
         run: .github/workflows/dependencies-linux.sh
 
       - name: Build PDC
-        working-directory: ./src
+        # working-directory: ./src
         run: |
           mkdir build && cd build
           cmake ../ -DBUILD_MPI_TESTING=ON -DBUILD_SHARED_LIBS=ON -DBUILD_TESTING=ON -DPDC_ENABLE_MPI=ON -DCMAKE_C_COMPILER=mpicc
@@ -36,5 +36,5 @@ jobs:
       #     mpirun -n 1 ./close_server
 
       - name: Test PDC
-        working-directory: ./src/build
+        working-directory: build
         run: ctest -L serial
diff --git a/.gitignore b/.gitignore
@@ -2,9 +2,10 @@
 *.swp
 
 # build dir
-*build*
 
 # exes
 *.exe
 
 *.pdf
+
+src/install
diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
@@ -1,30 +1,274 @@
-# This is a global variable
 variables:
-    LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
-    MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+    PDC_BUILD_PATH: "${CI_PROJECT_DIR}/build"
+    PDC_INSTALL_PATH: "${CI_PROJECT_DIR}/install"
 
 stages:
     - build
+    - test
 
-# This stage uses the global SCHEDULER_PARAMETERS variable
-build:
+cori-build:
     stage: build
     tags:
-      - cori
+        - cori
     variables:
         SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
-        # SCHEDULER_PARAMETERS: "--clusters=escori -N 1 --qos=compile -t 00:30:00"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
     script:
-      - echo "Build PDC"
-      # - pwd
-      - module list
-      - cd src && mkdir build && cd build
-      - cmake ../ -DBUILD_MPI_TESTING=ON -DBUILD_SHARED_LIBS=ON -DBUILD_TESTING=ON -DPDC_ENABLE_MPI=ON -DPDC_ENABLE_TIMING=ON -DMERCURY_DIR=$MERCURY_DIR -DCMAKE_C_COMPILER=cc -DCMAKE_C_FLAGS=-dynamic -DMPI_RUN_CMD=srun -DPDC_ENABLE_LUSTRE=ON -DPDC_DISABLE_CHECKPOINT=ON
-      - make -j
-      - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
-      - echo $LD_LIBRARY_PATH
-      # - echo "Run Serial Tests"
-      # - ctest -L serial
-      - echo "Run Parallel Tests"
-      - ctest -L parallel
+        - module list
+        - mkdir -p ${PDC_BUILD_PATH}/cori
+        - cd ${PDC_BUILD_PATH}/cori
+        - cmake ../.. -DBUILD_MPI_TESTING=ON -DBUILD_SHARED_LIBS=ON -DBUILD_TESTING=ON -DPDC_ENABLE_MPI=ON -DPDC_ENABLE_TIMING=ON -DMERCURY_DIR=$MERCURY_DIR -DCMAKE_C_COMPILER=cc -DCMAKE_C_FLAGS=-dynamic -DMPI_RUN_CMD=srun -DPDC_ENABLE_LUSTRE=ON -DPDC_DISABLE_CHECKPOINT=ON -DCMAKE_INSTALL_PREFIX=${PDC_INSTALL_PATH}/cori
+        - make -j
+        - make install
+    artifacts:
+        paths:
+            - ${PDC_BUILD_PATH}/cori
+            - ${PDC_INSTALL_PATH}/cori
 
+perlmutter-build:
+    stage: build
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+    script:
+        - module load libfabric/1.15.2.0
+        - module list
+        - mkdir -p ${PDC_BUILD_PATH}/perlmutter
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - cmake ../.. -DBUILD_MPI_TESTING=ON -DBUILD_SHARED_LIBS=ON -DPDC_SERVER_CACHE=ON -DBUILD_TESTING=ON -DCMAKE_INSTALL_PREFIX=$PDC_DIR -DPDC_ENABLE_MPI=ON -DMERCURY_DIR=$MERCURY_DIR -DCMAKE_C_COMPILER=mpicc -DMPI_RUN_CMD="srun -A m2621 --qos=debug --constraint=cpu --tasks-per-node=64" -DCMAKE_INSTALL_PREFIX=${PDC_INSTALL_PATH}/perlmutter
+        - make -j
+        - make install
+    artifacts:
+        paths:
+            - ${PDC_BUILD_PATH}/perlmutter
+            - ${PDC_INSTALL_PATH}/perlmutter
+
+cori-parallel-pdc:
+    stage: test
+    needs:
+        - cori-build
+    tags:
+        - cori
+    variables:
+        SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-pdc"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-pdc"
+    script:        
+        - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/cori
+        - ctest -L parallel_pdc
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+cori-parallel-obj:
+    stage: test
+    needs:
+        - cori-build
+        - cori-parallel-pdc
+    tags:
+        - cori
+    variables:
+        SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-obj"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-obj"
+    script:        
+        - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/cori
+        - ctest -L parallel_obj
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+cori-parallel-cont:
+    stage: test
+    needs:
+        - cori-build
+        - cori-parallel-pdc
+    tags:
+        - cori
+    variables:
+        SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-cont"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-cont"
+    script:        
+        - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/cori
+        - ctest -L parallel_cont
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+cori-parallel-prop:
+    stage: test
+    needs:
+        - cori-build
+        - cori-parallel-pdc
+    tags:
+        - cori
+    variables:
+        SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-prop"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-prop"
+    script:        
+        - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/cori
+        - ctest -L parallel_prop
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+cori-parallel-region:
+    stage: test
+    needs:
+        - cori-build
+        - cori-parallel-pdc
+    tags:
+        - cori
+    variables:
+        SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-region"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-region"
+    script:        
+        - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/cori
+        - ctest -L parallel_region_transfer
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+cori-parallel-region-all:
+    stage: test
+    needs:
+        - cori-build
+        - cori-parallel-pdc
+    tags:
+        - cori
+    variables:
+        SCHEDULER_PARAMETERS: "-C haswell --qos=debug -N 1 -t 00:30:00 --gres=craynetwork:3"
+        LIBFABRIC_DIR: "/global/cfs/cdirs/m1248/pdc/libfabric-1.12.1/install"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc/mercury-2.0.0/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-region-all"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-region-all"
+    script:        
+        - export LD_LIBRARY_PATH="$LIBFABRIC_DIR/lib:$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/cori
+        - ctest -L parallel_region_transfer_all
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+perlmutter-parallel-pdc:
+    stage: test
+    needs:
+        - perlmutter-build
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-pdc"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-pdc"
+    script:        
+        - export LD_LIBRARY_PATH="$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - ctest -L parallel_pdc
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+perlmutter-parallel-obj:
+    stage: test
+    needs:
+        - perlmutter-build
+        - perlmutter-parallel-pdc
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-obj"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-obj"
+    script:        
+        - export LD_LIBRARY_PATH="$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - ctest -L parallel_obj
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+perlmutter-parallel-cont:
+    stage: test
+    needs:
+        - perlmutter-build
+        - perlmutter-parallel-pdc
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-cont"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-cont"
+    script:        
+        - export LD_LIBRARY_PATH="$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - ctest -L parallel_cont
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+perlmutter-parallel-prop:
+    stage: test
+    needs:
+        - perlmutter-build
+        - perlmutter-parallel-pdc
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-prop"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-prop"
+    script:        
+        - export LD_LIBRARY_PATH="$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - ctest -L parallel_prop
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+perlmutter-parallel-region:
+    stage: test
+    needs:
+        - perlmutter-build
+        - perlmutter-parallel-pdc
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-region"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-region"
+    script:        
+        - export LD_LIBRARY_PATH="$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - ctest -L parallel_region_transfer
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
+
+perlmutter-parallel-region-all:
+    stage: test
+    needs:
+        - perlmutter-build
+        - perlmutter-parallel-pdc
+    tags:
+        - perlmutter
+    variables:
+        SCHEDULER_PARAMETERS: "-A m1248 --qos=debug --constraint=cpu --tasks-per-node=64 -N 1 -t 00:30:00"
+        SUPERCOMPUTER: "perlmutter"
+        MERCURY_DIR: "/global/cfs/cdirs/m1248/pdc-perlmutter/mercury/install"
+        PDC_TMPDIR: "${PDC_BUILD_PATH}/pdc-tmp-paralell-region-all"
+        PDC_DATA_LOC: "${PDC_BUILD_PATH}/pdc-data-paralell-region-all"
+    script:        
+        - export LD_LIBRARY_PATH="$MERCURY_DIR/lib:$LD_LIBRARY_PATH"
+        - cd ${PDC_BUILD_PATH}/perlmutter
+        - ctest -L parallel_region_transfer_all
+        - rm -rf ${PDC_TMPDIR} ${PDC_DATA_LOC}
diff --git a/src/CMake/FindDRC.cmake → CMake/FindDRC.cmake b/src/CMake/FindDRC.cmake → CMake/FindDRC.cmake
diff --git a/src/CMake/pdc-config-version.cmake.in → CMake/pdc-config-version.cmake.in b/src/CMake/pdc-config-version.cmake.in → CMake/pdc-config-version.cmake.in
diff --git a/src/CMake/pdc-config.cmake.build.in → CMake/pdc-config.cmake.build.in b/src/CMake/pdc-config.cmake.build.in → CMake/pdc-config.cmake.build.in
diff --git a/src/CMake/pdc-config.cmake.install.in → CMake/pdc-config.cmake.install.in b/src/CMake/pdc-config.cmake.install.in → CMake/pdc-config.cmake.install.in
-Original file line number
+Diff line change
@@ Expand Up / @@ -2,9 +2,10 @@ @@
     *.swp
     # build dir
-    *build*
     # exes
     *.exe
     *.pdf
+    src/install