Skip to content

Commit

Permalink
Disable developer tools build for In-process API + JavaCPP tests (#6296)
Browse files Browse the repository at this point in the history
  • Loading branch information
jbkyang-nvi authored and mc-nv committed Sep 19, 2023
1 parent e5ba28b commit 1c32d27
Show file tree
Hide file tree
Showing 5 changed files with 22 additions and 32 deletions.
14 changes: 10 additions & 4 deletions docs/customization_guide/inference_protocols.md
Original file line number Diff line number Diff line change
Expand Up @@ -447,8 +447,8 @@ Java program with the Java bindings with the following steps:
# Run build script
## For In-Process C-API Java Bindings
$ source clientrepo/src/java-api-bindings/scripts/install_dependencies_and_build.sh
## For C-API Wrapper Java Bindings
$ source clientrepo/src/java-api-bindings/scripts/install_dependencies_and_build.sh --enable-developer-tools-server`
## For C-API Wrapper (Triton with C++ bindings) Java Bindings
$ source clientrepo/src/java-api-bindings/scripts/install_dependencies_and_build.sh --enable-developer-tools-server
```
This will install the Java bindings to `/workspace/install/java-api-bindings/tritonserver-java-bindings.jar`

Expand All @@ -472,10 +472,16 @@ If you want to make changes to the Java bindings, then you can use Maven to
build yourself. You can refer to part 1.a of [Run Java program with Java
bindings Jar](#run-java-program-with-java-bindings-jar) to also build the jar
yourself without any modifications to the Tritonserver bindings in
JavaCPP-presets. You can do this using the following steps:
JavaCPP-presets.
You can do this using the following steps:

1. Create the JNI binaries in your local repository (`/root/.m2/repository`)
with [`javacpp-presets/tritonserver`](https://github.com/bytedeco/javacpp-presets/tree/master/tritonserver)
with [`javacpp-presets/tritonserver`](https://github.com/bytedeco/javacpp-presets/tree/master/tritonserver).
For C-API Wrapper Java bindings (Triton with C++ bindings), you need to
install some build specific dependencies including cmake and rapidjson.
Refer to [java installation script](https://github.com/triton-inference-server/client/blob/main/src/java-api-bindings/scripts/install_dependencies_and_build.sh)
for dependencies you need to install and modifications you need to make for your container.
After installing dependencies, you can build the tritonserver project on javacpp-presets:
```bash
$ git clone https://github.com/bytedeco/javacpp-presets.git
$ cd javacpp-presets
Expand Down
10 changes: 3 additions & 7 deletions qa/L0_java_memory_growth/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,14 +27,10 @@

# Set up test files based on installation instructions
# https://github.com/bytedeco/javacpp-presets/blob/master/tritonserver/README.md
set +e
rm -r javacpp-presets
git clone https://github.com/bytedeco/javacpp-presets.git
cd javacpp-presets
mvn clean install --projects .,tritonserver
mvn clean install -f platform --projects ../tritonserver/platform -Djavacpp.platform.host
cd ..
set -e
git clone --single-branch --depth=1 -b ${TRITON_CLIENT_REPO_TAG} https://github.com/triton-inference-server/client.git
source client/src/java-api-bindings/scripts/install_dependencies_and_build.sh -b $PWD --keep-build-dependencies
cd ..

export MAVEN_OPTS="-XX:MaxGCPauseMillis=40"
MODEL_REPO=`pwd`/models
Expand Down
10 changes: 3 additions & 7 deletions qa/L0_java_resnet/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -53,14 +53,10 @@ done

# Set up test files based on installation instructions
# https://github.com/bytedeco/javacpp-presets/blob/master/tritonserver/README.md
set +e
rm -r javacpp-presets
git clone https://github.com/bytedeco/javacpp-presets.git
cd javacpp-presets
mvn clean install --projects .,tritonserver
mvn clean install -f platform --projects ../tritonserver/platform -Djavacpp.platform.host
cd ..
set -e
git clone --single-branch --depth=1 -b ${TRITON_CLIENT_REPO_TAG} https://github.com/triton-inference-server/client.git
source client/src/java-api-bindings/scripts/install_dependencies_and_build.sh -b $PWD --keep-build-dependencies
cd ..

CLIENT_LOG="client.log"
SAMPLES_REPO=`pwd`/javacpp-presets/tritonserver/samples/simple
Expand Down
10 changes: 3 additions & 7 deletions qa/L0_java_sequence_batcher/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -43,14 +43,10 @@ DATADIR=/data/inferenceserver/${REPO_VERSION}

# Set up test files based on installation instructions
# https://github.com/bytedeco/javacpp-presets/blob/master/tritonserver/README.md
set +e
rm -r javacpp-presets
git clone https://github.com/bytedeco/javacpp-presets.git
cd javacpp-presets
mvn clean install --projects .,tritonserver
mvn clean install -f platform --projects ../tritonserver/platform -Djavacpp.platform.host
cd ..
set -e
git clone --single-branch --depth=1 -b ${TRITON_CLIENT_REPO_TAG} https://github.com/triton-inference-server/client.git
source client/src/java-api-bindings/scripts/install_dependencies_and_build.sh -b $PWD --keep-build-dependencies
cd ..

CLIENT_LOG="client.log"
MODEL_REPO=`pwd`/models
Expand Down
10 changes: 3 additions & 7 deletions qa/L0_java_simple_example/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -37,14 +37,10 @@ if [ -z "$REPO_VERSION" ]; then
exit 1
fi

set +e
rm -r javacpp-presets
git clone https://github.com/bytedeco/javacpp-presets.git
cd javacpp-presets
mvn clean install --projects .,tritonserver
mvn clean install -f platform --projects ../tritonserver/platform -Djavacpp.platform.host
cd ..
set -e
git clone --single-branch --depth=1 -b ${TRITON_CLIENT_REPO_TAG} https://github.com/triton-inference-server/client.git
source client/src/java-api-bindings/scripts/install_dependencies_and_build.sh -b $PWD --keep-build-dependencies
cd ..

CLIENT_LOG="client_cpu_only.log"
DATADIR=/data/inferenceserver/${REPO_VERSION}/qa_model_repository
Expand Down

0 comments on commit 1c32d27

Please sign in to comment.