Skip to content

Commit

Permalink
Fix phishing config.pbtxt which was causing performance degradation (
Browse files Browse the repository at this point in the history
…nv-morpheus#1062)

- Phishing E2E benchmarks revealed 4x throughput degradation from previous benchmarks caused by accidental change to `config.pbtxt`.  `precision_mode` was changed from `FP16` to `FP32`.
- Reverted the above change and now showing throughput improvement from previous release benchmark.

Authors:
  - Eli Fajardo (https://github.com/efajardo-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: nv-morpheus#1062
  • Loading branch information
efajardo-nv authored Jul 18, 2023
1 parent c4fe0f6 commit 65263eb
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion models/triton-model-repo/phishing-bert-onnx/config.pbtxt
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ dynamic_batching {
optimization { execution_accelerators {
gpu_execution_accelerator : [ {
name : "tensorrt"
parameters { key: "precision_mode" value: "FP32" }
parameters { key: "precision_mode" value: "FP16" }
parameters { key: "max_workspace_size_bytes" value: "1073741824" }
}]
}}

0 comments on commit 65263eb

Please sign in to comment.