Skip to content
This repository was archived by the owner on Aug 7, 2025. It is now read-only.

Commit 3cb5a73

Browse files
namannandanNaman Nandan
andauthored
Update path to sample input text for inf2 opt benchmark model (#2617)
* update path to sample input text for inf2 opt benchmark model * test inf2 benchmark fix * Revert "test inf2 benchmark fix" This reverts commit 4679305. --------- Co-authored-by: Naman Nandan <namannan@amazon.com>
1 parent c3ca259 commit 3cb5a73

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

benchmarks/models_config/opt_6.7b_neuronx.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ opt_6.7b_neuronx_batch_1:
88
batch_delay: 100
99
batch_size:
1010
- 1
11-
input: "./examples/large_models/inferentia2/sample_text.txt"
11+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
1212
requests: 2000
1313
concurrency: 10
1414
backend_profiling: False
@@ -25,7 +25,7 @@ opt_6.7b_neuronx_batch_2:
2525
batch_delay: 100
2626
batch_size:
2727
- 2
28-
input: "./examples/large_models/inferentia2/sample_text.txt"
28+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
2929
requests: 2000
3030
concurrency: 10
3131
backend_profiling: False
@@ -42,7 +42,7 @@ opt_6.7b_neuronx_batch_4:
4242
batch_delay: 100
4343
batch_size:
4444
- 4
45-
input: "./examples/large_models/inferentia2/sample_text.txt"
45+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
4646
requests: 2000
4747
concurrency: 10
4848
backend_profiling: False
@@ -59,7 +59,7 @@ opt_6.7b_neuronx_batch_8:
5959
batch_delay: 100
6060
batch_size:
6161
- 8
62-
input: "./examples/large_models/inferentia2/sample_text.txt"
62+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
6363
requests: 2000
6464
concurrency: 10
6565
backend_profiling: False

0 commit comments

Comments
 (0)