Skip to content
This repository was archived by the owner on Aug 7, 2025. It is now read-only.

Commit c658bc7

Browse files
authored
Merge fdec204 into c3ca259
2 parents c3ca259 + fdec204 commit c658bc7

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

benchmarks/models_config/opt_6.7b_neuronx.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ opt_6.7b_neuronx_batch_1:
88
batch_delay: 100
99
batch_size:
1010
- 1
11-
input: "./examples/large_models/inferentia2/sample_text.txt"
11+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
1212
requests: 2000
1313
concurrency: 10
1414
backend_profiling: False
@@ -25,7 +25,7 @@ opt_6.7b_neuronx_batch_2:
2525
batch_delay: 100
2626
batch_size:
2727
- 2
28-
input: "./examples/large_models/inferentia2/sample_text.txt"
28+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
2929
requests: 2000
3030
concurrency: 10
3131
backend_profiling: False
@@ -42,7 +42,7 @@ opt_6.7b_neuronx_batch_4:
4242
batch_delay: 100
4343
batch_size:
4444
- 4
45-
input: "./examples/large_models/inferentia2/sample_text.txt"
45+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
4646
requests: 2000
4747
concurrency: 10
4848
backend_profiling: False
@@ -59,7 +59,7 @@ opt_6.7b_neuronx_batch_8:
5959
batch_delay: 100
6060
batch_size:
6161
- 8
62-
input: "./examples/large_models/inferentia2/sample_text.txt"
62+
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
6363
requests: 2000
6464
concurrency: 10
6565
backend_profiling: False

0 commit comments

Comments
 (0)