Skip to content

Commit 07e3b22

Browse files
committed
update
1 parent 1b00dcc commit 07e3b22

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

scripts/run_textgen_benchmark_breakdown.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ TOKEN_STEP=${5:-5}
1212
STEP_ID=${6:-""}
1313
CYCLES=${7:-10}
1414

15-
SAVE_DIR=data/benchmarks/v3
15+
SAVE_DIR=data/benchmarks/v4
1616
#BATCH_SIZES="1 2 4 8 16 24 32 48 64 96 128 160 224 256"
1717
RUN="python3 -m src.main --pipeline_class=TG_Pipeline --max_log_outputs=0 --dtype=float16 --device=cuda --custom_generate --breakdown_latency --ignore_oom --no_fast_init "
1818

0 commit comments

Comments
 (0)