Skip to content

Commit 7109710

Browse files
committed
doc: update full script
1 parent ed9886c commit 7109710

File tree

1 file changed

+3
-4
lines changed

1 file changed

+3
-4
lines changed

run.sh

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,13 @@
11
DATASET=bigcodebench
2-
MODEL=meta-llama/Llama-3.2-1B-Instruct
2+
MODEL=meta-llama/Meta-Llama-3.1-8B-Instruct
33
BACKEND=vllm
4-
NUM_GPU=1
4+
NUM_GPU=2
55
SPLIT=complete
66
SUBSET=hard
77

88
bigcodebench.evaluate \
99
--model $MODEL \
10-
--samples meta-llama--Llama-3.2-1B-Instruct--bigcodebench-hard-complete--vllm-0-1-sanitized_calibrated.jsonl \
1110
--split $SPLIT \
1211
--subset $SUBSET \
1312
--backend $BACKEND \
14-
--greedy
13+
--tp $NUM_GPU

0 commit comments

Comments
 (0)