Skip to content

Commit e51bd31

Browse files
committed
doc: minor update
1 parent 7109710 commit e51bd31

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

README.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -92,13 +92,12 @@ pip install "git+https://github.com/bigcode-project/bigcodebench.git#egg=bigcode
9292
We use the greedy decoding as an example to show how to evaluate the generated code samples via remote API.
9393

9494
```bash
95+
# greedy decoding by default
9596
bigcodebench.evaluate \
9697
--model meta-llama/Meta-Llama-3.1-8B-Instruct \
9798
--split [complete|instruct] \
9899
--subset [full|hard] \
99-
--backend [vllm|openai|anthropic|google|mistral|hf] \
100-
--tp [TENSOR_PARALLEL_SIZE] \
101-
--greedy
100+
--backend [vllm|openai|anthropic|google|mistral|hf]
102101
```
103102

104103
- All the resulted files will be stored in a folder named `bcb_results`.

0 commit comments

Comments
 (0)