We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent eb986d0 commit 0a26c44Copy full SHA for 0a26c44
run.sh
@@ -36,5 +36,5 @@ bigcodebench.evaluate --subset $SUBSET --samples $FILE_HEADER-sanitized-calibrat
36
# If the ground truth does not work, you can skip it:
37
bigcodebench.evaluate --subset $SUBSET --samples $FILE_HEADER-sanitized-calibrated.jsonl --no-gt
38
39
-# If not the execution is slow:
+# If the execution is slow:
40
bigcodebench.evaluate --subset $SUBSET --samples $FILE_HEADER-sanitized-calibrated.jsonl --parallel 32
0 commit comments