We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 7b688cd commit 4a23976Copy full SHA for 4a23976
bigcodebench/generate.py
@@ -145,7 +145,7 @@ def main():
145
trust_remote_code=args.trust_remote_code
146
)
147
148
- extra = "-" + args.subset if args.subset else ""
+ extra = "-" + args.subset if args.subset != "full" else ""
149
if not args.save_path:
150
save_path = args.model.replace("/", "--") + f"--bigcodebench{extra}-{args.split}--{args.backend}-{args.temperature}-{args.n_samples}.jsonl"
151
else:
0 commit comments