File tree Expand file tree Collapse file tree 2 files changed +20
-13
lines changed
Expand file tree Collapse file tree 2 files changed +20
-13
lines changed Original file line number Diff line number Diff line change 1- name : " 🐛 Report Bad Contract "
2- description : Report to us that certain program contract should be repaired.
3- title : " 🐛 [TestRemoval ] - <TASK_ID> <WHY>"
4- labels : ["program contract "]
1+ name : " 🐛 Report Bad Task "
2+ description : Report to us that certain programming task should be repaired.
3+ title : " 🐛 [TaskRemoval/TaskRepair ] - <TASK_ID> <WHY>"
4+ labels : ["programming task "]
55body :
66 - type : input
77 id : version
88 attributes :
99 label : " BigCodeBench version"
1010 description : What is the version of BigCodeBench? You can find it by running `pip show bigcodebench`.
11- placeholder : For example, 0.1.0
11+ placeholder : For example, 0.1.5
1212 validations :
1313 required : true
1414 - type : input
@@ -27,15 +27,15 @@ body:
2727 - type : textarea
2828 id : original
2929 attributes :
30- label : " The original wrong contract "
31- description : You can run `python -c "from bigcodebench.data import get_bigcodebench print(get_bigcodebench['BigCodeBench/❓']['contract '])"`
30+ label : " The original complete prompt "
31+ description : You can run `python -c "from bigcodebench.data import get_bigcodebench print(get_bigcodebench['BigCodeBench/❓']['complete_prompt '])"`
3232 render : python
3333 validations :
3434 required : true
3535 - type : textarea
3636 id : new
3737 attributes :
38- label : " Your proposed new contract "
38+ label : " Your proposed new complete prompt "
3939 render : python
4040 validations :
4141 required : true
Original file line number Diff line number Diff line change 11name : " 🐛 Report Bad Test Inputs"
22description : Report to us that certain test inputs should be removed.
3- title : " 🐛 [TestRemoval] - <TASK_ID> <WHY>"
3+ title : " 🐛 [TestRemoval/TestRepair ] - <TASK_ID> <WHY>"
44labels : ["bug"]
55body :
66 - type : input
@@ -21,14 +21,21 @@ body:
2121 id : task_id
2222 attributes :
2323 label : " Task ID of the programming task"
24- placeholder : HumanEval /[??]
24+ placeholder : BigCodeBench /[??]
2525 validations :
2626 required : true
2727 - type : textarea
28- id : test_input
28+ id : original
2929 attributes :
30- label : " Test input"
31- description : The text form of the test input that you think should be removed
30+ label : " The original test"
31+ description : You can run `python -c "from bigcodebench.data import get_bigcodebench print(get_bigcodebench['BigCodeBench/❓']['test'])"`
32+ render : python
33+ validations :
34+ required : true
35+ - type : textarea
36+ id : new
37+ attributes :
38+ label : " Your proposed new test"
3239 render : python
3340 validations :
3441 required : true
You can’t perform that action at this time.
0 commit comments