Beam Search Baseline

[Laknath1996]

I have been going through generate/synthesis_exp.py script. I noticed that default num_beams is set to 1 for the generation. Does this mean you're doing greedy decoding for "Beam-Search" entry of the Table 1 metrics in the paper? Thanks

[shunzh]

Thanks for your question! We actually used a beam size of 5 as described in the paper. So there's a missing argument in the script (I reorganized the scripts before release and it looks like I missed this argument). I just updated the script below. Sorry for the confusion.

Code-AI-Tree-Search/generate/scripts/beam/run.sh

Line 5 in d075c68

extra='--alg bs --num-beams 5'