This is the implementation of a underworking paper "Beam Search as Tree Parallel Decoding"
Presequites
Important!!!!!
Please use a python virtual environment.
Install requirements with
pip install --no-user -r requirements.txt we modified the transformer library for evaluating resource consumption. run benchmark with
cd benchmark
python main.pythe results will be in benchmark/out