Function calling auto-tool-choice

[RRaphaell]

when I try to deploy a llm which requires the latest update from vllm it shows:
I tried to deploy vllm localy and function calling works when I pass these arguments:
--enable-auto-tool-choice
--tool-call-parser hermes
maybe we need the same thing here but I dont know where to add this arguments

2024-09-22T22:40:15.504307332Z [rank0]: Traceback (most recent call last):
2024-09-22T22:40:15.504342187Z [rank0]:   File "/src/handler.py", line 7, in <module>
2024-09-22T22:40:15.504347942Z [rank0]:     OpenAIvLLMEngine = OpenAIvLLMEngine(vllm_engine)
2024-09-22T22:40:15.504352334Z [rank0]:   File "/src/engine.py", line 122, in __init__
2024-09-22T22:40:15.504356359Z [rank0]:     asyncio.run(self._initialize_engines())
2024-09-22T22:40:15.504360651Z [rank0]:   File "/usr/lib/python3.10/asyncio/runners.py", line 44, in run
2024-09-22T22:40:15.504364911Z [rank0]:     return loop.run_until_complete(main)
2024-09-22T22:40:15.504368929Z [rank0]:   File "/usr/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
2024-09-22T22:40:15.504373289Z [rank0]:     return future.result()
2024-09-22T22:40:15.504377481Z [rank0]:   File "/src/engine.py", line 128, in _initialize_engines
2024-09-22T22:40:15.504381457Z [rank0]:     self.chat_engine = OpenAIServingChat(
2024-09-22T22:40:15.504385907Z [rank0]:   File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 70, in __init__
2024-09-22T22:40:15.504390268Z [rank0]:     self.chat_template = load_chat_template(chat_template)
2024-09-22T22:40:15.504394291Z [rank0]:   File "/usr/local/lib/python3.10/dist-packages/vllm/entrypoints/chat_utils.py", line 309, in load_chat_template
2024-09-22T22:40:15.504399968Z [rank0]:     with open(chat_template, "r") as f:
2024-09-22T22:40:15.504407248Z [rank0]: TypeError: expected str, bytes or os.PathLike object, not dict

[RRaphaell]

@pandyamarut